Super Mario Meets AI: Experimental Effects of Automation and Skills on Team Performance and Coordination

Abstract

This article studies the effects of the adoption of artificial intelligence on teams and their performance and coordination in a laboratory experiment. We posit that automation decreases organizational performance, interferes with team member coordination, and leads to behavioral changes in human co-workers. We randomize the introduction of automated players and new hires into "laboratory firms" (Weber and Camerer, 2003) who must coordinate in teams playing a game on the Nintendo Switch console. We demonstrate experimentally that even in a task where AI outperforms humans, the replacement of a human player by an automated videogame agent decreases team performance. We also find that automation leads to an increase in coordination failures, and reduces team trust and individual effort provision. Finally, we explore the distributional consequences of introducing AI within teams and show that the performance effects are especially large in the short-term and in low- and medium-skilled teams whose skills we pre-tested. Overall, our team-based design supports a perspective that collaborative human-machine interaction is key to the positive transformation that AI may bring to teams, organizations, and work more broadly.


Research paper available here
Link
We care about your privacy so we do not store nor use any cookie unless it is stricly necessary to make the website to work
Got it
Learn more