The Unintended Consequences of Automated Scripts in Crowdwork Platforms: A Simulation Study in MTurk

Xie, Haoyu; Checco, Alessandro; Zamani, Efpraxia D.

Abstract

Crowdworkers on platforms like Amazon Mechanical Turk face growing competition as a result of the global excess supply of digital labour. As a result, many crowdworkers turn to automated scripts, which help them locate better tasks faster and to boost their earnings. However, to date, it is not clear whether and to what extent the use of such scripts influence the opportunities for those crowdworkers who do not use them. This an important aspect that warrants further exploration because it can have negative implications for the health of crowdwork platforms. In this study, we use Discrete Event Simulation to identify and quantify the unintended consequences of the excessive use of automated scripts. Our findings show that, while the use of scripts allows some crowdworkers to identify and accept far more tasks than others, in the long run, this behaviour results in their competence persistence and reputational persistence and progressively to detrimental impacts for those workers who do not use scripts, and who may ultimately be forced to exit the platform. As a result, automated scripts have negative consequences, whereby their excessive use leads to a tragedy of the commons for all platform stakeholders, including the crowdworkers, the job requesters and the platform itself.

Citation

Xie, H., Checco, A., & Zamani, E. D. (2023). The Unintended Consequences of Automated Scripts in Crowdwork Platforms: A Simulation Study in MTurk. Information Systems Frontiers, https://doi.org/10.1007/s10796-023-10373-x

• Journal Article Type: Article
• Acceptance Date: Jan 12, 2023
• Online Publication Date: Jan 21, 2023
• Publication Date: Jan 21, 2023
• Deposit Date: Aug 16, 2023
• Journal: Information Systems Frontiers
• Print ISSN: 1387-3326
• Electronic ISSN: 1572-9419
• Publisher: Springer
• Peer Reviewed: Peer Reviewed
• DOI: https://doi.org/10.1007/s10796-023-10373-x
• Keywords: Computer Networks and Communications; Information Systems; Theoretical Computer Science; Software
• Public URL: https://durham-repository.worktribe.com/output/1718722
• Related Public URLs: https://eprints.whiterose.ac.uk/195506/