Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title Task Routing and Assignment in Crowdsourcing based on Cognitive Abilities
Organization Unit
  • Jorge Goncalves
  • Michael Feldman
  • Subingqian Hu
  • Vassilis Kostakos
  • Abraham Bernstein
Presentation Type paper
Item Subtype Original Work
Refereed No
Status Published in final form
  • English
Event Title World Wide Web Conference - Web Science Track
Event Type conference
Event Location Perth, Australia
Event Start Date April 3 - 2017
Event End Date April 7 - 2017
Place of Publication Geneva
Abstract Text Appropriate task routing and assignment is an important, but often overlooked, element in crowdsourcing research and practice. In this paper, we explore and evaluate a mechanism that can enable matching crowdsourcing tasks to suitable crowd-workers based on their cognitive abilities. We measure participants’ visual and fluency cognitive abilities with the well-established Kit of Factor- Referenced Cognitive Test, and measure crowdsourcing performance with our own set of developed tasks. Our results indicate that participants’ cognitive abilities correlate well with their crowdsourcing performance. We also built two predictive models (beta and linear regression) for crowdsourcing task performance based on the performance on cognitive tests as explanatory variables. The model results suggest that it is feasible to predict crowdsourcing performance based on cognitive abilities. Finally, we discuss the benefits and challenges of leveraging workers’ cognitive abilities to improve task routing and assignment in crowdsourcing environments.
Free access at DOI
Digital Object Identifier 10.1145/3041021.3055128
Other Identification Number merlin-id:14648
PDF File Download from ZORA
Export BibTeX