Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title Behavior-Based Quality Assurance in Crowdsourcing Markets
Organization Unit
  • Michael Feldman
  • Abraham Bernstein
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
  • English
Event Title Conference on Human Computation & Crowdsourcing 2014
Event Type conference
Event Location Pittsburgh, USA
Event Start Date November 2 - 2014
Event End Date November 4 - 2014
Place of Publication Pittsburgh, USA
Publisher s.n.
Abstract Text Quality assurance in crowdsourcing markets has appeared to be an acute problem over the last years. We propose a quality control method inspired by Statistical Process Control (SPC), commonly used to control output quality in production processes and characterised by relying on time-series data. Behavioural traces of users may play a key role in evaluating the performance of work done on crowdsourcing platforms. Therefore, in our experiment we explore fifteen behavioural traces for their ability to recognise the drop in work quality. Preliminary results indicate that our method has a high potential for real-time detection and signalling a drop in work quality.
Other Identification Number merlin-id:10078
PDF File Download from ZORA
Export BibTeX