Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title CrowdLang: A Programming Language for the Systematic Exploration of Human Computation Systems
Organization Unit
  • Patrick Minder
  • Abraham Bernstein
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
  • English
Event Title Fourth International Conference on Social Informatics (SocInfo 2012)
Event Type conference
Event Location Lausanne
Event Start Date December 5 - 2012
Event End Date December 7 - 2012
Place of Publication Lausanne
Publisher Springer
Abstract Text Human computation systems are often the result of extensive lengthy trial-and-error refinements. What we lack is an approach to systematically engineer solutions based on past successful patterns.In this paper we present the CrowdLang1 programming framework for engineering complex computation systems incorporating large crowds of networked humans and machines with a library of known interaction patterns. We evaluate CrowdLang by programming a German-to-English translation program incorporating machine translation and a monolingual crowd. The evaluation shows that CrowdLang is able to simply explore a large design space of possible problem-solving programs with the simple variation of the used abstractions. In an experiment involving 1918 different human actors, we show that the resulting translation program significantly outperforms a pure machine translation in terms of adequacy and fluency whilst translating more than 30 pages per hour and approximates the human-translated gold standard to 75%.
Other Identification Number merlin-id:7322
PDF File Download from ZORA
Export BibTeX
Funders This work was supported in part by the Swiss National Science Foundation (SNSF- Project: 200021-143411/1)
Keywords CrowdLang,ProgrammingLanguage,HumanComputation, Collective Intelligence, Crowdsourcing, Translation Software