Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title How to translate a book within an hour - Towards general purpose programmable human computers with CrowdLang
Organization Unit
  • Patrick Minder
  • Abraham Bernstein
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
  • English
Event Title Web Science 2012
Event Type conference
Event Location Evanston, Illinois, USA.
Event Start Date June 22 - 2012
Event End Date June 24 - 2012
Place of Publication New Yortk, NY, USA
Abstract Text In this paper we present the programming language and framework CrowdLang for engineering complex computation systems incorporating large numbers of networked humans and machines agents. We evaluate CrowdLang by developing a text translation program incorporating human and machine agents. The evaluation shows that we are able to simply explore a large design space of possible problem solving programs with the simple variation of the used abstractions. Furthermore, an experiment, involving 1918 different human actors, shows that the developed mixed human-machine translation program significantly outperforms a pure machine translation in terms of adequacy and fluency whilst translating more than 30 pages per hour and that the program approximates the professional translated gold-standard to 75% using the automatic evaluation metric METEOR. Last but not least, our evaluation illustrates that our new human computation pattern staged-contest with pruning outperforms all other refinements in the translation task.
Related URLs
Digital Object Identifier 10.1145/2380718.2380745
Other Identification Number merlin-id:6988
PDF File Download from ZORA
Export BibTeX