Not logged in.
Quick Search - Contribution
Contribution Details
Type | Conference or Workshop Paper |
Scope | Discipline-based scholarship |
Published in Proceedings | Yes |
Title | How to translate a book within an hour - Towards general purpose programmable human computers with CrowdLang |
Organization Unit | |
Authors |
|
Presentation Type | paper |
Item Subtype | Original Work |
Refereed | Yes |
Status | Published in final form |
Language |
|
Event Title | Web Science 2012 |
Event Type | conference |
Event Location | Evanston, Illinois, USA. |
Event Start Date | June 22 - 2012 |
Event End Date | June 24 - 2012 |
Place of Publication | New Yortk, NY, USA |
Abstract Text | In this paper we present the programming language and framework CrowdLang for engineering complex computation systems incorporating large numbers of networked humans and machines agents. We evaluate CrowdLang by developing a text translation program incorporating human and machine agents. The evaluation shows that we are able to simply explore a large design space of possible problem solving programs with the simple variation of the used abstractions. Furthermore, an experiment, involving 1918 different human actors, shows that the developed mixed human-machine translation program significantly outperforms a pure machine translation in terms of adequacy and fluency whilst translating more than 30 pages per hour and that the program approximates the professional translated gold-standard to 75% using the automatic evaluation metric METEOR. Last but not least, our evaluation illustrates that our new human computation pattern staged-contest with pruning outperforms all other refinements in the translation task. |
Related URLs | |
Digital Object Identifier | 10.1145/2380718.2380745 |
Other Identification Number | merlin-id:6988 |
PDF File |
![]() |
Export |
![]() ![]() |