Not logged in.
Quick Search - Contribution
Contribution Details
Type | Conference or Workshop Paper |
Scope | Discipline-based scholarship |
Published in Proceedings | No |
Title | The Challenge of Technical Text |
Authors |
|
Item Subtype | Original Work |
Refereed | Yes |
Status | Published in final form |
Event Title | LREC-2002, Workshop on Question Answering: Strategy and Resources |
Place of Publication | Las Palmas, Spain |
Abstract Text | When evaluating and comparing Answer Extraction and Question Answering systems one can distinguish between scenarios for different information needs such as the “Fact Finding”, the “Problem Solving”, and the “Generic Information” scenarios. For each scenario, speci?c types of questions and speci?c types of texts have to be taken into account, each one causing speci?c problems. We argue that comparative evaluations of such systems should not be limited to a single type of information need and one speci?c text type. We use the example of technical manuals and a working Answer Extraction system, “ExtrAns”, to show that other, and important, problems will be encountered in the other cases. We also argue that the quality of the individual answers could be determined automatically through the parameters of correctness and succinctness, i.e. measures for recall and precision on the level of unifying predicates, against a (hand-crafted) gold standard of “ideal answers”. |
Export |
BibTeX
EP3 XML (ZORA) |