Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title Evaluating semantic search tools using the SEALS platform
Organization Unit
Authors
  • S N Wrigley
  • K Elbedweihy
  • Dorothee Reinhard
  • Abraham Bernstein
  • F Ciravegna
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
Event Title International Workshop on Evaluation of Semantic Technologies (IWEST 2010) Workshop
Event Type workshop
Event Location Shanghai, China
Event Start Date November 8 - 2010
Event End Date November 8 - 2010
Abstract Text In common with many state of the art semantic technologies, there is a lack of comprehensive, established evaluation mechanisms for semantic search tools. In this paper, we describe a new evaluation and benchmarking approach for semantic search tools using the infrastructure under development within the SEALS initiative. To our knowledge, it is the first effort to present a comprehensive evaluation methodology for semantic search tools. The paper describes the evaluation methodology including our two-phase approach in which tools are evaluated both in a fully automated fashion as well as within a user-based study. We also present and discuss preliminary results from the first SEALS evaluation campaign together with a discussion of some of the key findings.
Other Identification Number 1475; merlin-id:13
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)