Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title Evaluating semantic search systems to identify future directions of research
Organization Unit
  • Khadija Elbedweihy
  • Stuart N Wrigley
  • Fabio Ciravegna
  • Dorothee Reinhard
  • Abraham Bernstein
  • Raúl García-Castro
  • Nixon Lyndon
  • Stuart N Wrigley
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
  • English
ISSN 1613-0073
Page Range 25 - 36
Event Title Second International Workshop on Evaluation of Semantic Technologies
Event Type workshop
Event Location Heraklion, Greece
Event Start Date May 28 - 2012
Event End Date May 28 - 2012
Series Name CEUR Workshop Proceedings
Number 843
Abstract Text Recent work on searching the Semantic Web has yielded a wide range of approaches with respect to the style of input, the underlying search mechanisms and the manner in which results are presented. Each approach has an impact upon the quality of the information retrieved and the user’s experience of the search process. This highlights the need for formalised and consistent evaluation to benchmark the coverage, applicability and usability of existing tools and provide indications of future directions for advancement of the state-of-the-art. In this paper, we describe a comprehensive evaluation methodology which addresses both the underlying performance and the subjective usability of a tool. We present the key outcomes of a recently completed international evaluation campaign which adopted this approach and thus identify a number of new requirements for semantic search tools from both the perspective of the underlying technology as well as the user experience.
Official URL
Related URLs
Other Identification Number merlin-id:6971
PDF File Download from ZORA
Export BibTeX