Not logged in.

Quick Search - Contribution

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title Multi-Mode Clustering for Graph-Based Lifelog Retrieval
Organization Unit
Authors
  • Luca Rossetto
  • Oana Inel
  • Svenja Lange
  • Florian Ruosch
  • Ruijie Wang
  • Abraham Bernstein
Editors
  • Cathal Gurrin
  • Bjorn Por Jonsson
  • Duc Tien Dang Nguyen
  • Graham Healy
  • Jakub Lokoc
  • Liting Zhou
  • Luca Rossetto
  • Minh-Triet Tran
  • Wolfgang Hurst
  • Werner Bailer
  • Klaus Schoeffmann
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
ISBN 9798400701887
Page Range 36 - 40
Event Title ICMR '23: International Conference on Multimedia Retrieval
Event Type workshop
Event Location Thessaloniki Greece
Event Start Date July 12 - 2023
Event End Date July 15 - 2023
Series Name Proceedings of the 2023 International Conference on Multimedia Retrieval
Place of Publication New York, NY, USA
Publisher ACM Digital library
Abstract Text As part of the 6th Lifelog Search Challenge, this paper presents an approach to arrange Lifelog data in a multi-modal knowledge graph based on cluster hierarchies. We use multiple sequence clustering approaches to address the multi-modal nature of Lifelogs in relation to temporal, spatial, and visual factors. The resulting clusters, along with semantic metadata captions and augmentations based on OpenCLIP, provide for the semantic structure of a graph including all Lifelogs as entries. Textual queries on this hierarchical graph can be expressed to retrieve individual Lifelogs, as well as clusters of Lifelogs.
Digital Object Identifier 10.1145/3592573.3593102
Other Identification Number merlin-id:23770
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)