Not logged in.

Contribution Details

Type Journal Article
Scope Discipline-based scholarship
Title Interactive video retrieval in the age of effective joint embedding deep models: lessons from the 11th VBS
Organization Unit
  • Jakub Lokoč
  • Stelios Andreadis
  • Werner Bailer
  • Aaron Duane
  • Cathal Gurrin
  • Zhixin Ma
  • Nicola Messina
  • Thao-Nhu Nguyen
  • Ladislav Peška
  • Luca Rossetto
  • Loris Sauter
  • Konstantin Schall
  • Klaus Schoeffmann
  • Omar Shahbaz Khan
  • Florian Spiess
  • Lucia Vadicamo
  • Stefanos Vrochidis
Item Subtype Original Work
Refereed Yes
Status Published in final form
  • English
Journal Title Multimedia Systems
Publisher Springer
Geographical Reach international
ISSN 0942-4962
Volume 29
Number 6
Page Range 3481 - 3504
Date 2023
Abstract Text This paper presents findings of the eleventh Video Browser Showdown competition, where sixteen teams competed in known-item and ad-hoc search tasks. Many of the teams utilized state-of-the-art video retrieval approaches that demonstrated high effectiveness in challenging search scenarios. In this paper, a broad survey of all utilized approaches is presented in connection with an analysis of the performance of participating teams. Specifically, both high-level performance indicators are presented with overall statistics as well as in-depth analysis of the performance of selected tools implementing result set logging. The analysis reveals evidence that the CLIP model represents a versatile tool for cross-modal video retrieval when combined with interactive search capabilities. Furthermore, the analysis investigates the effect of different users and text query properties on the performance in search tasks. Last but not least, lessons learned from search task preparation are presented, and a new direction for ad-hoc search based tasks at Video Browser Showdown is introduced.
Digital Object Identifier 10.1007/s00530-023-01143-5
Other Identification Number merlin-id:23967
PDF File Download from ZORA
Export BibTeX