Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title Data-Driven Feature Tracking for Event Cameras
Organization Unit
Authors
  • Nico Messikommer
  • Carter Fang
  • Mathias Gehrig
  • Davide Scaramuzza
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
ISBN 979-8-3503-0129-8
ISSN 1063-6919
Page Range 5642 - 5651
Event Title 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023
Event Type conference
Event Location Vancouver, BC, Canada
Event Start Date June 18 - 2023
Event End Date June 22 - 2023
Series Name IEEE Conference on Computer Vision and Pattern Recognition. Proceedings
Publisher Institute of Electrical and Electronics Engineers
Abstract Text Because of their high temporal resolution, increased resilience to motion blur, and very sparse output, event cameras have been shown to be ideal for low-latency and low-bandwidth feature tracking, even in challenging scenarios. Existing feature tracking methods for event cameras are either handcrafted or derived from first principles but require extensive parameter tuning, are sensitive to noise, and do not generalize to different scenarios due to unmodeled effects. To tackle these deficiencies, we introduce the first data-driven feature tracker for event cameras, which leverages low-latency events to track features detected in a grayscale frame. We achieve robust performance via a novel frame attention module, which shares information across feature tracks. By directly transferring zero-shot from synthetic to real data, our data-driven tracker outperforms existing approaches in relative feature age by up to 120 % while also achieving the lowest latency. This performance gap is further increased to 130 % by adapting our tracker to real data with a novel self-supervision strategy.
Digital Object Identifier 10.1109/CVPR52729.2023.00546
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)