Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title Neuromorphic Optical Flow and Real-time Implementation with Event Cameras
Organization Unit
Authors
  • Yannick Schnider
  • Stanislaw Woźniak
  • Mathias Gehrig
  • Jules Lecomte
  • Axel Von Arnim
  • Luca Benini
  • Davide Scaramuzza
  • Angeliki Pantazi
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
ISBN 979-8-3503-0249-3
ISSN 2160-7508
Page Range 4129 - 4138
Event Title 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2023
Event Type conference
Event Location Vancouver, BC, Canada
Event Start Date June 18 - 2023
Event End Date June 22 - 2023
Series Name IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Publisher Institute of Electrical and Electronics Engineers
Abstract Text Optical flow provides information on relative motion that is an important component in many computer vision pipelines. Neural networks provide high accuracy optical flow, yet their complexity is often prohibitive for application at the edge or in robots, where efficiency and latency play crucial role. To address this challenge, we build on the latest developments in event-based vision and spiking neural networks. We propose a new network architecture, inspired by Timelens, that improves the state-of-the-art self-supervised optical flow accuracy when operated both in spiking and non-spiking mode. To implement a real-time pipeline with a physical event camera, we propose a methodology for principled model simplification based on activity and latency analysis. We demonstrate high speed optical flow prediction with almost two orders of magnitude reduced complexity while maintaining the accuracy, opening the path for real-time deployments.
Digital Object Identifier 10.1109/CVPRW59228.2023.00434
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)