Not logged in.

Contribution Details

Type Conference or Workshop Paper
Scope Discipline-based scholarship
Published in Proceedings Yes
Title E-RAFT: Dense Optical Flow from Event Cameras
Organization Unit
Authors
  • Mathias Gehrig
  • Mario Millhausler
  • Daniel Gehrig
  • Davide Scaramuzza
Presentation Type paper
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
ISBN 978-1-6654-2688-6
Page Range 197 - 206
Event Title 2021 International Conference on 3D Vision (3DV)
Event Type conference
Event Location London
Event Start Date January 1 - 2022
Event End Date January 3 - 2022
Publisher IEEE
Abstract Text We propose to incorporate feature correlation and sequential processing into dense optical flow estimation from event cameras. Modern frame-based optical flow methods heavily rely on matching costs computed from feature correlation. In contrast, there exists no optical flow method for event cameras that explicitly computes matching costs. Instead, learning-based approaches using events usually resort to the U-Net architecture to estimate optical flow sparsely. Our key finding is that the introduction of correlation features significantly improves results compared to previous methods that solely rely on convolution layers. Compared to the state-of-the-art, our proposed approach computes dense optical flow and reduces the end-point error by 23% on MVSEC. Furthermore, we show that all existing optical flow methods developed so far for event cameras have been evaluated on datasets with very small displacement fields with maximum flow magnitude of 10 pixels. Based on this observation, we introduce a new real-world dataset that exhibits displacement fields with magnitudes up to 210 pixels and 3 times higher camera resolution. Our proposed approach reduces the end-point error on this dataset by 66%.
Related URLs
Digital Object Identifier 10.1109/3DV53792.2021.00030
Other Identification Number merlin-id:22172
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)