Not logged in.

Contribution Details

Type Journal Article
Scope Discipline-based scholarship
Title Augmenting Visual Place Recognition With Structural Cues
Organization Unit
Authors
  • Amadeus Oertel
  • Titus Cieslewski
  • Davide Scaramuzza
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
Journal Title IEEE Robotics and Automation Letters
Publisher Institute of Electrical and Electronics Engineers
Geographical Reach international
ISSN 2377-3766
Volume 5
Number 4
Page Range 5534 - 5541
Date 2020
Abstract Text In this letter, we propose to augment image-based place recognition with structural cues. Specifically, these structural cues are obtained using structure-from-motion, such that no additional sensors are needed for place recognition. This is achieved by augmenting the 2D convolutional neural network (CNN) typically used for image-based place recognition with a 3D CNN that takes as input a voxel grid derived from the structure-from-motion point cloud. We evaluate different methods for fusing the 2D and 3D features and obtain best performance with global average pooling and simple concatenation. On the Oxford RobotCar dataset, the resulting descriptor exhibits superior recognition performance compared to descriptors extracted from only one of the input modalities, including state-of-the-art image-based descriptors. Especially at low descriptor dimensionalities, we outperform state-of-the-art descriptors by up to 90%.
Related URLs
Digital Object Identifier 10.1109/LRA.2020.3009077
Other Identification Number merlin-id:20321
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)