Event-driven stereo vision algorithm based on silicon retina sensors

Research output: Chapter in Book/Report/Conference proceedingsConference contribution

2 Citations (Scopus)

Abstract

In this paper a new stereo matching concept for event-driven silicon retinae is presented. The main contribution of the proposed approach is the correlation of incoming events. As a novelty, not only the spatial information is used, but also the time of occurrence of the events as a part of the similarity measure. Stereo matching is used in depth generating camera systems for solving the correspondence problem and for 3D reconstruction of the sensed environment. In fact, using conventionally frame-based cameras, this is a time consuming and computationally expensive task, especially for high frame rates and spatial resolutions. An event-based silicon retina delivers events only on illumination changes and completely asynchronous in time. The sensor provides no frames, but a time-continuous data stream of intensity differences and thus inherently reduces the visual information to a minimum. This paper focuses on an event-based stereo matching algorithm implemented in hardware on a field programmable gate array (FPGA) that allows a reliable matching of the sparse input event data. Furthermore, the approach is compared to other standard frame-based and event driven stereo methods. The results show that the achieved depth map outperforms other algorithms in terms of accuracy and the calculation performance of the hardware architecture is in the range or still higher than state-of-the-art computing platforms.

Original languageEnglish
Title of host publication2017 27th International Conference Radioelektronika, RADIOELEKTRONIKA 2017
ISBN (Electronic)9781509045914
DOIs
Publication statusPublished - 31 May 2017
Event 27th International Conference Radioelektronika (RADIOELEKTRONIKA) - Brno, Czech Republic
Duration: 19 Apr 201720 Apr 2017
https://www.marew.cz/

Publication series

Name2017 27th International Conference Radioelektronika, RADIOELEKTRONIKA 2017

Conference

Conference 27th International Conference Radioelektronika (RADIOELEKTRONIKA)
CountryCzech Republic
CityBrno
Period19.04.201720.04.2017
Internet address

Keywords

  • Event-Based
  • Field Programmable Gate Array
  • Hardware Architecture
  • Silicon Retina
  • Stereo Vision

Fingerprint Dive into the research topics of 'Event-driven stereo vision algorithm based on silicon retina sensors'. Together they form a unique fingerprint.

Cite this