Real-time Low-Cost Omni-directional Stereo Vision via Bi-Polar Spherical Cameras

Lin, K.; Breckon, T.P.

Abstract

With the rise of consumer-grade spherical cameras, offering full omni-directional 360∘ image capture, the potential for low-cost omni-directional stereo vision is ever present. Whilst this potentially offers novel low-cost omni-directional depth sensing without the need for active range sensing, it presents a number of challenges associated with the realization of contemporary dense stereo matching across this spherical imaging format. In this work, we outline an approach for omni-directional dense stereo vision, based on imagery from two consumer-grade spherical cameras mounted in a bi-polar configuration, offering 360∘ depth recovery at 5.5 fps. Specifically we outline the required aspects of inter-camera calibration and equirectangular image correction before detailing the required angular disparity correction that is unique to this stereo sensing formulation. Furthermore we illustrate the disparity and synchronization error achievable with the use of such consumer-grade spherical camera units, in addition to the quality of disparity (depth) available, within the context of on-road sensing for future vehicle autonomy.

Citation

Lin, K., & Breckon, T. (2018, June). Real-time Low-Cost Omni-directional Stereo Vision via Bi-Polar Spherical Cameras. Presented at 15th International Conference on Image Analysis and Recognition (ICIAR 2018)., Póvoa de Varzim, Portugal

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 15th International Conference on Image Analysis and Recognition (ICIAR 2018).
• Start Date: Jun 27, 2018
• End Date: Jun 29, 2018
• Publication Date: 2018
• Deposit Date: Apr 4, 2018
• Publisher: Springer Verlag
• Pages: 315-325
• Book Title: Proc. Int. Conf. Image Analysis and Recognition
• DOI: https://doi.org/10.1007/978-3-319-93000-8_36
• Keywords: stereo vision, spherical camera, angular disparity correction, bi-polar stereo, vertical stereo, spherical stereo
• Public URL: https://durham-repository.worktribe.com/output/1145673
• Publisher URL: https://breckon.org/toby/publications/papers/lin18spherical.pdf