360 Degree Fish Eye Optical Construction for Equirectangular Projection of Panoramic Images

Bo Hong Lin, Hou Zhen Cheng, Yu Ting Li, Jiun In Guo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Intelligent transportation systems is widely studied in autonomous driving car recently. To identify the location of Autonomous driving car and verify the environment, Simultaneous Localization and Mapping (SLAM) is a concept for constructing the unknown environment model and estimating sensor motion during movement. One of the major challenges of monocular SLAM is fast movement and video image suture on dual fisheye camera. A field of view of a general monocular camera is limited to barely 50 to 70 degrees. For these reasons, this paper chooses dual back-to-back fisheye cameras to overcome the narrow field of view and capture 360-degree images for monitor and SLAM applications. However, the fisheye lens poses a challenge of large distortion and the angle of the two fisheye camera causes image difference while unwrapping and blending to get a 360-degree panoramic image. This paper proposes an algorithm to successfully calibrate, project, stitch, and blend to acquire the equirectangular panoramic images. The experimental result shows that this algorithm is effective, fast (27.7 FPS), and overcomes the difficulties of significant changes in the scene of continuous frames when the dual eye fish camera is in motion on Xavier without using the graphic card. This fast and accurate image stitching method can also apply to the bird view of an autonomous driving car on fast-moving status.

Original languageEnglish
Title of host publicationProceedings - 2020 International Conference on Pervasive Artificial Intelligence, ICPAI 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages194-198
Number of pages5
ISBN (Electronic)9780738142623
DOIs
StatePublished - Dec 2020
Event1st International Conference on Pervasive Artificial Intelligence, ICPAI 2020 - Taipei, Taiwan
Duration: 3 Dec 20205 Dec 2020

Publication series

NameProceedings - 2020 International Conference on Pervasive Artificial Intelligence, ICPAI 2020

Conference

Conference1st International Conference on Pervasive Artificial Intelligence, ICPAI 2020
CountryTaiwan
CityTaipei
Period3/12/205/12/20

Keywords

  • Dual-fisheye
  • Effective FOV
  • Panoramic Images
  • Stitching

Fingerprint Dive into the research topics of '360 Degree Fish Eye Optical Construction for Equirectangular Projection of Panoramic Images'. Together they form a unique fingerprint.

Cite this