Rectification of Images Distorted by Microlens Array Errors in Plenoptic Cameras

Suning Li; Yanlong Zhu; Chuanxin Zhang; Yuan Yuan; Heping Tan

doi:10.3390/s18072019

Rectification of Images Distorted by Microlens Array Errors in Plenoptic Cameras

Sensors (Basel). 2018 Jun 23;18(7):2019. doi: 10.3390/s18072019.

Authors

Suning Li¹, Yanlong Zhu², Chuanxin Zhang³, Yuan Yuan^{4

5}, Heping Tan^{6

7}

Affiliations

¹ School of Energy Science and Engineering, Harbin Institute of Technology, 92 West Dazhi Street, Harbin 150001, China. 16b902036@stu.hit.edu.cn.
² School of Energy Science and Engineering, Harbin Institute of Technology, 92 West Dazhi Street, Harbin 150001, China. 17S002073@stu.hit.edu.cn.
³ School of Energy Science and Engineering, Harbin Institute of Technology, 92 West Dazhi Street, Harbin 150001, China. chuanxin@hit.edu.cn.
⁴ School of Energy Science and Engineering, Harbin Institute of Technology, 92 West Dazhi Street, Harbin 150001, China. yuanyuan83@hit.edu.cn.
⁵ Key Laboratory of Aerospace Thermophysics, Ministry of Industry and Information Technology, Harbin Institute of Technology, 92 West Dazhi Street, Harbin 150001, China. yuanyuan83@hit.edu.cn.
⁶ School of Energy Science and Engineering, Harbin Institute of Technology, 92 West Dazhi Street, Harbin 150001, China. tanheping@hit.edu.cn.
⁷ Key Laboratory of Aerospace Thermophysics, Ministry of Industry and Information Technology, Harbin Institute of Technology, 92 West Dazhi Street, Harbin 150001, China. tanheping@hit.edu.cn.

Abstract

A plenoptic cameras is a sensor that records the 4D light-field distribution of target scenes. The surface errors of a microlens array (MLA) can cause the degradation and distortion of the raw image captured by a plenoptic camera, resulting in the confusion or loss of light-field information. To address this issue, we propose a method for the local rectification of distorted images using white light-field images. The method consists of microlens center calibration, geometric rectification, and grayscale rectification. The scope of its application to different sized errors and the rectification accuracy of three basic surface errors, including the overall accuracy and the local accuracy, are analyzed through simulation of imaging experiments. The rectified images have a significant improvement in quality, demonstrating the provision of precise light-field data for reconstruction of real objects.

Keywords: calibration; distortion rectification; light-field image processing; microlens array; plenoptic camera.