TY - JOUR
T1 - Multidimensional Optical Sensing and Imaging System (MOSIS)
T2 - From Macroscales to Microscales
AU - Javidi, Bahram
AU - Shen, Xin
AU - Markman, Adam S.
AU - Latorre-Carmona, Pedro
AU - Martinez-Uso, Adolfo
AU - Martinez Sotoca, Jose
AU - Pla, Filiberto
AU - Martinez-Corral, Manuel
AU - Saavedra, Genaro
AU - Huang, Yi-Pai
AU - Stern, Adrian
PY - 2017/5/1
Y1 - 2017/5/1
N2 - Multidimensional optical imaging systems for information processing and visualization technologies have numerous applications in fields such as manufacturing, medical sciences, entertainment, robotics, surveillance, and defense. Among different three-dimensional (3-D) imaging methods, integral imaging is a promising multiperspective sensing and display technique. Compared with other 3-D imaging techniques, integral imaging can capture a scene using an incoherent light source and generate real 3-D images for observation without any special viewing devices. This review paper describes passive multidimensional imaging systems combined with different integral imaging configurations. One example is the integral-imaging-based multidimensional optical sensing and imaging systems (MOSIS), which can be used for 3-D visualization, seeing through obscurations, material inspection, and object recognition from microscales to long range imaging. This system utilizes many degrees of freedom such as time and space multiplexing, depth information, polarimetric, temporal, photon flux and multispectral information based on integral imaging to record and reconstruct the multidimensionally integrated scene. Image fusion may be used to integrate the multidimensional images obtained by polarimetric sensors, multispectral cameras, and various multiplexing techniques. The multidimensional images contain substantially more information compared with two-dimensional (2-D) images or conventional 3-D images. In addition, we present recent progress and applications of 3-D integral imaging including human gesture recognition in the time domain, depth estimation, mid-wave-infrared photon counting, 3-D polarimetric imaging for object shape and material identification, dynamic integral imaging implemented with liquid-crystal devices, and 3-D endoscopy for healthcare applications.
AB - Multidimensional optical imaging systems for information processing and visualization technologies have numerous applications in fields such as manufacturing, medical sciences, entertainment, robotics, surveillance, and defense. Among different three-dimensional (3-D) imaging methods, integral imaging is a promising multiperspective sensing and display technique. Compared with other 3-D imaging techniques, integral imaging can capture a scene using an incoherent light source and generate real 3-D images for observation without any special viewing devices. This review paper describes passive multidimensional imaging systems combined with different integral imaging configurations. One example is the integral-imaging-based multidimensional optical sensing and imaging systems (MOSIS), which can be used for 3-D visualization, seeing through obscurations, material inspection, and object recognition from microscales to long range imaging. This system utilizes many degrees of freedom such as time and space multiplexing, depth information, polarimetric, temporal, photon flux and multispectral information based on integral imaging to record and reconstruct the multidimensionally integrated scene. Image fusion may be used to integrate the multidimensional images obtained by polarimetric sensors, multispectral cameras, and various multiplexing techniques. The multidimensional images contain substantially more information compared with two-dimensional (2-D) images or conventional 3-D images. In addition, we present recent progress and applications of 3-D integral imaging including human gesture recognition in the time domain, depth estimation, mid-wave-infrared photon counting, 3-D polarimetric imaging for object shape and material identification, dynamic integral imaging implemented with liquid-crystal devices, and 3-D endoscopy for healthcare applications.
KW - 3-D endoscopy
KW - 3-D human activity recognition
KW - 3-D imaging
KW - dynamic integral imaging
KW - long-range integral imaging
KW - material analysis
KW - multidimensional object recognition
KW - multispectral imaging
KW - photon counting
KW - polarimetric imaging
UR - http://www.scopus.com/inward/record.url?scp=85014820404&partnerID=8YFLogxK
U2 - 10.1109/JPROC.2017.2654318
DO - 10.1109/JPROC.2017.2654318
M3 - Article
AN - SCOPUS:85014820404
VL - 105
SP - 850
EP - 875
JO - Proceedings of the IEEE
JF - Proceedings of the IEEE
SN - 0018-9219
IS - 5
M1 - 7866839
ER -