Enhanced depth of field and resolution three-dimensional integral imaging by variable spatial filtering and intermediate-view reconstruction technique

• Autorzy: Huang Juezhen , Ge Peng

Identyfikatory

DOI

10.37190/oa210407

• Języki publikacji: EN

Abstrakty

EN

In this paper, we propose a novel three-dimensional (3D) integral imaging system to simultaneously improve the depth of field (DOF), resolution, and image quality of reconstructed images by variable spatial filtering and intermediate-view reconstruction technology (IVRT). In the proposed method, the camera performs element images acquisition on a 3D scene with objects of different depths through a 2D grid plane. The reconstructed slice image and block matching algorithm are used to extract the depth of the element images. To improve the sharpness of depth, the Laplace operator is used to perform variable depth filtering on objects of different depths, and depth-enhanced all-filtering element images are obtained through simple pixel fusion. IVRT is applied to all-filtering element images to obtain more element images to reconstruct a resolution-enhanced 3D image. According to the energy of gradient (EOG) value and the Tenengrad value, the reconstruction image quality evaluation of the proposed method is improved by 7.63 and 4.81 times compared with the traditional method, respectively. By the proposed method of generating all-filtering element images and an IVRT in 3D integral imaging system, the experimental results demonstrate that the 3D reconstructed image has extended depth of field, enhanced resolution and improved image quality.

Słowa kluczowe

EN

integral imaging; depth of field; variable filtering

• Wydawca: Oficyna Wydawnicza Politechniki Wrocławskiej
• Czasopismo: Optica Applicata
• Rocznik: 2021
• Tom: Vol. 51, nr 4
• Strony: 551--563
• Opis fizyczny: Bibliogr. 29 poz., rys., tab.

Twórcy

autor

Huang Juezhen

• School of Physics and Opto-electronic, South China University of Technology Guangzhou, 510640 Guangzhou, China

autor

Ge Peng

• School of Physics and Opto-electronic, South China University of Technology Guangzhou, 510640 Guangzhou, China

Bibliografia

• [1] LIPPMANN G., La Photographie Integrale, Comptes-Rendus Academie des Sciences 146, 1908, pp. 446–451.
• [2] OKANO F., ARAI J., HOSHINO H., YUYAMA I., Three-dimensional video system based on integral photography, Optical Engineering 38(6), 1999, p. 1072, DOI: 10.1117/1.602152.
• [3] STERN A, JAVIDI B., Three-dimensional image sensing, visualization, and processing using integral imaging, Proceedings of the IEEE 94(3), 2006, pp. 591–607, DOI: 10.1109/JPROC.2006.870696.
• [4] KIM Y., HONG K., LEE B., Recent researches based on integral imaging display method, 3D Research 1(1), 2010, pp. 17–27, DOI: 10.1007/3DRes.01(2010)2.
• [5] SCHULEIN R., DANESHPANAH M., JAVIDI B., 3D imaging with axially distributed sensing, Optics Letters 34(13), 2009, pp. 2012–2014, DOI: 10.1364/OL.34.002012.
• [6] PIAO Y., ZHANG M., SHIN D., YOO H., Three-dimensional imaging and visualization using off-axially distributed image sensing, Optics Letters 38(16), 2013, pp. 3162–3164, DOI: 10.1364/OL.38.003162.
• [7] XIE W., WANG Q.H., WANG Y.Z., DENG H., Depth-enhanced integral imaging system with convex and composite concave micro-lens arrays, Optik 125(20), 2014, pp. 6087–6089, DOI: 10.1016/j.ijleo.2014.06.113.
• [8] ZHANG M., WEI C., PIAO Y., LIU J., Depth-of-field extension in integral imaging using multi-focus elemental images, Applied Optics 56(22), 2017, pp. 6059–6064, DOI: 10.1364/AO.56.006059.
• [9] WANG Q., WANG A., Survey on stereoscopic three-dimensional display, Journal of Computer Applications 30(3), 2010, pp. 579–581, DOI: 10.3724/SP.J.1087.2010.00579.
• [10] JANG J.S., JAVIDI B., Three-dimensional synthetic aperture integral imaging, Optics Letters 27(13), 2002, pp. 1144–1146, DOI: 10.1364/OL.27.001144.
• [11] PIAO Y., XING L., ZHANG M., LEE B.-G., Three-dimensional reconstruction of far and large objects using synthetic aperture integral imaging, Optics and Lasers in Engineering 88, 2017, pp. 153–161, DOI: 10.1016/j.optlaseng.2016.08.008.
• [12] MARTÍNEZ-CUENCA R., SAAVEDRA G., MARTÍNEZ-CORRAL M., JAVIDI B., Enhanced depth of field integral imaging with sensor resolution constraints, Optics Express 12(21), 2004, pp. 5237–5242, DOI: 10.1364/OPEX.12.005237.
• [13] JANG J.S., JAVIDI B., Large depth-of-focus time-multiplexed three-dimensional integral imaging by use of lenslets with nonuniform focal lengths and aperture sizes, Optics Letters 28(20), 2003, pp. 1924–1926, DOI: 10.1364/OL.28.001924.
• [14] KIM Y., CHOI H., KIM J., CHO S.-W., KIM Y., PARK G., LEE B., Depth-enhanced integral imaging display system with electrically variable image planes using polymer-dispersed liquid-crystal layers, Applied Optics 46(18), 2007, pp. 3766–3773, DOI: 10.1364/AO.46.003766.
• [15] ZHANG L., YANG Y., ZHAO X., FANG Z., YUAN X., Enhancement of depth-of-field in a direct projection-type integral imaging system by a negative lens array, Optics Express 20(23), 2012, pp. 26021–26026, DOI: 10.1364/OE.20.026021.
• [16] XING Y., WANG Q.H., LUO C.G., DENG H., LI D.H., Depth-enhanced integral imaging system based on spatial filtering, Journal of Information Display 16(2), 2015, pp. 85–88, DOI: 10.1080/15980316.2015.1014937.
• [17] JANG J.S., JAVIDI B., Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics, Optics Letters 27(5), 2002, pp. 324–326, DOI: 10.1364/OL.27.000324.
• [18] SHIN D.H., KIM N.W., YOO H., LEE J.J., LEE B., KIM E.S., Improved viewing quality of 3-D images in computational integral imaging reconstruction based on round mapping model, ETRI Journal 29(5), 2007, pp. 649–654, DOI: 10.4218/etrij.07.0107.0038.
• [19] PARK J.H., KIM J., KIM Y., LEE B., Resolution-enhanced three-dimension/two-dimension convertible display based on integral imaging, Optics Express 13(6), 2005, pp. 1875–1884, DOI: 10.1364/OPEX.13.001875.
• [20] PARK J.S., HWANG D.C., SHIN D.H., KIM E.S., Enhanced-resolution computational integral imaging reconstruction using an intermediate-view reconstruction technique, Optical Engineering 45(11), 2006, article 117004, DOI: 10.1117/1.2393235.
• [21] YUAN S., ABE M., TAGUCHI A., KAWAMATA M., High accuracy bicubic interpolation using image local features, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences E90-A(8), 2007, pp. 1611–1615, DOI: 10.1093/ietfec/e90-a.8.1611.
• [22] LEE J.J., LEE B.G., YOO H., Depth extraction of three-dimensional objects using block matching for slice images in synthetic aperture integral imaging, Applied Optics 50(29), 2011, pp. 5624–5629, DOI: 10.1364/AO.50.005624.
• [23] HONG S.H., JANG J.S., JAVIDI B., Three-dimensional volumetric object reconstruction using computational integral imaging, Optics Express 12(3), 2004, pp. 483–491, DOI: 10.1364/OPEX.12.000483.
• [24] HONG S.H., JAVIDI B., Improved resolution 3D object reconstruction using computational integral imaging with time multiplexing, Optics Express 12(19), 2004, pp. 4579–4588, DOI: 10.1364/OPEX.12.004579.
• [25] CHO M., JAVIDI B., Computational reconstruction of three-dimensional integral imaging by rearrangement of elemental image pixels, Journal of Display Technology 5(2), 2009, pp. 61–65, DOI: 10.1109/JDT.2008.2004857.
• [26] BAE J.-W., PARK H.-C., KIM E.-S., YOO J.-S., Efficient disparity estimation algorithm based on spatial correlation, Optical Engineering 42(1), 2003, p. 176, DOI: 10.1117/1.1523944.
• [27] BAE K.-H., KIM E.-S., New disparity estimation scheme based on adaptive matching windows for intermediate view reconstruction, Optical Engineering 42(6), 2003, p. 1778, DOI: 10.1117/1.1571828.
• [28] HUANG W., JING Z., Evaluation of focus measures in multi-focus image fusion, Pattern Recognition Letters 28(4), 2007, pp. 493–500, DOI: 10.1016/j.patrec.2006.09.005.
• [29] LIANG X., Analysis and improvement on digital refocusing sharpness evaluation function of light field photography, Electro-Optic Technology Application, Issue 6, 2015, p. 56.