Dense depth map reconstruction by phase difference-based algorithm under influence of perspective distortion

• Autorzy: El-Etriby S. , Al-Hamadi A. , Michaelis B.
• Konferencja: International Conference on Computer Vision and Graphics ICCVG 2006 (25-27.09.2006 ; Warsaw, Poland)
• Języki publikacji: EN

Abstrakty

EN

This paper describes a novel phase difference-based algorithm applied to the corresponding points in two views, which takes into account the surface perspective distortion (foreshortening). The challenges arise from the fact that stereo images are acquired from slightly different views. Therefore, the surface of a projected image is more compressed and occupies a smaller area in one view. Since the projective distortion region can not be estimated in terms of a fixed-size matching algorithm, we suggest using a local spatial frequency representation model to address this problem. Instead of matching intensities directly, a Gabor scale-space expansion (scalogram) is used. The scalogram expresses the filter output as a function of the spatial position and the principal wavelength to which the filter is tuned. The phase difference at the corresponding points in the two images is used to find the disparity value. The suggested algorithm provides an analytical closed-form expression for the perspective foreshortening effect. The foreshortening factor is verified to overcome the perspective distortion region. The efficiency and performance of the suggested algorithm for dense depth map reconstruction is demonstrated on the basis of analysis of rectified real images. Hence, our proposed method has a superior performance in comparison with other conventional methods.

Słowa kluczowe

EN

stereo matching; disparity estimation; 3D reconstruction; perspective distortion

• Wydawca: Institute of Information Technology of the Warsaw University of Life Sciences – SGGW
• Czasopismo: Machine Graphics and Vision
• Rocznik: 2006
• Tom: Vol. 15, No. 3/4
• Strony: 349--361
• Opis fizyczny: Bibliogr. 15 poz., tab., wykr., il.

Twórcy

autor

El-Etriby S.

autor

Al-Hamadi A.

autor

Michaelis B.

• Institute of Electronics, Signal Processing and Communications (IESK), Otto-von-Guericke-University Magdeburg,

Bibliografia

• [1] Gabor D.: Theory of communication. Journal IEE, 93, 429-459, 1946.
• [2] Kuglin C., Hines D.: The phase correlation image alignment method. In Proceedings of the IEEE Int. Conf. on Cyber. Society, 163-165, 1975.
• [3] Sanger T. D.: A stereo disparity computation using gabor filters. Biol. Cyber., 59, 405-418, 1988.
• [4] Kanade T., Okutomi M.: Stereo matching algorithm with an adaptive window, In DARPA, 383-398, 1990.
• [5] Fleet D. J., Jepson A., Jenkin M.: Phase-based disparity measurement, CVGIP, 53(2), 198-210, 1991.
• [6] Fua P.: Combining stereo and monocular information to compute dense depth maps that preserve depth discontinuities, In Proc. Int'l Joint Conf. on Artificial Intelligence, Sydney, 1292-1298, 1991.
• [7] Jones D., Malik J.: Determining three-dimensional shape from orientation and spatial frequency disparities, UCB/CSD 91/657.
• [8] Fleet D. J., Jepson A.: Stability of phase information, IEEE Transaction on Pattern Analysis and Machine Intelligence, 15(12), 1253-1268.
• [9] Weng J.: Image matching using the windowed Fourier phase. Inter. Jor. of Comp. Vision, 211-236, 1993.
• [10] Wei G. Q., Hirzinger G.: Intensity and Feature-Based Stereo Matching by Disparity Parameterization, Proc. IEEE Int'l Conf. Computer Vision (ICCV), 1035-1040, 1998.
• [11] Ahlvers U., Zölzer U., Rechmeier S.: FFT based disparity estimation for stereo image coding, In Proc. IEEE (ICIP'03), Barcelona, Spain, vol (1), 761-764, 2003.
• [12] Xu N. Ahuja.: A three-view matching algorithm considering foreshortening effects, In Proceedings of Inter. Conf. on CVPR and IP, 635-638, 2003.
• [13] Kim J., Park J.: New stereo matching and 3D view generation algorithms using aerial stereo images. Proc. of the 12th Int. Conference on Geoinformatics Geospatial Information Research: Bridging the Pacific and Atlantic, 663-669, 2004.
• [14] Ahlvers U., Ahlvers U., Zölzer U.: Inclusion of magnitude information for improved phase-based disparity estimation in stereoscopic image pairs, Proc. Int. Conf. on Computer Vision, 3-9, 2005.
• [15] El-Etriby S., Al-Hamadi A., Michaelis B.: Phase-based disparity estimation with implicit foreshortening-correction, 4th International Multi conference on Computer Science and Information Technology CSIT-2006, Vol (3), 510-520. Press, Cambridge, MA, 2006.