A cooperative stereo matching and occlusion detection algorithm for stereo coding

• Autorzy: Han J. , Lu Z.
• Języki publikacji: EN

Abstrakty

EN

This paper presents a novel stereo algorithm for obtaining disparity vectors with simply detected occluded points, which is adaptive to a stereo coding scheme. In this algorithm, we first propose a novel scheme based on an adaptive UT mesh model and an epipolar line constraint principle for stereo matching. Furthermore, a simple occlusion detection algorithm is introduced, which uses two fundamental concepts: the uniqueness assumption and the disparity gradient limit principle. Our technique first extracts some triangular vertices from a reference image using an improved adaptive Delaunay triangulation representation algorithm. As feature points, these vertices are matched in the target image with some correlation measurement. After obtaining the disparity vector of each vertex, the uniqueness assumption and the disparity gradient limit are used to select occluded points and label occluded regions. Thr disparity vectors of the points among the triangular vertices can be calculated by a six-parameter affine transformation. In terms of advantages for image coding of a DT mesh model, this algorithm is definitely appropriate for stereo coding, which has been proven by experimental results. We have applied this algorithm to some stereo images, and the experimental results show that the veracity of the disparity estimation given in this paper is higher than that of the conventional algorithms. What is more. some occluded points and occlusion regions can be easily detected with this algorithm. lu addition, the algorithm can achieve higher coding efficiency as compared to conventional stereo coding algorithms.

Słowa kluczowe

EN

stereo matching; occlusion detection; Delaunay triangulation; disparity vector

• Wydawca: Institute of Information Technology of the Warsaw University of Life Sciences – SGGW
• Czasopismo: Machine Graphics and Vision
• Rocznik: 2004
• Tom: Vol. 13, No. 1/2
• Strony: 25--38
• Opis fizyczny: Bibliog. 16 poz., il., wykr.

Twórcy

autor

Han J.

• School of Telecommunication Engineering, ISN National Key Laboratory, Xidian Univ, Shaanxi Xi'an 710071, China

autor

Lu Z.

• School of Telecommunication Engineering, ISN National Key Laboratory, Xidian Univ, Shaanxi Xi'an 710071, China

Bibliografia

• [1] Marr D., Poggio T.: Cooperative computation of stereo disparity. Science, 194, 209-236, 1976.
• [2] Burt P., Julesz B.: A gradient limit for binocular fusion. Science, 208, 615-617, 1980.
• [3] Grimson W. E. L.: Computational experiments with a feature based stereo algorithm. IEEE Trans. PAMI, 7(1), 17-34, 1985.
• [4] Ayacge N., Faverjon B.: Efficient registration of stereo images by matching graph descriptions of edge segments. The Int. J CV, 1(2), 1987.
• [5] Goshtasby A., Gage S.H., Bartholic J.F.: A two-stage cross correlation approach to template matching. IEEE Trans. on PAMI, 6(3), 374-378, 1994.
• [6] Geiger D., Ladendorf B., Yuille A.: Occlusion and binocular stereo. Int. J CV, 14, 211-226, 1995.
• [7] Candocia F., Adjouadi M.: A similarity measure for stereo feature matching. IEEE Trans. on IP, 6(10), 1460-1464, 1997.
• [8] Malassiotis S., Strintzis M.G.: Object-based coding of stereo image sequences using three-dimensional models. IEEE Trans. on CSVT, 7(6), 892-905, 1997.
• [9] Scharstein D., Szeliski R.: Stereo matching with nonlinear diffusion. The International Journal of Computer Vision, 28(2), 155-174, 1998.
• [10] Ma Song-de, Zhang Zheng-you: Computer Vision-computation Theory and Algorithm Base. Beijing: Science Publishing Company, 1998.
• [11] Strintzis M.G., Malassiotis S.: Object-based coding of stereoscopic and 3D image sequences. IEEE Signal Processing Magazine, 16(3), 14-28, 1999.
• [12] Woo W., Ortega A.: Overlapped block disparity compensation with adaptive window for stereo image coding. IEEE Trans. on CSVT, 10(2), 194-200, 2000.
• [13] Zhengyou Zhang, Ying Shan: A progressive scheme for stereo matching. SMILE 2000, LNCS, 2018, 68-85, 2000.
• [14] Han Jun-gong, Lu Zhao-yang, Tian Yi-ke, Gao Xi-quan: An improved DT-mesh coding algorithm adaptive to MPEG-4. 6th Int. Conf. on SP (ICSP), 949-953, 2002.
• [15] Egnal G., Wiildes R. P.: Detecting binocular half-occlusions: empirical comparisons of five approaches. IEEE Trans. on PAMI, 24(8), 1127-1133, 2002.
• [16] Szeliski R., Zabih R.: An experimental comparison of stereo algorithm http://research.microsoft.com/vision/visionbasedmodeling/publications/Szeliski-VisAlg99.pdf