Object based segmentation of video using variational level sets

• Autorzy: Cheng B. , Wang Y. , Zheng N. , Bian Z.
• Języki publikacji: EN

Abstrakty

EN

The paper demonstrates a new approach to video segmentation which retains some of the attractive features of existing methods and overcomes some of their limitations. The video sequence is represented as a spatio-temporal volume, and is segmented by an extension of active contour model based on Mumford-Shah techniques. The energy function minimization is similar to 3D interface evolution with curvature-dependent speeds. The spatio-temporal volume need not to be smoothed before processing because our method is not sensitive to noise. Each object needs a closed interface, which is embedded as a level set of a higher-dimensional functions, and is propagated by solving a partial differential equation. The interface stops in the vicinity of object boundaries, which are not necessarily defined by the gradient and can be represented with complex topologies. Finally, an experiment is given to show the effectiveness and robustness of the method.

Słowa kluczowe

EN

video sequence; segmentation; level set; Mumford-Shah functional

• Wydawca: Institute of Information Technology of the Warsaw University of Life Sciences – SGGW
• Czasopismo: Machine Graphics and Vision
• Rocznik: 2005
• Tom: Vol. 14, No. 2
• Strony: 145--157
• Opis fizyczny: Bibliogr. 24 poz., il.

Twórcy

autor

Cheng B.

• Artificial Intelligence and Robotics Institute, Xi' an Jiaotong University, Xi' an 710049, China
• Department of Biomedical Engineerig, Xi' an Jiaotong University, Xi' an 710049, China

autor

Wang Y.

• Medical experiment center of of No.1 hospital, Xi' an Jiaotong University, Xi' an 710061, China

autor

Zheng N.

• Artificial Intelligence and Robotics Institute, Xi' an Jiaotong University, Xi' an 710049, China

autor

Bian Z.

• Department of Biomedical Engineerig, Xi' an Jiaotong University, Xi' an 710049, China

Bibliografia

• [1] Bergen J.R., Anandan P., Hanna K., Hingorani R.: Hierarchical model-based Motion estimation. ECCV, May, 237-252,1992.
• [2] Peleg S., Irani M.: Motion analysis for image enhancement: Resolution, occlusion and transparency. Journal of Visual Communication and Image Representation, 4(4), December, 324-335, 1993.
• [31 Darrell T., Pentland A. P.: Cooperative robust estimation using layers of support. IEEE Trans. PAMI, 17(5), 474-487, 1995.
• [4] Malladi R., Sethian J., Vemuri B.: Shape modeling with front propagation: a level set approach. IEEE Trans. on PAMI, 17(2), 158-175, 1995.
• [5] Colonnese S., Neri A., Russo G., Tabacco C.: Adaptive segmentation of moving object versus background for video coding. Proc. of SPIE Annual Symposium, vol. 3164, S. Diego, August, 1997.
• [6] Blake A., Isard M.: Active Contours. Springer-Verlag, 1998.
• [7] Moscheni F., Bhattacharjee S., Kunt M.: Spatiotemporal segmentation based on region merging, IEEE Trans. PAMI, 20(9), 897-915, 1998.
• [8] Osher S., Sethian J.: Fronts propagating with curvature-dependent speed: Algorithms based on hamilton-jacobi formulation. Journal of Computational Physics, vol. 79, 12-49, 1998.
• [9] MPEG. MPEG-4: Applications document. Technical Report ISO/IEC JTC1/SC29/WG11/w2724, MPEG, Seoul, Korea, March, 1999.
• [10] MPEG. MPEG-4: Requirements document. Technical Report ISO/IEC JTC1/SC29/WG11/w2723, MPEG, Seoul, Korea, March, 1999.
• [11] MPEG. MPEG-7: Applications. Technical Report ISO/IEC JTC1/SC29/WG11/w2860, MPEG, Vancouver, Canada, July, 1999.
• [12] MPEG. MPEG-7: Requirements document. Technical Report ISO/IEC JTC1/SC29/WG11/w2859, MPEG, Vancouver, Canada, July, 1999.
• [13] Chan T., VeseL.: An active contour model without edges. Int. Conf. Scale-Space Theories in Computer Vision, 16(2), 266-277, 1999.
• [14] Meier T., Ngan K. N.: Video segmentation for content based coding. IEEE Trans. Circuits Syst. Video Technol., vol. 9, Dec., 1190-1203, 1999.
• [15] Sethian J. A.: Level Set Methods and Fast Marching Methods. Cambridge University Press, Cambridge, UK, 1999.
• [16] Masouri A. R., Sirivong B., Konrad J.: Multiple motion segmentation with level sets. Proc. of SPIE, vol. 3974, 584-595, 2000.
• [17] Paragios N., Deriche R.: Geodesic active contours and level sets for the detection and tracking of moving object. IEEE Trans. on PAMI, 22(3), 266-280, 2000.
• [18] Bergen L., Meyer F.: A novel approach to depth ordering in monocular image sequences. CVPR, June, 536-541, 2000.
• [19] Cavallaro A., Ebrahimi T.: Video object extraction based on adaptive background and statistical Change detection. Proc. of SPIE Electronic Imaging - Visual Communications and Image Processing, San Jose, California, USA, pp. 465-475, 2001.
• [20] Sapiro G.: Geometric Partial Differential Equations and Image Analysis. Cambridge, University Press, 2001.
• [21] Sifakis E., Grinias I., Tziritas G.: Video segmentation using fast marching and region growing algorithms. Journal on Applied Signal Processing, vol. 4, 379-388, 2002.
• [22] Vese L., Chan T.: A multiphase level set framework for image segmentation using the Mumford and Shah model. Int. Journal of Computer Vision, 50(3), 271-293, 2002.
• [23] Erdem C. E., Sankur B., Tekalp A. M.: Performance measures for video object segmentation and tracking. IEEE Trans. on Image Processing, 13(7), 937-951, 2004.