Object segmentation in video via graph cut built on superpixels

• Autorzy: Kwolek B.
• Języki publikacji: EN

Abstrakty

EN

This paper proposes a real-time scheme for object segmentation in video. In the first stage a segmentation based on pairwise region comparison is utilized to oversegment image through extracting superpixels. Next, the algorithmapplies the graph cut built on such superpixels, instead of the image pixels. Owing to the optimization is performed on a simpler graph and in consequence the object segmentation runs in shorter time. Tracking of object features over time contributes toward improved segmenting the object from one image to another. The segmentation information supports following the entire object, instead of just a few features on it. The objects are segmented correctly as complete entities, despite the high variability of the object shape and cluttered background. Experimental results illustrate the efficiency and effectiveness of the algorithm.

Słowa kluczowe

EN

Cognitive Vision Systems; image segmentation; object recognition

• Wydawca: IOS Press
• Czasopismo: Fundamenta Informaticae
• Rocznik: 2009
• Tom: Vol. 90, nr 4
• Strony: 379--393
• Opis fizyczny: bibliogr. 34 poz., fot.

Twórcy

autor

Kwolek B.

• Rzeszów University of Technology, W. Pola 2, 35-959 Rzeszów, Poland,

Bibliografia

• [1] Belongie, S., Malik, J., Puzicha, J.: Schape matching and object recognition using shape contexts, IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(24), 2002, 509-522.
• [2] Beucher, S., Meyer, F.: The morphological approach to segmentation: The watershed transformation, Mathematical Morphology in Image Processing, 1993, 443-481.
• [3] Biederman, I.: Recognition by components: A theory of human image understanding, Psychological Review, 94, 1987, 115-147.
• [4] Black,M.: Combining intensity andmotion for incremental segmentation and tracking, European Conference on Computer Vision, 1992.
• [5] Boykov, Y., Jolly, M.: Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images, Proc. of ICCV, 2001.
• [6] Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts, IEEE Trans. On Pattern Analysis and Machine Intelligence, 23(11), 2001, 1222-1239.
• [7] Cave, C. B., Kosslyn, S. M.: The role of parts and spatial relations in object identification, Perception, 22, 1993, 229-248.
• [8] Cormen, T., Leiserson, C., Rivest, R.: Introduction to algorithms, MIT Press, 1990.
• [9] Criminisi, A., Gross, G., Blake, A., Kolmogorov, V.: Bilayer segmentation of live video, Proc. of the IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 2006.
• [10] Felzenszwalb, P. F., Huttenlocher, D. P.: Efficient graph-based image segmentation, International Journal of Computer Vision, 59(2), 2004, 167-181.
• [11] Juan, O., Boykov, Y.: Active graph cuts, Proc. of CVPR, 2006.
• [12] Kolmogorov, V., Criminisi, A., Blake, A., Ross, G., Rother, C.: Bi-layer segmentation of binocular stereo video, Proc. of CVPR, 2005.
• [13] Kolmogorov, V., Zabih, R.: What energy functions can be minimized via graph cuts?, Proc. of European Conf. on Computer Vision, 2002.
• [14] Li, S.: Markov Random Field modeling in computer vision, Springer-Verlag, 1995.
• [15] Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision, Proc. Seventh Int. Joint Conf. on Artificial Intelligence, Vancouver, Canada, 1981.
• [16] Luck, S. J., Vogel, E. K.: The capacity of visual working memory for features and conjuctions, Nature, 390(20), 1997, 279-281.
• [17] Marr, D.: Vision: a computational investigation into the human representation and processing of visual information, W. Freeman, San Francisco, CA, 1982.
• [18] Ogiela, L., Tadeusiewicz, R., Ogiela, M.: Cognitive informatics in automatic pattern understanding, In: D. Zhang, Y. Wang, W. Kisner, Proc. the 6th IEEE Int. Conf. Cognitive Informatics, 2007.
• [19] Ohta, Y., Kanade, T., Sakai, T.: Structural method for obstacle detection and terrain classification, Proc. Of Int. Joint Conf. on Pattern Recognition, 1978.
• [20] Ommer, B., Buhmann, J. M.: Learning compositional categorization models, ECCV, 2006.
• [21] Plataniotis, K., Venetsanopoulos, A.: Color image processing and applications, Springer, New York, Heidelberg, 2000.
• [22] Ren, X.,Malik, J.: Learning a classification model for segmentation, In Proc. 9th Int. Conf. Computer Vision, 2003.
• [23] Rosch, E., Mervis, C. B., Gray,W. D., Johnson, D. M., Boyes-Braem, P.: Basic objects in natural categories, Cognitive Psychology, 8, 1976, 382-439.
• [24] Rother, C., Blake, A., Kolmogorov, V.: Grabcut - interactive foreground extraction using iterated graph cuts, Proc. of ACM SIGGRAPH, 2004.
• [25] Shi, J., Malik, J.: Normalized cuts and image segmentation, IEEE Trans. on Pattern Analysis and Machine Intelligence, 22(8), 2000, 888-905.
• [26] Shi, J., Tomasi, C.: Good features to track, Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, Seattle, WA, 1994.
• [27] Sun, J., Zhang, W., Tang, X., Shum, H.-Y.: Background cut, Proc. of European Conf. On Computer Vision, 2006.
• [28] Swain, M. J., Ballard, D. H.: Color indexing, Int. Journal of Computer Vision, 7(1), 1991, 11-32.
• [29] Ullmann, S.: Object recognition and segmentation by a fragment-based hierarchy, Trends in Cognitive Sciences, 11(2), 2006, 58-64.
• [30] Vincent, L., Soille, P.: Watersheds in digital spaces: An efficient algorithm based on immersion simulations, IEEE Trans. on Pattern Analysis and Machine Intelligence, 13(6), 1991, 583-598.
• [31] Wang, J., Bhat, P., Colburn, R. A., Argawala, M., Cohen, M. F.: Interactive video cutout, Proc. of ACM SIGGRAPH, 2005.
• [32] Wang, Y.: The real-time process algebra (RTPA), The Int. J. of Annals of Software Engineering, 14, 2002, 235-274.
• [33] Wang, Y.,Wang, Y.: On cognitive informatics models of the brain, IEEE Transactions on Systems, Man, and Cybernetics, 36(2), 2006, 16-20.
• [34] Xu, N., Bansal, R., Ahuja, N.: Object segmentation using graph cuts based active contours, Proc. of CVPR, 2003.