Shape understanding system : 3D interpretation as a part of the visual concept formation

• Autorzy: Les Z. , Les M.
• Języki publikacji: EN

Abstrakty

EN

This paper presents a new method of interpretation of the 2D visual objects in terms of 3D geometrical or real world objects. The 3D interpretation of the visual objects depends on the class where a given object is assigned. Each class has its own 3D interpretation method. The interpretation methods for selected classes are described and the results of testing of these methods are presented. It is shown that a visual object can be interpreted as a 3D object by assigning it to one of shape classes. The main novelty of the presented method is that the process of interpretation is related to a visual concept represented as a set of symbolic names of the shape classes. The visual concept, which is one of the components of the category of a visual object, makes it possible to represent knowledge about the visual object in the form of a categorical structure. The presented results are part of research aimed at developing a shape understanding method that will be able to perform complex visual tasks connected with visual thinking.

Słowa kluczowe

EN

shape understanding; object recognition; visual concept; visual reasoning

• Wydawca: Institute of Information Technology of the Warsaw University of Life Sciences – SGGW
• Czasopismo: Machine Graphics and Vision
• Rocznik: 2006
• Tom: Vol. 15, No. 2
• Strony: 141--175
• Opis fizyczny: Bibliogr. 52 poz., il., rys.

Twórcy

autor

Les Z.

autor

Les M.

• The Queen Jadwiga Research Institute of Understanding P.O. Box 654, Toorak, Victoria 3142, Australia

Bibliografia

• [1] Waltz D. M.: Generating Semantic Description from Drawing Scenes with Shadows. Tech. Rept AI-TR-271. M.I.T.: Cambridge, 1972.
• [2] Winston P. H.: Learning Structural Descriptions from Examples, in Psychology of Computer Vision. P.H. Winston, Editor. McGraw Hill: New York, 1975.
• [3] Sugihara K.: Picture Language for Skeletal Polyhedra. Computer Graphics and Image Processing, 8, 382-405, 1978.
• [4] You K. C., Fu K. S.: Distorted Shape Recognition Using Attributed Grammars and Error-Correcting Techniques. Computer Graphics and Image Processing, 13, 1-16, 1980.
• [5] Binford T. O.: Survey of Model-Based Image Analysis Systems. International Journal of Robotics Research, 1(1), 8-64, 1982.
• [6] Bhanu B., Faugeras O. D.: Shape Matching of Two-Dimensional Objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6(2): 137-156, 1984.
• [7] Homan D. D., Richards W. A.: Parts of recognition. Cognition, 18, 65-96, 1984.
• [8] Chin R. T., Dyer C. R.: Model-Based Recognition in Robot Vision. Computing Surveys, 18(1), 67-108, 1986.
• [9] Biederman I.: Recognition by Components: a Theory of Human Image Understanding. Psychological Review, 94, 115-147, 1987.
• [10] Connell J. H., Brady M.: Generating and Generalizing Models of Visual Objects. Artificial Intelligence, 31, 159-183, 1987.
• [11] Reiter R., Mackworth A. K.: A Logical Framework for Depiction and Image Interpretation. Artificial Intelligence, 41(2), 125-155, 1989.
• [12] Grimson W. E. L.: Object Recognition by Computer: the Role of Geometric Constraints, Boston: MIT Press, 1990.
• [13] Grimson W .E. L.: Object Recognition by Constrained Search. Machine Vision for Three Dimensional Scene, ed. H. Freeman. Academic Press Inc, Boston, 1990.
• [14] Bergevin R., Levine M. D.: Generic object recognition: building and matching coarse descriptions from line drawings. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(1), 19-36, 1993.
• [15] Ghosh P. K., Jain P.: An Algebra of Geometric Shapes. IEEE Computer Graphics and Applications, 11, 99-118, 1993.
• [16] Lu C. H., Dunham J. G.: Shape Matching Using Polygon Approximation and Dynamic Alignment. Pattern Recognition Letters, 14, 945-949, 1993.
• [17] Pal N. R., Pal P., Basu A. K.: A New Shape Representation Scheme and Its Application to Shape Discrimination Using a Neural Network. Pattern Recognition, 26(4), 543-551, 1993.
• [18] Bhanu B., Poggio T. A.: Introduction to the Special Section on Learning in Computer Vision. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(9), 865-868, 1994.
• [19] Bhavnagri B.: A Method for Representing Shape Based on an Equivalence Relation of Polygon. Pattern Recognition, 27(2), 247-260, 1994.
• [20] Mahmoud S. I.: Arabic Character Recognition Using Fourier Descriptors and Character Contour Encoding. Pattern Recognition, 27(6), 815-824, 1994.
• [21] Mitizias D. A., Mertzios B. G.: Shape Recognition with a Neural Classifier Based on a Fast Polygon Approximation Technique. Pattern Recognition, 5(27), 627-636, 1994.
• [22] Pellegretti P., Roli F., Serplco S. B., Vernazza G.: Supervised Learning of Descriptions for Image Recognition Purposes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(1), 92-98, 1994.
• [23] Les Z.: An Aesthetic Evaluation Method Based on Image Understanding Approach. Proc. The First International Conference on Visual Information Systems VISUAL'96, Melbourne, 1996.
• [24] Lipson H., Shpitalni M.: Optimization-based Reconstruction of a 3D Object from a Single Freehand Line Drawing. Computer-Aided Design, 28(8), 651-663, 1996.
• [25] Siddiqi K., Tresness K. J., Kimia B. B.: Parts of visual form: psychophysical aspects. Perception, 25, 399-424, 1996.
• [26] Caelli T., Bishof W.: Machine Learning and Image Interpretation. In Advances in Computer Vision and Machine Intelligence, ed. M.D. Levine. New York: Plenum Press, 1997.
• [27] Grimstead I. J.: Interactive Sketch Input of Boundary Representation Solid Models. Cardiff University, 1997.
• [28] Hoffman D. D., Singh M.: Salience of visual parts. Cognition, 63, 29-78, 1997.
• [29] Hsu J. C., Hwang S-Y.: A Machine Learning Approach for Acquiring Descriptive Classification Rules of Shape Contours. Pattern Recognition, 30(2): 245-252, 1997.
• [30] Les Z., Les M.: System of Experts to Perform an Epistemological Task of Shape Understanding Proc. the IASTED International Conference on Software Engineering, Las Vegas 2000.
• [31] Chella A., Frixione M., Gaglio S.: Conceptual Spaces for Computer Vision Representation. Artificial Intelligence Review, 16, 137-152, 2001.
• [32] Les Z.: Shape Understanding. Possible Classes of Shapes. International Journal of Shape Modelling 7(1), 75-109, 2001.
• [33] Varley P. A. C., Martin R. R.: The Junction Catalogue for Labeling Line Drawings of Polychedra with Tetrahedral Vertices. International Journal of Shape Modelling, 7(1), 23-44, 2001.
• [34] Latecki L. J., Lakamper R.: Application of planar shape comparison to object retrieval in image databases. Pattern Recognition, 35, 15-29, 2002.
• [35] Les Z.: Shape Understanding System: Understanding the thin object. An International Journal Computers and Graphics, 26(6): 951-970, 2002.
• [36] Bemier T., Landry J-A.: A new method for representing and matching shapes of natural objects. Pattern Recognition, 36, 1711-1723, 2003.
• [37] Les Z., Les M.: Understanding as an Interpretation in shape Understanding System. Journal of Experimental and Theoretical Artificial Intelligence, 15(4), 433-459, 2003.
• [38] Les Z.: The Processing Method as a Set of Image Transformations in Shape Understanding. An International Journal Computers and Graphics, 25(2), 223-233, 2003.
• [39] Les Z., Les M.: Shape Understanding system: Understanding of the Convex Objects. The Journal of Electronic Imaging, 12(2), 327-341, 2003.
• [40] Les Z., Les M.: Visual thinking as a part of understanding process - a new way of problem solving and communication of the intelligent systems in automotive and transportation technology. SAE 2002 Transactions - Journal of Passenger Cars: Electronic and Electrical Systems, 893-899 2003.
• [41] Su Y-M., Wang J-F.: A novel stroke extraction method for Chinese characters using Gabor filters. Pattern Recognition, 36, 635-647, 2003.
• [42] Bicego M., Murino V.: Investigating Hidden Markov Models' Capabilities in 2D Shape Classification. Transaction on Pattern Analysis and Artifficial Intelligence, 26(2), 281-286, 2004.
• [43] Klassen E., Srivastava A., Mio M., Joshi H.S.: Analysis of Planar Shapes Using Geodesic Paths on Shape Spaces. Transaction on Pattern Analysis and Artifficial Intelligence, 26: 372-383, 2004.
• [44] Les Z., Les M.: Understanding in Shape Understanding System. International Journal of Pattern Recognition and Artificial Intelligence, 18(4), 727-745, 2004.
• [45] Les Z., Les M.: Shape Understanding System-the System of Experts. International Journal of Intelligent Systems, 19(10), 949-978, 2004.
• [46] Les Z., Les M.: Understanding of the Curve Polygon Object. Journal of Computers and Graphics, 28(6), 919-936, 2004.
• [47] Les Z., Les M.: Shape Understanding System-Communication in Natural Language. Proc. IASTED Signal and Image Processing Conference, Honolulu, Hawaii.
• [48] Liu C.-L., Nakashima K., Sako H., Fujisawa H.: Handwritten digit recognition: investigation of normalization and feature extraction techniques. Pattern Recognition, 37, 265-279, 2004.
• [49] Les Z., Les M.: Understanding of a Concave Polygon Object in Shape Understanding System. Journal of Computer and Graphics, 29(3), 365-378, 2005.
• [50] Les Z., Les M.: Shape Understanding System: Understanding of the Complex Object. The Journal of Electronic Imaging, 14(2): p. 023015-1-023015-13, 2005.
• [51] Les Z., Les M.: SUS: Categorical Learning as a New Epistemologicly Oreiented Knowledge Acqiusition. WSEAS Transaction on Computers, 5(3): 653-660, 2006.
• [52] Les Z., Les M.: Understanding of the cyclic object as part of the visual understanding in shape understanding system. Journal of Computer and Graphics (accepted), 30(5), 2006.