Utilization of FraDIA for Development of Robotic Vision Subsystems on the Example of Checkers’ Playing Robot

• Autorzy: Kornuta T. , Bem T. , Winiarski T.
• Języki publikacji: EN

Abstrakty

EN

The paper presents FraDIA, a framework facilitating the creation of vision systems, that can operate as a stand–alone application as well as play a role of a vision subsystem for robotic controllers. The article describes motivations leading to the tool creation, its structure and a method of integration with a MRROC++ system, enabling the development of a robot controllers with visual feedback. The usefulness of the framework is demonstrated on the example of a robot playing checkers. In the application, FraDIA was used to implement two different vision subsystems, and the control system exhibited two behaviors utilizing visual information in two totally different ways: passive, responsible for monitoring the state of the game, and active, in which vision was utilized during the manipulator motion for localization of a pawn to be grasped. Regarding the complexity of the system, a specification method based on agents and transition function was used. The method, consisting of mathematical formulas supplemented by data flow diagrams, enables the reader to understand both the system structure and its behavior.

Słowa kluczowe

EN

vision subsystem; robotic controller; behavior-based control; checkers game

• Wydawca: Institute of Information Technology of the Warsaw University of Life Sciences – SGGW
• Czasopismo: Machine Graphics and Vision
• Rocznik: 2011
• Tom: Vol. 20, No. 4
• Strony: 495--520
• Opis fizyczny: Bibliogr.30 poz., rys.

Twórcy

autor

Kornuta T.

• Institute of Control and Computation Engineering, Warsaw University of Technology, Nowowiejska 15/19, 00-665 Warsaw, Poland

autor

Bem T.

• Institute of Control and Computation Engineering, Warsaw University of Technology, Nowowiejska 15/19, 00-665 Warsaw, Poland

autor

Winiarski T.

• Institute of Control and Computation Engineering, Warsaw University of Technology, Nowowiejska 15/19, 00-665 Warsaw, Poland

Bibliografia

• [1] Y. Shirai and H. Inoue. Guiding a robot by visual feedback in assembling tasks. Pattern Recognition, 5 (2): 99-108, 1973.
• [2] H. P. Moravec. The CMU Rover. In Proceedings of AAAI-82, pages 377-380, August 1982.
• [3] R. A. Brooks. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, RA-2 (l): 14-23, March 1986.
• [4] R. Rivest. Game tree searching by min/max approximation. Artificial Intelligence, 34 (l):77-96, 1987.
• [5] B. Marsh, C. Brown, T. Leblanc, M. Scott, T. Becker, G. Quiroz, P. Das, and J. Karlsson. The rochester checkers player: multimodel parallel programming for animate vision. IEEE Computer, 2: 12-19, 1992.
• [6] S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach. Prentice Hall, Upper Saddle River, N.J., 1995.
• [7] K. Slonneger and B. L. Kurtz. Formal Syntax and Semantics of Programming Languages: A Laboratory Based Approach. Addison-Wesley Publishing Company, Reading, 1995.
• [8] S. A. Hutchinson, G. D. Hager, and P. I. Corke. A tutorial on visual servo control. IEEE Trans. on Robotics and Automation, 12 (5): 651-670, October 1996.
• [9] R. C. Arkin. Behavior-Based Robotics. MIT Press, 1998.
• [10] C. Zieliński. The MRROC++ system. In First Workshop on Robot Motion and Control (Ro MoCo'99), pages 147-152, Kiekrz, Polska, July 28-29 1999.
• [11] J. Bruce, T. Balch, and M. Veloso. Fast and inexpensive color image segmentation for interactive robots. In 2000 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS ’00), volume 3, pages 2061-2066, Oct 2000.
• [12] D. Bailey, K. Mercer, C. Plaw, and K. Subramaniam. Trax playing robot. Proceedings of the IEEE International Conference on Mechatronics and Machine Vision in Practise, pages 151-155, 2001.
• [13] C. Zieliński, K. Mianowski, K. Nazarczuk, and W. Szynkiewicz. A Prototype Robot for Polishing and Milling Large Objects. Industrial Robot, 30 (l): 67-76, January 2003.
• [14] D. Lewis and D. Bailey. A checkers playing robot. Proceedings of the Eleventh Electronics New Zealand Conference, pages 218-222, 2004.
• [15] W. Szynkiewicz, C. Zieliński, W. Czajewski, and T. Winiarski. Control Architecture for Sensor- Based Two-Handed Manipulation. In T. Zielińska and C. Zieliński, editors, CISM Courses and Lectures - 16th CISM-IFToMM Symposium on Robot Design, Dynamics and Control, RoManSy’06, June 20-24, number 487, pages 237-244, Wien, New York, 2006. Springer.
• [16] G. Taylor and L. Kleeman. Visual Perception and Robotic Manipulation. Springer, 2006.
• [17] S. Thrun, M. Montemerlo, H. Dahlkamp, D. Stavens, A. Aron, J. Diebel, P. Fong, J. Gale, M. Halpenny, G. Hoffmann, K. Lau, C. Oakley, M. Palatucci, V. Pratt, and P. Stang. Stanley: The robot that won the DARPA Grand Challenge. Journal of Field Robotics, 23 (9): 661-692, 2006.
• [18] C. Zieliński. Transition-function based approach to structuring robot control software. In K. Kozłowski, editor, Robot Motion and Control: Recent Developments, Lecture Notes in Control and Information Sciences, Vol. 335, pages 265-286. Springer Verlag, 2006.
• [19] C. Zieliński, W. Szynkiewicz, T. Winiarski, M. Staniak, W. Czajewski, and T. Kornuta. Rubik’s cube as a benchmark validating MRROC++ as an implementation tool for service robot control systems. Industrial Robot: An International Journal, 34 (5): 368-375, 2007.
• [20] G. Bradski and A. Kaehler. Learning OpenCV: Computer Vision with the OpenCV Library. O’Reilly, first edition, September 2008.
• [21] F. Chaumette and S. Hutchinson. The Handbook of Robotics, chapter Visual Servoing and Visual Tracking, pages 563-583. Springer, June 2008.
• [22] M. J. Matarić and F. Michaud. The Handbook of Robotics, chapter Behavior-Based Systems, pages 891-909. Springer, June 2008.
• [23] M. Staniak, T. Winiarski, and C. Zieliński. Parallel visual-force control. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS ’08, Nice, France, 2008.
• [24] T. Winiarski and C. Zielinski. Specification of multi-robot controllers on an example of a haptic device. Lecture Notes in Control & Information Sciences, 396: 227-242, 2009.
• [25] T. Kornuta. Application of the FraDIA vision framework for robotic purposes. In L. Bolc, R. Tadeusiewicz, L. Chmielewski, and K. Wojciechowski, editors, Proceedings of the International Conference on Computer Vision and Graphics, Part II, volume 6375 of Lecture Notes in Computer Science, pages 65-72. Springer Berlin / Heidelberg, 2010.
• [26] C. Zieliński and T. Winiarski. Motion Generation in the MRROC++ Robot Programming Framework. International Journal of Robotics Research, 29 (4): 386-413, 2010.
• [27] M. Staniak and C. Zieliński. Structures of visual servos. Robotics and Autonomous Systems, 58 (8): 940-954, 2010.
• [28] T. Kornuta and C. Zieliński. Behavior-based control system of a robot actively recognizing hand postures. In 15th IEEE International Conference on Advanced Robotics, ICAR 2011, pages 265- 270, June 2011.
• [29] T. Kornuta and C. Zieliński. Decomposition of the robot-cashier control system (In Polish). Pomiary - Automatyka - Robotyka PAR, (2): 41-48, 2011.
• [30] C. Zieliński, T. Kornuta, P. Trojanek, T. Winiarski, and M. Walęcki. Specification of a Multi-agent Robot-Based Reconfigurable Fixture Control System. Robot Motion & Control 2011 (Lecture Notes in Control & Information Sciences), 422: 171-182, 2012.