Control of a manipulator by hand movement watched by visual a system

• Autorzy: Milecki, A. , Owczarek, P. , Rybarczyk, D.
• Języki publikacji: EN

Abstrakty

EN

The paper presents a control system, which uses a simple internet camera with a PC based markers recognition software for tracking human hand movement by a 2-axis manipulator with electrohydraulic servo drives. Three colour markers are attached to the operator's hand and arm, which are tracked by a vision system. It recognizes these markers, calculates their two-dimensional coordinates and sends them to the manipulator main controller, which calculates the desired signals to satisfy the requirements of electrohydraulic servo drives. These signals are then sent to the manipulator slave controller, which governs the movements of the electrohydraulic servo drives installed in the manipulator. In this way, the manipulator is able to follow the human hand.

Słowa kluczowe

PL

system wizyjny; manipulator; kontrola

EN

vision system; manipulator; control

• Czasopismo: International Journal of Applied Mechanics and Engineering
• Rocznik: 2012
• Tom: Vol. 17, no. 3
• Strony: 907-916
• Opis fizyczny: Bibliogr. 14 poz., rys., wykr.

Twórcy

autor

Milecki, A.

autor

Owczarek, P.

autor

Rybarczyk, D.

• Poznan University of Technology Institute of Mechanical Engineering ul. Piotrowo 3, 60-965 Poznań, POLAND,

Bibliografia

• Behal A., Setlur P., Dixon W. and Dawson D.M. (2005): Adaptive position and orientation regulation for the camera-in-hand problem. - Journal of Robotic Systems, vol.22, No.9, pp.457-47.
• Benezeth Y., Emile B., Laurent H. and Rosenberger C. (2010): Vision-based system for human detection and tracking in indoor environment. - Int. J. Soc. Robot, vol.2, pp.41-52.
• Bouguet J.Y. (2010): Camera Calibration Toolbox for Matlab. - www.vision.caltech.edu/bouguetj/calib_doc.
• Bradski G. and Kaehler A. (2008): Learning OpenCV. Computer Vision with the OpenCV Library. - O'Reilly Media.
• Chang W.-Ch. (2006): Hybrid force and vision-based contour following of planar robots. - J. Intelligent Robot Systems, vol.47, pp.215-237.
• Chuanga Ch.-W., Huangb M.-S., Chenb K.-Y. and Fung R.-F. (2008): Adaptive vision-based control of a motor-toggle mechanism: Simulations and experiments. - Journal of Sound and Vibration, vol.312, pp.848-861.
• Hashimoto K. (2003) A review on vision-based control of robot manipulators. - Advanced Robotics, vol.17, No.10, pp.969-991.
• Heikkila J. and Silven O. (1997): A four-step camera calibration procedure with implicit image correction. - Proceedings of the 1997 IEEE Computer Society Conference Computer Vision and Pattern Recognition, pp.1106-1112.
• Ju Y., Chang S.K., Jong B., Hong S., Lee M.H. and Harashima F. (2001): Vision based lateral control by yaw rate feedback. - The 27th Annual Conference of the IEEE Industrial Electronics Society C, pp.2135-2138.
• Milecki A. (2003): Linear electrohydraulic servo drives. Modeling and control. - Publisher: Poznan University of Technology, pp.1-130.
• Mozos O.M., Kurazume R. and Hasegawa T. (2010): Multi-part people detection using 2D range data. - Int. J. Soc. Robot 2, pp.31-40.
• Park J.H. and Lee Y.J. (2002): Robust visual servoing for motion control of the ball on a plate. - Mechatronics, vol.13, pp.723-738.
• Sturm J., Plagemann Ch. and Burgard W. (2009): Body schema learning for robotic manipulators from visual self-perception. - Journal of Physiology-Paris, vol.103, No.3-5, pp.220-231.
• Tadeusiewicz R. (1992): Visual Systems for Robots. - Warsaw, Poland: Publisher, WNT.