Field Programmable Gate Arrays Based Real Time Robot Arm Inverse Kinematic Calculations and Visual Servoing

Reliability and precision are very important in space, medical, and industrial robot control applications. Recently, researchers have tried to increase the reliability and precision of the robot control implementations. High precision calculation of inverse kinematic, color based object recognition, and parallel robot control based on field programmable gate arrays (FPGA) are combined in the proposed system. The precision of the inverse kinematic solution is improved using the coordinate rotation digital computer (CORDIC) algorithm based on double precision floating point number format. Red, green, and blue (RGB) color space is converted to hue saturation value (HSV) color space, which is more convenient for recognizing the object in different illuminations. Moreover, to realize a smooth operation of the robot arm, a parallel pulse width modulation (PWM) generator is designed. All applications are simulated, synthesized, and loaded in a single FPGA chip, so that the reliability requirement is met. The proposed method was tested with different objects, and the results prove that the proposed inverse kinematic calculations have high precision and the color based object recognition is quite successful in finding coordinates of the objects.

PDF

___

W. He, K. Yuan, H. Xiao, Z. Xu, “A high speed robot vision system with GigE vision extension”, IEEE International Conference on Mechatronics and Automation, 2011, pp. 452-457.

X. Zhang, M.H. Lee, “A Developmental Robot Vision System”, IEEE International Conference on Systems, Man and Cybernetics, 2006, pp. 2024-2029.

P.R. Possa, S.A. Mahmoudi, N. Harb, C. Valderrama, P. Manneback, “A Multi-Resolution FPGA-Based Architecture for Real-Time Edge and Corner Detection”, IEEE Transactions on Computers, 2014, pp. 2376-2388.

R. Köker, “A genetic algorithm approach to a neural-network-based inverse kinematics solution of robotic manipulators based on error minimization”, Information Sciences, 222, pp. 528-543.

Y.H. Yu, N.M. Kwok, Q.P. Ha, “Color tracking for multiple robot control using a system-on-programmable-chip,” Automation in Construction, 20(6), pp. 669-676, 2013.

X. Lu, D. Ren, S. Yu, “FPGA-based real-time object tracking for mobile robot,”, International Conference on Audio, Language and Image Processing, 2010, pp. 1657-1662.

M. Z. Zhang, M.J. Seow, L. Tao, V.K. Asari, “A tunable high-performance architecture for enhancement of stream video captured under non-uniform lighting conditions”, Microprocessors and Microsystems, 32(7), pp. 386-393, 2008.

J. Rodríguez-Araújo, J.J. Rodríguez-Andina, J. Fariña, M.Y. Chow, “Field-Programmable System-on-Chip for Localization of UGVs in an Indoor iSpace”, IEEE Transactions on Industrial Informatics, 10(2), pp. 1033-1043, 2014.

X. He, Z. Wang, H. Fang, K. He, R. Du, “An embedded robot controller based on ARM and FPGA”, 4th IEEE International Conference on Information Science and Technology, 2014, pp. 702-705.

Y.S. Kung, H. Cheng-Ting, C. Hsin-Hung, T. Tai-Wei, “FPGA-realization of a motion control IC for wafer-handling robot”, 8th IEEE International Conference on Industrial Informatics, 2010, pp. 493-498.

S. Seok, D.J. Hyun, S. Park, D. Otten, S. Kim, “A highly parallelized control system platform architecture using multicore CPU and FPGA for multi-DoF robots”, IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 5414-5419.

Y. Zheng, H. Sun, Q. Jia, G. Shi, “Kinematics control for a 6-DOF space manipulator based on ARM processor and FPGA Co-processor”, 6th IEEE International Conference on Industrial Informatics, 2008, pp. 129-134.

M. K. Wu, Y. S. Kung, Y. H. Huang, T. H. Jung, “Fixed-point computation of robot kinematics in FPG”, International Conference on Advanced Robotics and Intelligent Systems (ARIS), 2014, pp. 35-40.

Y. S. Juang, T. Y. Sung, L. T. Ko, C. I. Li, “FPGA implementation of a CORDIC-based joint angle processor for a climbing robot”, International Journal of Advanced Robotic Systems, 10(4), p. 195, 2013.

R. Szabo, A. Gontean, A., “Robotic Arm Control Algorithm Based on Stereo Vision Using RoboRealm Vision”, Advances in Electrical and Computer Engineering, 15(2), pp. 65-74, 2015.

M. Kazmi, A. Aziz, P. Akhtar, D. Kundi, “FPGA based compact and efficient full image buffering for neighborhood operations”, Adv. Electr. Comput. Eng, 15(1), pp. 95-104, 2015.

A. Alabdo, J. Pérez, G.J. Garcia, J. Pomares, F. Torres, “FPGA-based architecture for direct visual control robotic systems”, Mechatronics, 39, pp. 204-216, 2016.

R. P. Paul, “Robot manipulators: mathematics, programming, and control: the computer control of robot manipulators”, Cambridge, London, MIT Press, 1983.

J. Rigelsford, “Robotics: Control, Sensing, Vision andIntelligence”, Industrial Robot: An International Journal, vol. 26, no. 2, 1999.

C. Krieger, B. J. Hosticka, “Inverse kinematics computations with modified CORDIC iterations,” IEE Proceedings - Computers and Digital Techniques, vol. 143, no. 1, pp. 87-92, 1996.