基于现场可编程门阵列的可重构手势交互教学机器人设计

Abstract
Figure/Table
References
Related Citation (2)

Download: PDF (7005 KB) HTML (1 KB)
Export: BibTeX | EndNote (RIS)

Abstract In view of the disadvantages of traditional teaching robots such as poor recon- figurability, insufficient comprehensive application of the system and simple human-computer interaction function, this paper designs and develops a reconfigurable dynamic and static gesture interactive teaching robot based on field programmable gate array (FPGA). The robot uses Spartan6 of Xilinx as the controller, uses OV5640 camera to recognize and transmit the gesture image information, uses I2C bus to communicate with FPGA, and uses WiFi module to transmit data, so as to control the robot with corresponding gesture instructions. It realizes many functions, such as human-computer gesture interaction, mechanical arm grasping, automatic tracking, ultrasonic obstacle avoidance, motion obstacle removal, voice broadcasting and so on. At the same time, the recognition accuracy of the gesture control robot is 95.1%, and the real-time recognition response time is less than 0.5s. A FPGA-based reconfigurable teaching robot controlled by dynamic and static gestures designed in this paper can be used in the teaching of research courses such as FPGA system design, and has promotion value.

Key words： reconfigurable teaching robot dynamic and static gesture control field programmable gate array (FPGA) real-time recognition

Received: 15 August 2023

	Service

	E-mail this article
	Add to my bookshelf
	Add to citation manager
	E-mail Alert
	RSS
	Articles by authors
	DENG Guangwen
	LIANG Jiaojiao
	ZHANG Jiaxiang
	TAN Huisheng

Cite this article:

DENG Guangwen,LIANG Jiaojiao,ZHANG Jiaxiang等. Design of reconfigurable gesture interactive teaching robot based on field programmable gate array[J]. Electrical Engineering, 2023, 24(10): 8-16.

URL:

http://dqjs.cesmedia.cn/EN/Y2023/V24/I10/8

[1] KARALEKAS G, VOLOGIANNIDIS S, KALOMIROS J.Europa: a case study for teaching sensors, data acquisition and robotics via a ROS-based educational robot[J]. Sensors, 2020, 20(9): 2469.
[2] YANG Dapeng, OH E S, WANG Yingchun.Hybrid physical education teaching and curriculum design based on a voice interactive artificial intelligence educational robot[J]. Sustainability, 2020, 12(19): 8000.
[3] 温秀兰, 胡仰, 姚波, 等. 基于双目视觉的双臂协作教学机器人研究与设计[J]. 南京信息工程大学学报(自然科学版), 2021, 13(3): 304-310.
[4] 金安成, 路敦民, 李彬, 等. 可重构模块化教学机器人设计[J]. 森林工程, 2012, 28(6): 50-53.
[5] 赵艺兵, 王振豪, 倪银堂, 等. 拖动示教教学机器人研究与设计[J]. 实验技术与管理, 2020, 37(6): 128-131, 175.
[6] 何之源. 高性能嵌入式AI计算平台的人机交互手势控制识别[J]. 电子技术与软件工程, 2022(2): 145-148.
[7] PATHAN A N, SHEJAL S A, SALGAR S A, et al.Hand gesture controlled robotic system[J]. International Journal of Aquatic Science, 2022, 13(1): 487-493.
[8] 杨建华, 李正, 赵妤, 等. 基于肌电信号的嵌入式手势识别系统设计[J]. 自动化与仪表, 2021, 36(12): 62-66.
[9] 朱越, 李振伟, 杨晓利, 等. 基于视觉的静态手势识别系统[J]. 计算机技术与发展, 2019, 29(2): 69-72.
[10] 李金鑫, 周卫华. 移动机器人位姿检测系统的设计与实现[J]. 电气技术, 2018, 19(11): 68-70, 75.
[11] 陈标发, 陈传东, 魏榕山, 等. 基于现场可编程门阵列的智能配电站安防巡检系统设计与实现[J]. 电气技术, 2022, 23(5): 34-38.
[12] 龙樟, 卢成娅, 李国鹏, 等. 视觉手势识别的移动机器人手势控制系统设计[J]. 机械科学与技术, 2022, 41(8): 1247-1253.
[13] YU Yuting, QIAO Ya, REN Gangqiang, et al.Design of digital recognition system based on FPGA[J]. Journal of Physics: Conference Series, 2021, 1885(5): 052030.
[14] ZHANG Xuexiang, WU Xuncheng.Robotic control of dynamic and static gesture recognition[C]//2019 2nd World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM), Shanghai, China, 2020: 474-478.
[15] 赵忠宇, 高博, 龙行锐, 等. 实时FPGA手势识别算法的设计[J]. 电子测量技术, 2020, 43(20): 89-92.
[16] 黄沛昱, 黄岭, 袁素真. 基于肤色质心与边缘自生长的手势分割算法[J]. 计算机应用与软件, 2022, 39(3): 159-164, 171.