基于表面肌电信号和眼动追踪的人-多机器人协同控制方法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:


Human-multi-robot Cooperative Control Method Based on Surface Electromyography and Eye Tracking
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为提高机器人系统对复杂指令的响应能力和适应性,提出基于表面肌电信号(surface electromyography,sEMG)和眼动追踪(Eye-Tracking)技术的人-多机器人共享控制。使用自主设计的肌电腕带实时采集操作员前臂的表面肌电信号,通过设计轻量级卷积神经网络识别典型的手势,并映射为系统控制指令。使用眼动跟踪仪获取操作员的注视点信息和视线轨迹,实现机器人选定和期望路径绘制。集成2种新型交互方式构建人机交互平台,并与多台小型机器人构成人-多机器人共享控制系统。在搭建的人-多机器人半实物仿真平台上进行实验。结果表明,该共享控制方法具备可行性和有效性。

    Abstract:

    In order to improve the response ability and adaptability of robot system to complex instructions, a human-multi-robot shared control based on surface electromyography (sEMG) and eye tracking technology is proposed. The self-designed EMG wrist strap is used to collect the surface EMG signals of the operator's forearm in real time, and the lightweight convolutional neural network is designed to recognize typical gestures and map them into system control instructions. The eye tracker is used to obtain the operator's gaze point information and gaze trajectory, and the robot is selected and the desired path is drawn. Two new interaction modes are integrated to construct a human-computer interaction platform, and a human-multi-robot shared control system is constructed with multiple small robots. Experiments are carried out on a human-multi-robot hardware-in-the-loop simulation platform, and the results show that the shared control method is feasible and effective.

    参考文献
    相似文献
    引证文献
引用本文

胡益铭.基于表面肌电信号和眼动追踪的人-多机器人协同控制方法[J].,2025,44(04).

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-08-10
  • 最后修改日期:2024-09-15
  • 录用日期:
  • 在线发布日期: 2025-05-06
  • 出版日期:
文章二维码