基于多模态传感融合的人体下肢肌肉力预测及其在外骨骼控制中的应用方法研究
DOI:
CSTR:
作者:
作者单位:

1.天津理工大学天津市先进机电系统设计与智能控制重点实验室天津300384; 2.机电工程国家级实验教学示范中心 (天津理工大学)天津300384; 3.中国科学院沈阳自动化研究所机器人与智能系统全国重点实验室沈阳110016; 4.辽宁工业大学电气工程学院锦州121001

作者简介:

通讯作者:

中图分类号:

TH-39TP242

基金项目:

国家自然科学基金面上项目(62473361)、辽宁省优秀青年科学基金项目(2025JH6/101000028)、机器人学国家重点实验室开放课题项目(2024-O17)资助


Research on the prediction of lower limb muscle forces based on multimodal sensor fusion and its application methods in exoskeleton control
Author:
Affiliation:

1.Tianjin Key Laboratory for Advanced Mechatronic System Design and Intelligent Control, School of Mechanical Engineering, Tianjin University of Technology, Tianjin 300384, China; 2.National Demonstration Center for Experimental Mechanical and Electrical Engineering Education, Tianjin University of Technology, Tianjin 300384, China; 3.State Key Laboratory of Robotics and Intelligent Systems, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; 4.College of Electrical Engineering, Liaoning University of Technology, Jinzhou 121001, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    人体肌肉力的实时准确感知是实现下肢外骨骼“按需辅助”控制的核心前提。针对外骨骼在肌肉疲劳、皮肤出汗等工况下基于传统表面肌电信号(sEMG)的运动意图识别易失效的局限,提出一种基于深度视觉与惯性测量单元(IMU)多模态融合的非侵入式下肢肌肉力预测及控制方法。首先,构建了5名健康受试者在平地及不同坡度上下坡等5种典型地形下的视觉与运动学多模态数据集,并基于sEMG-Hill肌肉模型离线计算股四头肌和腘绳肌内部肌肉力作为监督真值。其次,设计了一种双分支时空特征融合深层网络,通过并行通道分别提取深度图像序列的空间几何特征与惯性运动数据的时序动态,并引入自适应注意力机制进行特征智能异构加权融合,实现在实际应用阶段完全摆脱对表面肌电传感器的依赖。为实现从感知到控制的闭环转化,构建了由预测肌肉力实时驱动的自适应阻抗控制架构,将肌肉力变化连续映射为外骨骼的辅助刚度。实验结果表明,该方法预测精度显著优于单一模态方案,跨受试者平均决定系数(R2)超过0.81,均方根误差(RMSE)优于6 N;在模拟肌肉疲劳干扰下预测曲线形态高度一致,表现出极强的稳健性。最后,在商用下肢外骨骼系统上完成平台验证,实现高时间相位同步与低横向漂移,为复杂动态环境下外骨骼高鲁棒按需辅助控制提供了新路径。

    Abstract:

    Accurate real-time perception of human muscle force is a core prerequisite for achieving "assistance-on-demand" control in lower-limb exoskeletons. To address the vulnerability of traditional surface electromyography (sEMG)based motion intention recognition to failure under challenging real-world conditions such as muscle fatigue, electrode displacement, and skin perspiration, this paper proposes a non-invasive lower-limb muscle force prediction and control method based on the multimodal fusion of depth vision and inertial measurement unit (IMU). First, a multimodal visual and kinematic dataset was constructed involving five healthy subjects across five typical daily terrains, including level ground and sloped walking at various gradients. The internal muscle forces of the quadriceps and hamstrings were calculated offline using an sEMG-driven Hill-type musculoskeletal model to serve as the supervised ground truth. Second, a dual-branch spatiotemporal feature fusion deep network was designed, which extracts spatial-geometric features from depth image sequences and temporal dynamics from inertial motion data through parallel channels. By incorporating an adaptive attention mechanism for the intelligent, heterogeneous weighted fusion of these features, the proposed framework completely eliminates the reliance on sEMG sensors during the practical application phase, thereby bypassing signal degradation issues. To bridge the gap from perception to closed-loop control, an adaptive impedance control framework driven by real-time predicted muscle force was established, continuously mapping variations in muscle force to the assistance stiffness of the exoskeleton. Experimental results demonstrate that the proposed method significantly outperforms unimodal approaches, yielding a robust cross-subject average coefficient of determination (R2) exceeding 0.81 and a root-mean-square error (RMSE) of less than 6 N. Furthermore, the predicted force curves maintain highly consistent profiles under simulated muscle fatigue interference, exhibiting superior robustness against physiological disturbances. Finally, platform validation on a commercial lower-limb exoskeleton system achieved high temporal phase synchronization and low lateral drift, providing a promising and viable new paradigm for the highly robust, assistance-on-demand control of exoskeletons in complex, dynamic environments.

    参考文献
    相似文献
    引证文献
引用本文

刘宸,包瑞来,姚杰,张廷丰,张弼.基于多模态传感融合的人体下肢肌肉力预测及其在外骨骼控制中的应用方法研究[J].仪器仪表学报,2026,47(5):163-178

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-07-24
  • 出版日期:
文章二维码