论文arXiv 2611.259582 天前
深度强化学习框架实现四足机器人11种步态地形自适应最优选择
本文由 AI 根据公开内容整理,可能有误,请以原文为准:Learning optimal gaits and styles for terrain-adaptive quadruped locomotion(arXiv 2611.25958)
核心内容
针对四足机器人步态最优性依赖地形与评价指标的难题,研究者提出一种联合深度强化学习与中枢模式发生器(CPG)抽象振荡器网络的学习框架。该方法在多种挑战性地形中成功习得11种四足步态及其对应的基座高度、足端离地间隙等运动风格参数,并证明每种步态在特定地形-指标-速度组合下均具备最优性,突破了传统仅关注平地能效的局限。
系统采用双层策略架构:底层生成步态与风格,上层根据用户指定准则(如运输成本、基座稳定性或关节平滑度)动态选择最优步态。实验表明该框架具备强零样本泛化能力,可适应训练分布外的极端地形、未见过的步态耦合,以及质量达训练机体5倍的更大四足平台;仅需增加俯仰跟踪奖励项,同一套步态耦合即可支持双足运动模式,为多模态具身移动提供了通用解法。
关键看点
- 步态库规模:基于RL与CPG振荡器网络,在复杂地形联合学习11种四足步态及配套运动风格参数
- 多目标择优:上层策略依据运输成本、基座稳定性或关节平滑度等指标,实时匹配地形与速度最优步态
- 零样本泛化:无需微调即可迁移至训练分布外地形、新步态耦合及5倍训练质量的更大四足机体
- 跨模态复用:通过单一俯仰跟踪奖励项扩展,同一套步态耦合机制可直接支持双足运动模式
工程与产业观察
该工作将步态选择从启发式规则升级为基于地形-指标-速度的端到端优化,证实CPG与RL结合可实现跨尺度、跨模态的运动原语复用。其零样本泛化至5倍质量机体的能力,为具身智能算法从小型仿真/实验平台向大型工业四足机器人的Sim-to-Real迁移提供了关键验证,显著降低了多地形自适应控制器的部署门槛。
英文摘要 (Abstract)
Animals use many different gaits to locomote at different speeds across varying terrains. A longstanding question in biology and robotics is: which gait is best? This question is most often addressed from an energy-efficiency perspective on flat terrain, leaving open how the answer depends on terrain and on the criterion optimized. Here we show that gait optimality is determined jointly by terrain, performance metric, and velocity. We use deep reinforcement learning and networks of abstract oscillators, modeling spinal central pattern generators, to learn 11 quadrupedal gaits across diverse challenging terrains, together with the locomotion style (base height, foot ground clearance, foot offsets) that each requires. A second policy then selects among them to optimize a user-specified criterion such as cost of transport, base stability, or joint smoothness. Across these performance metrics and within this repertoire, every gait is optimal under at least one terrain-metric-velocity combination. The framework adapts zero-shot to gait couplings and styles never seen during training, to terrains far beyond the training distribution, and to larger quadrupeds five times the training mass. With a single additional pitch-tracking reward term, the same gait couplings also support bipedal-mode locomotion. Our method provides a general and systematic way to produce expressive locomotion and to select the gait best suited to a given terrain and criterion. Project page: https://guillaume10.github.io/terrain-gaits.
作者:Guillaume Bellegarda, Auke Ijspeert
外部来源
本页事实对应的公开页面,以原文为准。(点击将离开本站)