外观
论文arXiv 2610.1029721 天前
分层强化学习实现四足机器人跨地形零样本低能耗步态自适应
本文由 AI 根据公开内容整理，可能有误，请以原文为准：Energy-Efficient Gait Adaptation via Hierarchical Reinforcement Learning for Quadrupedal Locomotion Across Diverse Terrains（arXiv 2610.10297）
核心内容
针对端到端RL策略在腿足机器人控制中能耗与鲁棒性难以兼顾的痛点，研究提出分层强化学习（HRL）框架。该方法将高频关节级稳定运动执行与低频显式最小化运输成本（CoT）的步态适应解耦，并通过基于Isaac的三阶段训练流程，实现了从仿真到真机的零样本迁移，解决了传统方法对奖励函数设计高度敏感的问题。
系统展现出自动速度依赖的步态适应能力，低速时采用Pacing步态，高速时切换为Trotting步态。仿真对比显示该架构在宽速度范围及平坦、崎岖、斜坡等复杂地形下均优于单策略及现有分层基线。最终在Unitree AlienGo四足机器人上完成零样本实机部署，验证了算法在物理系统中的低能耗与高鲁棒性。
关键看点
- HRL架构解耦：分离高频关节控制与低频步态规划，显式优化CoT指标，克服端到端策略能耗优化难题
- 零样本Sim-to-Real：采用Isaac三阶段训练流程，无需真机微调即可实现高精度跟踪与跨地形鲁棒迁移
- 自适应步态切换：策略自动根据指令速度调整步态，低速Pacing过渡至高速Trotting，兼顾能效与稳定性
- AlienGo实机验证：在Unitree AlienGo平台完成零样本部署，证实分层策略在物理环境中的低能耗可行性
工程与产业观察
该工作证明了通过架构解耦解决具身智能多目标优化的有效性。将能耗优化从高频控制中剥离并置于低频决策层，配合标准化Sim-to-Real流程，为四足机器人长续航作业提供了可复现的工程范式，对野外巡检与应急救援场景的算法落地具有直接参考价值。
英文摘要 (Abstract)
While energy efficiency is a critical objective for legged-robot locomotion control, achieving low energy consumption while maintaining robust performance across different velocity ranges and terrain conditions remains a key challenge. This is particularly true for end-to-end RL policies, where gait generation, motion execution, and energy optimization are tightly coupled, leading to high sensitivity to reward design. In this work, we propose a hierarchical reinforcement learning (HRL) framework that separates a high-frequency policy for stable and robust joint-level motion execution from low-frequency gait adaptation that explicitly minimizes the cost of transport (CoT). The three-stage Isaac-based training procedure enables zero-shot sim-to-real transfer with improved tracking accuracy, robustness, and energy efficiency. The learned hierarchy exhibits automatic speed-dependent gait adaptation, transitioning from pacing at low speeds to trotting at higher speeds. We validate the proposed approach in simulation against representative single-policy and hierarchical locomotion baselines, demonstrating reduced CoT over a broad range of commanded velocities, while maintaining robust locomotion across flat, uneven rough, and inclined terrains. We further demonstrate its practical feasibility through zero-shot deployment on a physical Unitree AlienGo quadruped.
作者：Ammar Issa, Anubhav Singh, Anton Tsaritsin, Sergey Kolyubin
来源
本页事实对应的公开页面，以原文为准。