# 分层强化学习实现四足机器人跨地形零样本低能耗步态自适应

> 原文链接：https://robotics.hellobike.com/papers/2026-10-07-2610-10297
> 频道：papers | 更新日期：2026-10-07 | 标签：auto, arxiv
> 核心摘要：提出分层强化学习框架解耦运动执行与步态优化，基于Isaac三阶段训练实现零样本迁移。Unitree AlienGo实测验证了速度自适应步态切换，在多种地形下显著降低运输成本并提升跟踪精度。

# 分层强化学习实现四足机器人跨地形零样本低能耗步态自适应

::: v-pre
> 本文由 AI 根据公开内容整理，可能有误，请以原文为准：[Energy-Efficient Gait Adaptation via Hierarchical Reinforcement Learning for Quadrupedal Locomotion Across Diverse Terrains](https://arxiv.org/abs/2610.10297)（arXiv 2610.10297）

## 核心内容

针对端到端RL策略在腿足机器人控制中能耗与鲁棒性难以兼顾的痛点，研究提出分层强化学习（HRL）框架。该方法将高频关节级稳定运动执行与低频显式最小化运输成本（CoT）的步态适应解耦，并通过基于Isaac的三阶段训练流程，实现了从仿真到真机的零样本迁移，解决了传统方法对奖励函数设计高度敏感的问题。

系统展现出自动速度依赖的步态适应能力，低速时采用Pacing步态，高速时切换为Trotting步态。仿真对比显示该架构在宽速度范围及平坦、崎岖、斜坡等复杂地形下均优于单策略及现有分层基线。最终在Unitree AlienGo四足机器人上完成零样本实机部署，验证了算法在物理系统中的低能耗与高鲁棒性。

## 关键看点

- **HRL架构解耦**：分离高频关节控制与低频步态规划，显式优化CoT指标，克服端到端策略能耗优化难题
- **零样本Sim-to-Real**：采用Isaac三阶段训练流程，无需真机微调即可实现高精度跟踪与跨地形鲁棒迁移
- **自适应步态切换**：策略自动根据指令速度调整步态，低速Pacing过渡至高速Trotting，兼顾能效与稳定性
- **AlienGo实机验证**：在Unitree AlienGo平台完成零样本部署，证实分层策略在物理环境中的低能耗可行性

## 工程与产业观察

该工作证明了通过架构解耦解决具身智能多目标优化的有效性。将能耗优化从高频控制中剥离并置于低频决策层，配合标准化Sim-to-Real流程，为四足机器人长续航作业提供了可复现的工程范式，对野外巡检与应急救援场景的算法落地具有直接参考价值。

## 英文摘要 (Abstract)

While energy efficiency is a critical objective for legged-robot locomotion control, achieving low energy consumption while maintaining robust performance across different velocity ranges and terrain conditions remains a key challenge. This is particularly true for end-to-end RL policies, where gait generation, motion execution, and energy optimization are tightly coupled, leading to high sensitivity to reward design. In this work, we propose a hierarchical reinforcement learning (HRL) framework that separates a high-frequency policy for stable and robust joint-level motion execution from low-frequency gait adaptation that explicitly minimizes the cost of transport (CoT). The three-stage Isaac-based training procedure enables zero-shot sim-to-real transfer with improved tracking accuracy, robustness, and energy efficiency. The learned hierarchy exhibits automatic speed-dependent gait adaptation, transitioning from pacing at low speeds to trotting at higher speeds. We validate the proposed approach in simulation against representative single-policy and hierarchical locomotion baselines, demonstrating reduced CoT over a broad range of commanded velocities, while maintaining robust locomotion across flat, uneven rough, and inclined terrains. We further demonstrate its practical feasibility through zero-shot deployment on a physical Unitree AlienGo quadruped.

作者：Ammar Issa, Anubhav Singh, Anton Tsaritsin, Sergey Kolyubin
:::

## 原始参考来源 (Sources)

- [arXiv 2610.10297：Energy-Efficient Gait Adaptation via Hierarchical Reinforcement Learning for Quadrupedal Locomotion Across Diverse Terrains](https://arxiv.org/abs/2610.10297)