论文arXiv 2611.183056 天前
PROOF框架:基于OOD回退机制提升足式机器人视觉感知鲁棒性
本文由 AI 根据公开内容整理,可能有误,请以原文为准:PROOF: Perceptive Robustness via Out-of-Distribution Fallback for Legged Locomotion(arXiv 2611.18305)
核心内容
针对视觉感知足式机器人在遮挡、反光及光照变化下易失效的痛点,研究提出PROOF(Perceptive Robustness via Out-of-Distribution Fallback)框架。该方法通过两阶段教师-学生训练范式显式建模感知可靠性,使系统在严重视觉干扰下仍能保持稳健运动。实验基于Unitree Go2四足机器人平台搭载RealSense D435深度相机完成,验证了算法在真实复杂环境中的有效性。
技术上,教师策略同时学习感知驱动与本体感觉回退行为,学生网络预测外部特征并评估不确定性,在检测到分布外(OOD)输入时自动抑制不可靠视觉信息。实测表明,正常视觉下机器人可完成跨越大间隙、高台及窄梁等高动态跑酷动作;在重度遮挡或强光等极端视觉退化场景中,系统能无缝切换至本体感觉主导模式,确保持续稳定的地形适应能力。
关键看点
- 双模态回退机制:教师策略并行学习视觉感知与本体感觉回退行为,学生网络实时预测外部特征不确定性,遇OOD输入自动抑制视觉依赖
- 高动态运动能力:正常视觉条件下支持Unitree Go2执行跨越大间隙、高台及窄梁等复杂跑酷动作,验证感知与控制的紧耦合性能
- 极端环境鲁棒性:在重度遮挡与强光照变化等严重视觉退化场景中,依靠本体感觉回退维持稳定运动,解决纯视觉方案失效难题
- 实机验证平台:基于Unitree Go2四足机器人配合RealSense D435深度相机部署,提供从仿真到真机的完整感知鲁棒性验证数据
工程与产业观察
该工作为具身智能感知系统的长尾安全问题提供了工程化范式。通过显式建模感知置信度并设计平滑回退机制,解决了视觉SLAM/感知在极端工况下的脆性问题。对于依赖深度相机的足式机器人研发,这种“感知-本体”自适应融合策略比单纯追求视觉模型精度更具落地价值,是提升非结构化环境作业可靠性的关键技术路径。
英文摘要 (Abstract)
Vision-based perceptive locomotion has enabled legged robots to achieve agile and terrain-aware locomotion across complex environments. However, the reliability of such systems heavily depends on visual observations, which are inherently susceptible to occlusion, reflective surfaces, and illumination variations, often resulting in catastrophic locomotion failures under degraded perception conditions. In this paper, we present PROOF (Perceptive Robustness via Out-of-Distribution Fallback for Legged Locomotion), a perceptive locomotion framework that enables robust locomotion under severe visual disturbances. Our method adopts a two-stage teacher-student learning paradigm that explicitly models perception reliability: the teacher learns both perception-driven and proprioceptive fallback behaviors, while the student predicts exteroceptive features with uncertainty and suppresses them under out-of-distribution inputs. We evaluate our method on a Unitree Go2 quadruped equipped with a RealSense D435 depth camera in real-world settings. Under normal visual conditions, our method enables the robot to successfully perform high-dynamic parkour maneuvers, including traversing large gaps, elevated platforms, and narrow beam terrains. Under severe visual degradation, such as heavy occlusion and strong illumination changes, the robot continues to maintain stable and robust locomotion performance.
作者:Siyuan Wang, Dongjie Zhu, Jinxuan Lu, Wenjun Xu, Jiankun Wang
外部来源
本页事实对应的公开页面,以原文为准。(点击将离开本站)