外观
论文arXiv 2610.1895013 天前
λ0模型与HumanVerse数据集实现人形机器人零样本全身操作迁移
本文由 AI 根据公开内容整理,可能有误,请以原文为准:$λ_0$: Scaling Open-World Egocentric Human Data for Humanoid Loco-Manipulation(arXiv 2610.18950)
核心内容
针对人形机器人全身移动操作数据稀缺难题,研究团队推出包含500小时开放世界人类演示的HumanVerse数据集,同步采集第一视角视频、身体及手部运动。基于此构建的λ0人形基础模型,利用机器人对齐的人类数据进行中间训练,在SIMPLE基准测试中取得90.0%成功率,并在无目标机器人示教前提下,于真实世界长程移动操作任务中实现62.5%的成功率。
技术核心在于一套人机映射管线:首先对齐相机视点与手臂外观以消除具身差异,其次离线优化运动参考与控制器输入,在保留全身协调性的同时显著降低末端执行器误差。实验表明,随着全身人类数据规模增加,下游任务进度持续提升,证实了利用低成本人类视频数据替代昂贵机器人真机采集,是训练通用人形操作基础模型的可行路径。
关键看点
- HumanVerse数据集:包含500小时开放世界人类全身移动操作数据,同步记录第一视角视频与高精度身体及手部动作捕捉信息
- 零样本迁移管线:通过视点与外观对齐及离线运动优化,消除具身差异并修正控制器输入,实现无需机器人示教的策略迁移
- λ0模型性能:人形基础模型在SIMPLE基准达90.0%成功率,真实世界长程移动操作任务成功率62.5%,且性能随数据量提升
- 数据扩展规律:验证了增加全身人类演示数据规模能持续改善下游任务表现,确立了人类数据作为人形模型预训练资产的价值
工程与产业观察
该工作为人形机器人提供了从人类视频到机器人策略的标准化转换范式。对于算法工程师,其离线运动优化与视点对齐方法是解决Sim-to-Real及Human-to-Robot间隙的关键参考;对产业界而言,500小时数据集与62.5%实机成功率证明了利用海量人类数据预训练基础模型,是突破人形机器人泛化瓶颈、降低真机数据采集成本的有效工程路径。
英文摘要 (Abstract)
Humanoid loco-manipulation requires coordinated whole-body interaction with the physical world, yet collecting robot demonstrations at scale remains costly. Human demonstrations offer a scalable alternative, but existing egocentric human supervision often omits locomotion and posture, while embodiment differences and controller dynamics hinder accurate end-effector execution. We introduce HumanVerse, a 500-hour dataset of open-world human loco-manipulation pairing egocentric video with synchronized body and hand motion. Our human-to-humanoid pipeline aligns camera viewpoints and arm appearance, and refines motion references and controller inputs offline to reduce end-effector errors while preserving whole-body coordination. We validate the pipeline through zero-shot transfer to Unitree G1 on representative whole-body manipulation and long-range loco-manipulation tasks, without target-task robot demonstrations. Building on this pipeline, we develop $λ_0$, a humanoid foundation model for whole-body loco-manipulation, with robot-aligned human demonstrations providing supervision for mid-training. Increasing whole-body human data consistently improves downstream task progress. $λ_0$ achieves 90.0% success on SIMPLE and 62.5% across real-world loco-manipulation tasks. We expect this study to guide scalable whole-body human data collection toward humanoid foundation models for richer interaction with the physical world. Homepage: https://lambdahumanoid.github.io/
作者:Lambda-humanoid Team, :, Chongyang Xu, Jin Chen, Jinhui Ye, Yilun Chen, Yiming Jiang, Zhao Wu, Hu Wei, Lin Qu, Shifeng Zhang, Yisheng He, Yuming Jiang, Zenan Meng, Zheng Wu, Mu Xu, Steven Hoi
来源
本页事实对应的公开页面,以原文为准。