外观
论文arXiv 2610.2035114 天前
人类演示作为任意机器人本体的后训练数据：重定向物体，而非手部
原文链接：Human Demonstrations as Post-Training Data for Any Robot Body: Retargeting the Object, Not the Hand（arXiv 2610.20351 · 发布日期：2026-10-14）
Human Demonstrations as Post-Training Data for Any Robot Body: Retargeting the Object, Not the Hand
该工作将手机采集的人类演示转为物体运动记录，通过按URDF求解机器人并在仿真中验证其后训练适用性。
核心要点
- 人类演示多用于VLA预训练，难以直接服务目标本体或任务后训练。
- 方法不重定向手部，而记录物体位姿、接触区间和可溯源3D物体。
- 给定机器人URDF和简短描述，在仿真中以演示物体运动为真值评分。
- 样本含42次采集、8个机器人、157对；31.2%通过，52.2%失败。
验证范围与局限：验证仅覆盖人到仿真的环节：42次采集、8个机器人、157对在仿真中评估，尚未训练策略或真机验证。
英文摘要 (Abstract)
Human demonstrations are today used largely for pretraining vision-language-action models, with little ability to use the same data for target-embodiment or task-oriented training, which scalable deployment of robots in industrial and general environments depends on. A human demonstration recorded on a simple and scalable device such as a mobile phone can serve as post-training data for a robot whose body differs in structure and capability from the human who recorded it. This is made possible not by retargeting the hand's motion but the object's. A capture yields a body-free record: the object's pose over time, its contact intervals, and a reconstructed 3D object with provenance. Any robot, given as a URDF and a short descriptor, is solved against that record and scored in simulation against the demonstrated object motion as ground truth: the human-to-simulation leg of human-to-simulation-to-robot transfer, measured per robot. Each (robot, episode) pair gets one outcome: pass, failure with a named mode, or refusal, with its reason, before any motion. The method runs as a working system over a growing collection; the set analysed here is a sample of it: 42 captures solved on 8 robots, 157 pairs, of which 31.2% pass, 52.2% fail, 14.0% are refused and 2.5% are unauditable (kinematic feasibility, +/-50 mm / +/-15 deg, in simulation). Refusals held up: every pair the checks refuse on stored evidence yet ran anyway failed (13 of 13; 5 on a body whose public model welds its hand). A description file could not be shown to screen a robot: its outcomes were barely more predictable than guessing. No policy has yet been trained on the record. The record decides what a robot may post-train on; whether the policy then works on the real robot is the simulation-to-robot question, answered downstream.
作者：Nagasrikanth Kallakuri
来源
本页事实对应的公开页面，以原文为准。