外观
论文arXiv 2405.059412024-05-09
SIMPLER仿真环境发布：无需高保真数字孪生即可评估真实机器人操作策略
本文由 AI 根据公开内容整理，可能有误，请以原文为准：Evaluating Real-World Robot Manipulation Policies in Simulation（arXiv 2405.05941）
核心内容
针对通用机器人操作策略真机评测不可扩展及复现性差的痛点，研究团队识别出虚实环境间的控制与视觉差异为核心障碍，并提出无需构建全保真数字孪生的缓解方案。基于此构建了SIMPLER仿真环境集，覆盖常见真实机器人配置。成对实测表明，策略在SIMPLER中的表现与真实世界具有强相关性，且能准确反映对各类分布偏移的敏感性等真机行为模式。
技术上，SIMPLER通过针对性对齐手段缩小Sim-to-Real差距，避免了昂贵的高精度建模。该框架不仅验证了仿真评分作为真机性能预测指标的有效性，还完整开源了所有环境资产及新环境构建工作流（simpler-env.github.io）。这为通用操作策略研发提供了标准化的低成本验证闭环，使算法工程师能在仿真阶段可靠地评估策略鲁棒性与泛化能力。
关键看点
- 虚实对齐：通过缓解控制与视觉差异替代全保真数字孪生，实现低成本可靠仿真评估
- 性能相关：成对实验证实SIMPLER仿真评分与真机操作成功率呈强相关，可预测实机表现
- 行为映射：仿真环境能准确复现真机策略对多种分布偏移的敏感性等关键行为模式
- 开源资产：开放全部SIMPLER环境及新场景构建工作流，支持通用操作策略标准化评测
工程与产业观察
SIMPLER证明了在不追求极致视觉保真的前提下，通过精准对齐控制与视觉域差异即可建立可靠的Sim-to-Real评估闭环。该开源基准显著降低了通用操作策略的真机试错成本，为具身智能算法从仿真到部署提供了标准化的验证基础设施，加速了操作大模型的迭代效率。
英文摘要 (Abstract)
The field of robotics has made significant advances towards generalist robot manipulation policies. However, real-world evaluation of such policies is not scalable and faces reproducibility challenges, which are likely to worsen as policies broaden the spectrum of tasks they can perform. We identify control and visual disparities between real and simulated environments as key challenges for reliable simulated evaluation and propose approaches for mitigating these gaps without needing to craft full-fidelity digital twins of real-world environments. We then employ these approaches to create SIMPLER, a collection of simulated environments for manipulation policy evaluation on common real robot setups. Through paired sim-and-real evaluations of manipulation policies, we demonstrate strong correlation between policy performance in SIMPLER environments and in the real world. Additionally, we find that SIMPLER evaluations accurately reflect real-world policy behavior modes such as sensitivity to various distribution shifts. We open-source all SIMPLER environments along with our workflow for creating new environments at https://simpler-env.github.io to facilitate research on general-purpose manipulation policies and simulated evaluation frameworks.
作者：Xuanlin Li, Kyle Hsu, Jiayuan Gu, Karl Pertsch, Oier Mees, Homer Rich Walke, Chuyuan Fu, Ishikaa Lunawat, Isabel Sieh, Sean Kirmani, Sergey Levine, Jiajun Wu, Chelsea Finn, Hao Su, Quan Vuong, Ted Xia…
来源
本页事实对应的公开页面，以原文为准。