Skip to content

论文arXiv 2610.1407520 天前

评估 UMI 风格大 FoV 腕部相机操作中外部头部视图的边际效用 ​

原文链接:Assessing the Marginal Utility of Exocentric Head Views in UMI-Style Large-FoV Wrist-Camera Manipulation(arXiv 2610.14075 · 发布日期:2026-10-08)

Assessing the Marginal Utility of Exocentric Head Views in UMI-Style Large-FoV Wrist-Camera Manipulation

该文比较双大视场腕部相机与额外头部视图策略,在真实双臂平台三项桌面任务中评估多视角收益。

核心要点 ​

  • 多视角常被视为稳妥设计,论文在桌面双臂操作中重新检验更多相机是否更好。
  • 方法是在控制变量实验中,对比仅用两路大 FoV 腕部相机与额外加入头部视图的策略。
  • 三项桌面任务显示,若腕部相机已覆盖物体、夹爪和目标区,头部视图不稳定提升完成率或执行质量。
  • 限制腕部 FoV 会增加头部视图价值;ROI 裁剪比未裁剪头图更稳定,且 FoV 与示教数量存在交互。

验证范围与局限:验证限于真实双臂平台上的三项桌面双手操作任务。

英文摘要 (Abstract) ​

Multi-view perception is often treated as a safe design choice for robot manipulation: if one camera is useful, more cameras should be better. We revisit that assumption in tabletop bimanual manipulation by comparing policies trained with two large-field-of-view (FoV) wrist cameras against policies that additionally receive a head view, using controlled-variable experiments on a real bimanual platform. Across three tabletop tasks, adding a head view does not consistently improve task completion or execution quality: when the wrist cameras already observe the objects, grippers, and goal regions, wrist-only policies form a strong baseline. Restricting the wrist-camera FoV increases the potential value of a head view, but performance improves most reliably when the added view supplies concentrated, task-relevant information: region-of-interest (ROI) cropping yields more consistent head-view gains than the uncropped image, which is dominated by background and task-irrelevant regions. The data-scaling results further suggest an interaction between FoV and demonstration count: wide observations improve coverage but may require more data to stabilize, and they may reach a higher performance ceiling once enough demonstrations are available. These results suggest that camera design should be framed as a task-relevance and information-density problem rather than as a simple count of input views.

作者:Yuhui Duan, Shi Jin, Yuntian Wang, Jin Wang, Siao Liu, Wenchang Gao, Zhaxizhuoma, Yan Ding

来源

本页事实对应的公开页面,以原文为准。

  1. arXiv 2610.14075:Assessing the Marginal Utility of Exocentric Head Views in UMI-Style Large-FoV Wrist-Camera Manipulation访问 2026-10-21