论文arXiv 2611.1010712 天前
基于视觉嵌入高斯混合的在线物理参数估计提升机器人控制
本文由 AI 根据公开内容整理,可能有误,请以原文为准:Beyond Semantic Classes: Online Physical Parameter Estimation via Embedding-Conditioned Gaussian Mixtures(arXiv 2611.10107)
核心内容
针对机器人接触前物理属性推断中视觉歧义问题,研究提出一种基于嵌入条件化高斯混合模型的在线估计器。该方案摒弃固定语义分类,将逆建模得到的交互参数作为混合分量,利用视觉嵌入相似度检索并加权历史交互数据。实验表明,该系统可在控制器速率下实时评估,有效恢复多模态物理信念并拒绝无关历史,解决了传统点估计或离散化地图无法保留不同物理机制的局限。
系统架构包含支持感知融合机制与嵌入细化模块:前者在交互历史稀疏时引入条件生成先验模型,后者通过学习优化检索相关性且避免表征离散化。在高保真自动驾驶赛车仿真验证中,面对未知高低摩擦区域,该后验估计使控制器能随圈数增加积累交互证据并自适应调整策略。相比仅依赖外观的方法,该技术实现了摩擦感知行为的持续优化,为非结构化环境下的具身智能体提供了可靠的预接触物理推理能力。
关键看点
- 核心算法:采用交互驱动高斯混合后验替代语义索引,直接基于连续视觉嵌入进行条件化物理参数估计
- 稀疏适应:集成支持感知融合机制,在交互数据不足时自动调用条件生成先验模型维持估计稳定性
- 实时性能:估计器达到控制器级运行速率,避免空间地图离散化,支持在线多模态物理信念更新
- 仿真验证:在自动驾驶赛车场景中通过累积交互证据自适应调整策略,显著提升摩擦感知控制性能
工程与产业观察
该工作突破了视觉语义标签在物理交互中的信息瓶颈,证明了连续嵌入结合概率混合模型在实时控制回路中的有效性。对于具身智能体而言,这种不依赖预定义类别、能从稀疏交互中在线学习物理特性的范式,为解决Sim-to-Real迁移及非结构化环境操作提供了重要的算法参考,尤其适用于需要高频触觉-视觉融合的动态任务。
英文摘要 (Abstract)
Enabling robots to infer interaction-relevant physical properties from vision before contact would improve planning and control in unstructured environments. Vision provides useful pre-contact information, but appearance alone is often ambiguous: visually similar regions can induce different friction, stiffness, or sinkage responses upon contact. Existing approaches often collapse this ambiguity to a point estimate or aggregate experience through fixed semantic classes, limiting their ability to preserve distinct physical regimes. Instead, we propose a real-time estimator that replaces semantic class indexing with an interaction-grounded Gaussian-mixture posterior over latent physical parameters, conditioned directly on continuous visual embeddings. Our approach maintains interaction-derived Gaussian parameter estimates, typically from inverse modeling, as mixture components while using embedding similarity to retrieve and weight relevant past interactions for each new query region. A support-aware fusion mechanism incorporates a conditional generative prior model when interaction history is sparse, while a learned embedding refinement improves retrieval relevance without discretizing the representation. Our experiments show that the estimator recovers multimodal physical beliefs, rejects unrelated interaction history, avoids spatial map discretization, and evaluates at controller rates. In a high-fidelity autonomous racing simulation with unknown low- and high-friction surface regions, the posterior enables the controller to adapt over repeated laps as interaction evidence accumulates, improving performance while maintaining friction-aware behavior.
作者:Alexander Borca-Tasciuc, Prayag Sharma, Franck Djeumou
外部来源
本页事实对应的公开页面,以原文为准。(点击将离开本站)