外观
论文arXiv 2602.024598 个月前
TIC-VLA框架解决语义推理延迟，实现动态环境鲁棒导航
本文由 AI 根据公开内容整理，可能有误，请以原文为准：TIC-VLA: A Think-in-Control Vision-Language-Action Model for Robot Navigation in Dynamic Environments（arXiv 2602.02459）
核心内容
UCLA研究团队发布Think-in-Control (TIC)-VLA框架及配套DynaNav物理仿真套件，旨在解决视觉-语言-动作（VLA）模型在动态人机环境中因语义推理耗时导致的控制失配问题。该工作指出传统VLA假设推理与控制时间对齐不符合实际，提出了显式建模延迟语义状态的解决方案。实验表明，TIC-VLA在多秒级推理延迟条件下，依然能维持稳健的实时反应控制，且在仿真与真机测试中一致优于先前VLA模型，项目代码与数据已开源。
技术上，TIC-VLA定义了延迟语义-控制接口，将滞后的视觉-语言语义状态与显式延迟元数据作为动作生成条件，使策略网络学会补偿异步推理带来的信息过时。配套提出的延迟一致性训练管线，在模仿学习与在线强化学习阶段主动注入推理延迟，确保训练分布与异步部署场景对齐。DynaNav仿真套件提供物理精确且照片级逼真的动态环境，支持语言引导导航的高保真评估，有效弥合了Sim-to-Real差距，为具身智能算法验证提供了标准化基准。
关键看点
- 延迟感知架构：定义延迟语义-控制接口，将滞后语义状态与显式延迟元数据输入策略网络，补偿异步推理导致的信息过时
- 一致性训练管线：在模仿学习与在线RL阶段注入推理延迟，强制训练分布匹配真实部署中的异步时序特性
- DynaNav仿真套件：提供物理精确且照片级逼真的动态环境仿真，支持语言引导导航任务的高保真Sim-to-Real评估
- 实测性能验证：在数秒级语义推理延迟下保持实时反应控制，仿真与真机实验中导航成功率均显著优于现有VLA基线
工程与产业观察
该工作揭示了具身大模型落地中常被忽视的“推理-控制时序失配”工程瓶颈。TIC-VLA通过将系统延迟显式纳入模型输入与训练闭环，为大算力VLA模型在低实时性硬件上的部署提供了范式参考。配套的DynaNav套件填补了动态环境高保真导航评测空白，对推动具身智能从静态演示走向动态交互具有重要基础设施价值。
英文摘要 (Abstract)
Robots in dynamic, human-centric environments must follow language instructions while maintaining real-time reactive control. Vision-language-action (VLA) models offer a promising framework, but they assume temporally aligned reasoning and control, despite semantic inference being inherently delayed relative to real-time action. We introduce Think-in-Control (TIC)-VLA, a latency-aware framework that explicitly models delayed semantic reasoning during action generation. TIC-VLA defines a delayed semantic-control interface that conditions action generation on delayed vision-language semantic states and explicit latency metadata, in addition to current observations, enabling policies to compensate for asynchronous reasoning. We further propose a latency-consistent training pipeline that injects reasoning inference delays during imitation learning and online reinforcement learning, aligning training with asynchronous deployment. To support realistic evaluation, we present DynaNav, a physics-accurate, photo-realistic simulation suite for language-guided navigation in dynamic environments. Extensive experiments in simulation and on a real robot show that TIC-VLA consistently outperforms prior VLA models while maintaining robust real-time control under multi-second reasoning latency. Project website: https://ucla-mobility.github.io/TIC-VLA/
作者：Zhiyu Huang, Yun Zhang, Johnson Liu, Rui Song, Chen Tang, Jiaqi Ma
来源
本页事实对应的公开页面，以原文为准。