外观
论文HF Daily Papers · arXiv 2610.1972614 天前
DAO与JING框架构建具身智能持久世界仿真与第一人称交互
本文由 AI 根据公开内容整理，可能有误，请以原文为准：Generative World Simulation with DAO and JING（HF Daily Papers · arXiv 2610.19726）
核心内容
研究团队发布Generative World Simulation框架，核心解决具身智能仿真中环境状态不持久与交互体验割裂问题。该方案通过耦合可计算世界引擎DAO与自我中心交互体验模型JING，构建了支持人类与Agent长期互动的连续仿真系统，确保环境演化具备时间一致性与行为因果性。
技术架构上，DAO负责维护角色、物体及空间关系的共享状态，依据交互规则推进世界时间并记录行为后果；JING则基于DAO派生的观察者特定条件，结合场景引用与操作历史实时生成第一人称视听反馈。用户可通过视角控制与文本指令操纵对象或对话，其动作直接更新共享状态并驱动后续体验生成，形成具备历史记忆的闭环交互链路。
关键看点
- DAO世界引擎：维护角色与空间共享状态，按规则推进世界时间并持久化保存过往交互的行为后果
- JING体验模型：融合观察者条件、场景引用及操作历史，实时生成连续的第一人称视听交互体验
- 闭环交互机制：用户文本指令与视角操作直接更新共享世界状态，驱动环境演化与后续感知生成
- 持久化仿真：突破单次会话限制，构建保留完整历史记忆且独立于单一观察者存在的动态交互世界
工程与产业观察
该框架为具身智能提供了具备因果一致性的长程训练环境，解决了传统生成式仿真缺乏状态记忆导致策略难以泛化的痛点。通过将世界状态管理与感官生成解耦再耦合，为验证Agent在动态环境中的长期规划与交互能力确立了新的工程范式，对Sim-to-Real数据质量提升具有关键参考价值。
英文摘要 (Abstract)
We present a Generative World Simulation framework that couples persistent shared world state with continuous first-person audiovisual generation. The framework integrates DAO, a computable world engine, and JING, an Egocentric Interactive Experience Model, to support sustained interaction for humans and agents. DAO maintains the states of characters, objects, and spaces and their relationships, advancing the world according to interaction rules and world time while preserving the consequences of past actions. From this evolving state, DAO derives observer-specific conditions for JING, which combines these conditions with character, object, and scene references, observation history, and current actions to generate each observer's audiovisual experience. Users can explore environments, manipulate objects, and communicate with characters through viewpoint control and text instructions, with their actions shaping both the shared state and subsequent experiences. By connecting world-state evolution with experience generation in a continuous interaction loop, the framework offers an approach to building interactive worlds that retain their history, evolve through action, and persist beyond any individual observer.
Hugging Face Daily Papers 热度：8 upvotes 作者：XGEN Team, Guohao Cai, Haoxuan Che, Frank Fan, Chenran Huang, Junjia Huang, Jiayi Jiang, Yanheng Li, Leon Liu, Shaoteng Liu, Xi Liu, Feng Nie, Zhefan Rao, An Wang, Hanwen Wang, Pengxiang Yan, Jieming
来源
本页事实对应的公开页面，以原文为准。