Skip to content

论文arXiv 2610.0600823 天前

使用世界模型和基于检索的动作规划进行超声操作者引导 ​

原文链接:Ultrasound Operator Guidance Using World Modeling and Retrieval Based Action Planning(arXiv 2610.06008 · 发布日期:2026-10-05)

Ultrasound Operator Guidance Using World Modeling and Retrieval Based Action Planning

面向超声操作者引导,提出基于 V-JEPA 2.1 的检索诱导世界模型,并在颈动脉超声回顾与前瞻实验中验证。

核心要点 ​

  • 超声采集质量依赖操作者经验,操作者引导系统旨在帮助低训练用户移动探头至目标视图。
  • 方法将观测编码到潜空间,从参考数据库检索相似视图及探头位姿,用已执行转移进行多步规划。
  • 部署时仅依赖实时超声图像,无需探头跟踪硬件,并通过蒸馏在 CPU 上实时运行前瞻研究。
  • 颈动脉超声回顾闭环中达 86% 目标到达率,优于 52% 和 43% 基线;未见志愿者前瞻达 83%。

验证范围与局限:验证范围限于颈动脉超声的回顾闭环片段和未见志愿者前瞻可行性研究。

英文摘要 (Abstract) ​

Ultrasound is widely used, but acquisition quality is heavily dependent on the operator's knowledge and expertise. With demand for examinations outpacing the supply of trained sonographers, operator-guidance systems aim to close this gap by instructing a less trained user how to move the probe toward a target view. In this paper, we propose a retrieval-induced latent transition model for ultrasound acquisition dynamics, formulating ultrasound operator guidance as multi-step planning and retrieval in a world model. Using a V-JEPA 2.1 backbone, observations are first encoded into a latent space where anatomically related views lie close together. We then retrieve similar views from a reference database containing encoded latent states and corresponding probe positions and orientations. Rather than learning a parametric transition function, we directly use physically executed transitions from the database to establish our nonparametric, retrieval-induced transition model that supports receding-horizon planning. At deployment, guidance is generated from the live ultrasound image feed alone, without any probe tracking hardware. Applied to carotid ultrasound, the proposed planner reaches the target view in 86% of retrospective closed-loop episodes, versus 52% and 43% for representative baselines, outperforming both on every target view, including the challenging longitudinal internal and external carotid artery views. A prospective feasibility study on unseen volunteers, run in real time on a CPU using distillation, reaches 83% target-view reachability. Because planning is driven by proximity to any encodable goal latent, the same world model can navigate back to any previously acquired, patient-specific frame, supporting reproducible longitudinal imaging for e.g. perioperative or follow-up monitoring.

作者:Noortje I.P. Schueler, Hans van Gorp, Ruud J. G. van Sloun

来源

本页事实对应的公开页面,以原文为准。

  1. arXiv 2610.06008:Ultrasound Operator Guidance Using World Modeling and Retrieval Based Action Planning访问 2026-10-21