外观
论文arXiv 2610.0630623 天前
Inspect Robots:评估具身 AI 的能力与安全性
原文链接:Inspect Robots: Evaluating the Capabilities and Safety of Embodied AI(arXiv 2610.06306 · 发布日期:2026-10-05)
Inspect Robots: Evaluating the Capabilities and Safety of Embodied AI
提出开源模块化框架 Inspect Robots,用于具身智能体能力与安全评估,并在六种前沿语言模型策略上演示。
核心要点
- 通用语言模型日益能控制机器人硬件,需理解具身后的能力、安全与社会风险。
- 框架提供可定制、可复用抽象,用于指定物理评估并分析结果。
- 基础设施自动化评估的设置、执行与终止,支持模块化开发和运行。
- 作者用其评估六种基于前沿语言模型的策略;发布后三个月近十万次下载。
验证范围与局限:验证范围为六种基于前沿语言模型的策略,摘要未说明具体任务或机器人平台。
英文摘要 (Abstract)
General purpose language models are increasingly able to control robotic hardware. Understanding the capabilities and safety of these models when embodied is therefore increasingly important for understanding their societal impact and risks. To this end, we introduce Inspect Robots, a modular, open-source framework for developing and running evaluations of embodied agents. Inspect Robots pairs customizable, reusable abstractions for specifying physical evaluations and analyzing their results with infrastructure that automates evaluation setup, execution and termination. We demonstrate Inspect Robots by using it to evaluate the capabilities and safety of six policies based on frontier language models. Inspect Robots has seen significant early uptake, receiving nearly 100,000 downloads in the three months since its release.
作者:Christopher Leet, Achu Menon, Sravanthi Machcha, Sabrina Zou, Aayushya Patel, Aditya Kumar Singh, Anish Kr Singh, Galaba Vamsi, Javin Ahuja, Sai Asish Yamani
来源
本页事实对应的公开页面,以原文为准。