论文arXiv 2611.152809 天前
自行车机器人语义地形编码实现5m/s越野自主导航
本文由 AI 根据公开内容整理,可能有误,请以原文为准:Autonomous Trail Racing with a Bicycle Robot(arXiv 2611.15280)
核心内容
针对两轮机器人在非结构化越野环境中高速导航的难题,研究团队提出基于语义地形编码的统一学习框架。该方案在Ultra Mobility Vehicle (UMV) 自行车机器人上验证,成功在公里级山地赛道实现全段自主竞速,峰值速度超5m/s,平均速度达3.26m/s。仿真测试表明,相比传统分层控制基线,该策略在保持更高速度的同时,任务失败率降低了一个数量级,证实了语义驱动端到端控制在动态平衡载具上的有效性。
技术核心在于摒弃传统速度/姿态指令接口,将局部导航与运动控制作为联合优化问题求解。感知端采用冻结视觉基础模型配合轻量级双头解码器,实时预测像素级地形语义与置信度,并与LiDAR数据融合生成30Hz自中心语义高程图,部署于NVIDIA AGX Orin平台。训练阶段将语义层嵌入仿真环境,仅通过地形语义和回合长度调节,即可用固定奖励权重同时生成越野竞速与敏捷跑酷策略,实现了从仿真到实机的零样本迁移。
关键看点
- 语义地形编码:将越野路径抽象为语义层嵌入训练环境,部署时通过相机与LiDAR在线重建,替代传统几何建图
- 联合优化架构:绕过经典控制层级指令接口,将导航规划与底层运动控制统一为端到端强化学习优化问题
- 实时感知管线:基于NVIDIA AGX Orin以30Hz生成自中心语义高程图,融合视觉基础模型语义预测与LiDAR测距
- 实测性能指标:UMV自行车机器人在非结构化山地赛道平均速度3.26m/s,峰值超5m/s,仿真失败率降10倍
工程与产业观察
该工作证明了在非完整约束两轮平台上,通过语义先验弥补几何感知不足可实现高速动态机动。其冻结大模型加轻量解码器的感知范式,以及语义驱动的Sim-to-Real迁移策略,为具身智能在复杂野外地形中的高动态作业提供了可复用的工程参考,尤其适用于对实时性与鲁棒性要求极高的无人车与足式机器人越野场景。
英文摘要 (Abstract)
Navigating off-road trails on a mountain bike requires diverse locomotion skills, including aerial maneuvers, cornering, and slip recovery, paired with sophisticated perception for scene understanding. Translating these capabilities to autonomous, two-wheeled robots remains a formidable challenge. We show that autonomous, high-speed trail navigation can be achieved through a single idea: encoding the trail as a semantic layer of the terrain. In simulation, this layer embeds the navigation task into the training environment; during deployment, it is reconstructed onboard from camera and LiDAR data. First, we introduce a unified learning framework that treats local navigation and locomotion as a joint optimization problem, bypassing the twist or pose command interface of classical control hierarchies. With fixed reward weights, the same framework produces both trail racing and agile parkour, shaped only through terrain semantics and episode length. Second, our perception pipeline combines a frozen vision foundation model with a lightweight dual-head decoder that predicts per-pixel terrain semantics and confidence scores, which are fused with LiDAR range measurements into an egocentric semantic elevation map at 30 Hz onboard an NVIDIA AGX Orin. We validate our framework on the Ultra Mobility Vehicle (UMV), a bicycle robot that autonomously raced across all sections of a kilometer-long, unstructured mountain bike trail at speeds exceeding 5 m/s and averaging 3.26 m/s. In simulation, our policy fails up to an order of magnitude less often than hierarchical baselines while driving faster.
作者:Fabian Jenelten, Deepana Ishtaweera, Pablo Garcia, Liana Margolese, Igor Bogoslavskyi, Luca Buonocore, Jan Migliazza, Aleksandrs Ecins, Annika Wollschlaeger, Dario Bellicoso, Gabriel Nelson, Abel Gawe…
外部来源
本页事实对应的公开页面,以原文为准。(点击将离开本站)