← 返回时间线

paper

Can World and Action Modeling Benefit Each Other under Unified Causal Training?

arXiv ↗
ID
2610.21095
分类
—
首次捕获
2026-10-17
状态
unread
作者
Yue Su, Bokai Lin, Xinkai Wang, Chubin Zhang, Xiangnan Wu, Kuan Zhang, Weiyang Jin, Jiwen Yu, Yiming Li, Cewu Lu, Lixin Yang, Xihui Liu
信号
🔥 40

信号历史

  • 2026-10-17HF Daily Papers · 🔥39
  • 2026-10-18HF Daily Papers · 🔥40
暂无信号数据

摘要

World and action modeling are closely related, yet their reciprocal benefits under unified causal training remain unclear. We introduce OneWM, a simple framework for unified causal training that treats actions as both conditions for world prediction and targets for policy learning within a shared video-action architecture. Using this framework, we investigate whether learning forward dynamics conditioned on specified actions improves action learning, and whether learning to generate actions in turn improves action-conditioned world modeling. We use LIBERO, LIBERO-Plus, and RoboCasa365 as embodied testbeds to evaluate both policy learning and world modeling, complemented by real-world policy experiments. Learning the visual consequences of specified actions improves policy performance and generalization across changing scenes. In turn, action learning improves multi-view world-prediction fidelity under the same architecture. Together, these results answer both questions positively, supporting reciprocal benefits between world modeling and action generation under unified causal training.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2610.21095.md,PR 合并后本页自动更新)