← 返回时间线

paper

Multi-Agent Egocentric World Model with Fine-Grained Embodied Interaction

arXiv ↗
ID
2610.12299
分类
—
首次捕获
2026-10-09
状态
unread
作者
Dahyun Chung, Siyoon Jin, Hyunwook Choi, Honggyu An, Junyoung Seo, Hyunsung Kim, Seung Wook Kim, Seungryong Kim
信号
🔥 52

信号历史

  • 2026-10-09HF Daily Papers · 🔥36
  • 2026-10-10HF Daily Papers · 🔥46
  • 2026-10-11HF Daily Papers · 🔥52
暂无信号数据

摘要

Egocentric world models predict first-person observations conditioned on an agent's actions, but most focus on a single agent. Real embodied settings often involve multiple agents that act and interact within a shared environment. Existing multi-agent world models rely on coarse actions like locomotion, camera control, or discrete commands, leaving fine-grained embodied interactions underexplored. We formulate multi-agent egocentric world modeling as synchronized ego-stream generation for multiple agents interacting through fine-grained actions in a shared world. This requires cross-view action consistency, shared-environment consistency, and consistent propagation of interaction-induced state updates. We propose Multi-agent Egocentric World Model (ME-World), which jointly denoises multiple ego streams in a shared token sequence, conditions each stream on all agents' target-view poses, and grounds generation with shared environment memory. We train and evaluate on real and synthetic multi-agent data and introduce shared-world consistency metrics for environment, update, and identity consistency. Experiments show ME-World improves shared-world consistency, action control, identity preservation, and video quality over existing methods.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2610.12299.md,PR 合并后本页自动更新)