← 返回时间线

paper

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory

arXiv ↗
ID
2609.24984
分类
—
首次捕获
2026-09-22
状态
unread
作者
Wangbo Yu, Kunhao Liu, Wenbo Hu, Shenghai Yuan, Chaoran Feng, Haiyang Zhou, Yukun Huang, Yiran Wang, Wang Zhao, Yingmin Luo, Ying Shan
信号
🔥 122

信号历史

  • 2026-09-22HF Daily Papers · 🔥51
  • 2026-09-23HF Daily Papers · 🔥122
暂无信号数据

摘要

Video world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints. We present WorldCrafter, a video world model that learns a camera-queryable implicit 3D-aware memory for this purpose. The key insight is to let the requested viewpoint shape how multi-view evidence is compressed into the video generator's limited token budget. Trained jointly with the video generator, a memory encoder and pose-conditioned readout module integrate historical observations into a fixed set of target view-specific tokens before denoising, without explicit depth-based correspondences. By combining this memory with recent temporal context and few-step distillation, WorldCrafter enables streaming scene exploration from a single input image or text prompt. Experiments across static and dynamic scenes show substantial gains in long-horizon consistency and camera-control accuracy while preserving visual quality during minute-scale exploration.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2609.24984.md,PR 合并后本页自动更新)