← 返回时间线

paper

SpatialBlock: Enhancing Spatial Intelligence in LVLMs via Synthetic Block-Stacking Problem

arXiv ↗
ID
2609.07064
分类
—
首次捕获
2026-09-11
状态
unread
作者
Soohyun Ryu, Sohee Kim, Eunho Yang
信号
🔥 134

信号历史

  • 2026-09-11HF Daily Papers · 🔥32
  • 2026-09-12HF Daily Papers · 🔥78
  • 2026-09-13HF Daily Papers · 🔥112
  • 2026-09-14HF Daily Papers · 🔥134
暂无信号数据

摘要

Large Vision-Language Models (LVLMs) have achieved strong performance on diverse visual tasks, yet their ability to reconstruct and reason about the 3D structure of the scene depicted in 2D images -- referred to as spatial intelligence -- remains limited. Existing approaches attempt to address this gap by using real-scene spatial question answering datasets that require dense geometric annotations. However, constructing such labels is costly, time-consuming, and often noisy due to reliance on external perception modules. In this work, we propose a novel paradigm inspired by human cognitive development: learning foundational spatial skills through structured block-manipulation tasks. We introduce SpatialBlock-15k, a synthetic dataset of 15,000 block-stacking problems covering 3D-to-2D projection, viewpoint transformation, and structural combination. The dataset further incorporates controlled color modulation as visual cues to encourage anchor-based reasoning in visually complex conditions. Experiments demonstrate that LVLMs trained on our dataset through either direct answering or reasoning-based prediction significantly outperform baselines and generalize to real-world spatial tasks, despite the dataset's synthetic and compact nature. Code and data are available at https://github.com/rsoohyun/SpatialBlock.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2609.07064.md,PR 合并后本页自动更新)