← 返回时间线

paper

SheetSage2: Coherent Lead-Sheet Transcription with Synthetic Supervision

arXiv ↗
ID
2610.05336
分类
—
首次捕获
2026-10-08
状态
unread
作者
Junyan Jiang, Ruibin Yuan, Jiahao Pan, Wei Xue, Yike Guo, Gus Xia, Yann LeCun
信号
🔥 1

信号历史

  • 2026-10-08HF Daily Papers · 🔥1
暂无信号数据

摘要

Transcribing music into a human-readable score requires a coherent understanding of rhythm, harmony, melody, and form. Two obstacles limit this goal: annotated recordings are scarce, and accurate local predictions can still produce inconsistent musical sequences. We present SheetSage2, a unified music transcription framework that combines synthetic data, task-specific structured decoding, and autoregressive distillation. Automatically annotated MIDI, rendered into audio, provides scalable supervision across music understanding tasks. Task-specific structured decoders integrate complementary musical cues and their temporal dependencies to produce musically coherent scores. Autoregressive distillation further retains transcription accuracy without task-specific dynamic programming at inference. Across eight benchmark collections, a single SheetSage2-AR model exceeds the listed prior systems on 12 of 15 benchmark--metric pairs in our evaluation, substantially improving over SheetSage1 and surpassing task-specific models on several benchmarks. Model weights and inference code are publicly available.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2610.05336.md,PR 合并后本页自动更新)