← 返回时间线

paper

Scaling Online Optimal Transport Minibatches for Flow Matching

arXiv ↗
ID
2610.18838
分类
—
首次捕获
2026-10-15
状态
unread
作者
Peter Chen, Sergey Levine
信号
🔥 1

信号历史

  • 2026-10-15HF Daily Papers · 🔥1
暂无信号数据

摘要

A central challenge in scaling flow models is maintaining stability in training and integration. In flow matching, this stability depends critically on how source samples are paired with data. Independent random pairing introduces substantial stochasticity, motivating minibatch optimal transport (OT) to construct online source-target couplings that reduce this randomness (Tong et al., 2024). However, as applications extend to larger and higher-dimensional datasets, small minibatches can limit these benefits, while scaling the coupling to substantially larger minibatches at every iteration is computationally prohibitive. Moreover, how OT coupling affects the full stochastic gradient and integration remains theoretically unresolved. In this work, we develop a scalable online entropic OT approximation that enables substantially larger source-target couplings while preserving the benefits of OT. We close the theoretical gap for both unregularized and entropic OT by proving strict reductions in full stochastic-gradient variance and integration error relative to independent pairing, and further characterize how these improvements strengthen as the online coupling minibatch grows. Experiments on single-cell gene interpolation-flow and image-flow training validate these predictions, showing that larger online couplings consistently improve training stability and final generation performance.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2610.18838.md,PR 合并后本页自动更新)