← 返回时间线

paper

MintAct: A Unified Visual Agent for Digital Environments

arXiv ↗
ID
2609.22083
分类
—
首次捕获
2026-09-21
状态
unread
作者
Mingfei Gao, Rui Tian, Haiming Gang, Bohan Zhai, Le Zhang, Yuanzheng Gong, Di Feng, Ege Özsoy, Kaixin Ma, Vishwesh Kirthivasan, Oğuzhan Fatih Kar, Roman Bachmann, Anders Boesen Lindbo Larsen, Afshin Dehghan
信号
🔥 13

信号历史

  • 2026-09-21HF Daily Papers · 🔥6
  • 2026-09-22HF Daily Papers · 🔥13
暂无信号数据

摘要

We present MintAct, a family of vision-language models that unifies UI grounding, multi-step navigation across mobile, desktop, and web, and visual tool use, trained at 2B, 4B, and 8B scales. Through careful design of our environments, data, and training recipes, MintAct models match the performance of per-domain specialists across all of these capabilities. To enable this, we develop a scalable environment and reinforcement learning (RL) infrastructure. On the environment side, we host hundreds of concurrent instances across heterogeneous per-domain backends, serving both trajectory data collection and online RL. To enable efficient and scalable RL training, an asynchronous framework keeps explicit control over the cross-domain training distribution and remains stable under noisy environment feedback and off-policy drift. Experimental results show that MintAct achieves state-of-the-art performance (48.9 on OSWorld-Verified) across a wide range of benchmarks at comparable model sizes.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2609.22083.md,PR 合并后本页自动更新)