← 返回时间线

paper

From Tapping to Hopping: Augmenting Mobile GUI Agents with App-Native Deeplinks

arXiv ↗
ID
2609.30887
分类
—
首次捕获
2026-09-28
状态
unread
作者
Yuchen Sun, Chenglin Cai, Gongjie Zhang, Tianyu Xia, Quyu Kong, Panrong Tong, Zhengwen Zeng, Long Chen, Steven Hoi, Chongyang Zhang, Yue Wang
信号
SI 54

信号历史

  • 2026-09-28Scholar Inbox · 相关分 54
暂无信号数据

摘要

Mobile GUI agents complete tasks using GUI actions like taps and swipes. These actions are broadly applicable across applications, but reaching a navigation interface. A single deeplink call can replace a sequence of screen-by-screen GUI actions. We therefore introduce hybrid interaction, using deeplinks for direct navigation and GUI actions for other on-screen operations and fallback. To enable this, we discover candidate deeplinks through static analysis, validate them on real devices, and describe their observed landing screens. This process creates a verified and grounded deeplink catalog that pairs each working deeplink with a description of its landing screen. Using this catalog, we introduce GUI-Hopper, a improves task success in commercial applications on real devices, further demonstrating the benefits of hybrid interaction.

我的笔记

还没有笔记。

在 GitHub 上写笔记 ↗(新建 content/notes/2609.30887.md,PR 合并后本页自动更新)