VeriGUI: Verifiable Long-Chain GUI Dataset
Recent studies have delved into constructing autonomous agents capable of
performing complex Graphical User Interface (GUI)-based computer tasks, with
the potential to revolutionize human-computer interaction. Despite encouraging
results, existing efforts mainly focus on short-term interactions and rely on
outcome-only verification, thereby limiting their scalability in real-world GUI
applications that demand long-horizon task decomposition and execution. In this
work, we introduce VeriGUI, a novel verifiable long-chain GUI dataset designed
to facilitate the development and evaluation of generalist GUI agents operating
in realistic computer environments. Our dataset emphasizes two critical
dimensions: (1) long-chain complexity, with tasks decomposed into a sequence of
interdependent subtasks spanning hundreds of steps, explicitly designed to
allow any subtask to serve as a valid starting point; and (2) subtask-level
verifiability, which enables diverse exploration strategies within each
subtask, while ensuring that each subtask-level goal remains verifiable and
consistent. The dataset consists of GUI task trajectories across both desktop
and web, annotated by human experts. Extensive experiments on VeriGUI using
various agents with different foundation models reveal significant performance
gaps in handling long-horizon tasks, highlighting the need for more robust
planning and decision-making capabilities in GUI agents.
68941e5d741a16f544fbceed
Shunyu Liu
claimed_verified
2025-08-08T16:22:03.238Z
6713afea187a20dc579e121b
https://cdn-avatars.huggingface.co/v1/production/uploads/6713afea187a20dc579e121b/ELxVQLVF9ifuT-TCWPK22.jpeg
Shunyu Liu
user
liushunyu
68941e5d741a16f544fbceee
Minghao Liu
claimed_verified
2025-08-07T10:38:35.426Z
6417d9ea8f689506e7148417
https://cdn-avatars.huggingface.co/v1/production/uploads/6417d9ea8f689506e7148417/bAYcruWNw4WvmuQcGgcwC.jpeg
minghao
user
Liam-Liu
68941e5d741a16f544fbceef
Huichi Zhou
claimed_verified
2025-08-25T08:28:43.134Z
645d7f107c7258d904e82749
/avatars/a4e9d47b281f18616c522c1a8b8ee7e5.svg
HuichiZhou
user
Zhouhc
68941e5d741a16f544fbcef0
Zhenyu Cui
68941e5d741a16f544fbcef1
Yang Zhou
claimed_verified
2025-08-21T09:16:33.768Z
670ff71f6b8de497472a81dc
https://cdn-avatars.huggingface.co/v1/production/uploads/670ff71f6b8de497472a81dc/R2ydPAk6GU5Sk81Qja7E_.jpeg
YANG ZHOU
user
BAOLONGZHANSHEN
68941e5d741a16f544fbcef2
Yuhao Zhou
68941e5d741a16f544fbcef3
Wendong Fan
68941e5d741a16f544fbcef4
Ge Zhang
claimed_verified
2025-08-13T07:28:09.300Z
638efcf4c67af472d316d424
/avatars/97a57859d7d87a3a8f1bb41d32a72bc2.svg
Ge Zhang
user
zhangysk
68941e5d741a16f544fbcef5
Jiajun Shi
68941e5d741a16f544fbcef6
Weihao Xuan
claimed_verified
2025-08-07T10:38:31.782Z
65b8909c89eb3dfbe8d26780
https://cdn-avatars.huggingface.co/v1/production/uploads/65b8909c89eb3dfbe8d26780/aJExXsCN9oQOdd9bsQOEO.jpeg
Weihao XUAN
user
weihao1115
68941e5d741a16f544fbcef7
Jiaxing Huang
68941e5d741a16f544fbcef8
Shuang Luo
68941e5d741a16f544fbcef9
Fang Wu
68941e5d741a16f544fbcefa
Heli Qi
68941e5d741a16f544fbcefb
Qingcheng Zeng
68941e5d741a16f544fbcefc
Ziqi Ren
68941e5d741a16f544fbcefd
Jialiang Gao
68941e5d741a16f544fbcefe
Jindi Lv
68941e5d741a16f544fbceff
Junjie Wang
claimed_verified
2025-08-08T16:21:59.700Z
62579c55b98dcaa7e0de285d
https://cdn-avatars.huggingface.co/v1/production/uploads/62579c55b98dcaa7e0de285d/0YUd5nloul_bW9yolDGGo.jpeg
wangjunjie
user
wanng
68941e5d741a16f544fbcf00
Aosong Feng
68941e5d741a16f544fbcf01
Heng Zhou
claimed_verified
2025-08-18T06:59:45.068Z
660d17d6c9be0dcd31a30b3d
/avatars/3743fe9b695c488ebe33f0d8fd607a8a.svg
Zhou Heng
user
henggg
68941e5d741a16f544fbcf02
Wangchunshu Zhou
68941e5d741a16f544fbcf03
Zhenfei Yin
claimed_verified
2025-09-03T08:30:17.091Z
64e314ad24809d7fa0f20fbc
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/bHE0w_hjDFvU-Aul0_E7g.jpeg
Zhenfei Yin
user
JeremyYin
68941e5d741a16f544fbcf04
Wenlong Zhang
68941e5d741a16f544fbcf05
Guohao Li
claimed_verified
2025-09-06T10:57:33.191Z
6338790e76421c054310c96b
/avatars/112e3d88d155bc998a89fef6f33af64d.svg
Guohao Li
user
lightaime
68941e5d741a16f544fbcf06
Wenhao Yu
68941e5d741a16f544fbcf07
Irene Li
68941e5d741a16f544fbcf08
Lei Ma
68941e5d741a16f544fbcf09
Lei Bai
68941e5d741a16f544fbcf0a
Qunshu Lin
68941e5d741a16f544fbcf0b
Mingli Song
68941e5d741a16f544fbcf0c
Dacheng Tao
VeriGUI: Verifiable Long-Chain GUI Dataset
Recent studies have delved into constructing autonomous agents capable of
performing complex Graphical User Interface (GUI)-based computer tasks, with
the potential to revolutionize human-computer interaction. Despite encouraging
results, existing efforts mainly focus on short-term interactions and rely on
outcome-only verification, thereby limiting their scalability in real-world GUI
applications that demand long-horizon task decomposition and execution. In this
work, we introduce VeriGUI, a novel verifiable long-chain GUI dataset designed
to facilitate the development and evaluation of generalist GUI agents operating
in realistic computer environments. Our dataset emphasizes two critical
dimensions: (1) long-chain complexity, with tasks decomposed into a sequence of
interdependent subtasks spanning hundreds of steps, explicitly designed to
allow any subtask to serve as a valid starting point; and (2) subtask-level
verifiability, which enables diverse exploration strategies within each
subtask, while ensuring that each subtask-level goal remains verifiable and
consistent. The dataset consists of GUI task trajectories across both desktop
and web, annotated by human experts. Extensive experiments on VeriGUI using
various agents with different foundation models reveal significant performance
gaps in handling long-horizon tasks, highlighting the need for more robust
planning and decision-making capabilities in GUI agents.
VeriGUI is a novel dataset for evaluating GUI agents in long-horizon tasks, emphasizing long-chain complexity and subtask-level verifiability.
Graphical User Interface (GUI) GUI agents long-chain complexity subtask-level verifiability GUI task trajectories desktop web human experts long-horizon tasks robust planning decision-making capabilities