xbench: Tracking Agents Productivity Scaling with Profession-Aligned
  Real-World Evaluations
We introduce xbench, a dynamic, profession-aligned evaluation suite designed
to bridge the gap between AI agent capabilities and real-world productivity.
While existing benchmarks often focus on isolated technical skills, they may
not accurately reflect the economic value agents deliver in professional
settings. To address this, xbench targets commercially significant domains with
evaluation tasks defined by industry professionals. Our framework creates
metrics that strongly correlate with productivity value, enables prediction of
Technology-Market Fit (TMF), and facilitates tracking of product capabilities
over time. As our initial implementations, we present two benchmarks:
Recruitment and Marketing. For Recruitment, we collect 50 tasks from real-world
headhunting business scenarios to evaluate agents' abilities in company
mapping, information retrieval, and talent sourcing. For Marketing, we assess
agents' ability to match influencers with advertiser needs, evaluating their
performance across 50 advertiser requirements using a curated pool of 836
candidate influencers. We present initial evaluation results for leading
contemporary agents, establishing a baseline for these professional domains.
Our continuously updated evalsets and evaluations are available at
https://xbench.org.
6850cf555e07650ecce88fe2
Kaiyuan Chen
claimed_verified
2025-06-19T15:11:31.642Z
636b4d796e6981ebad73f398
/avatars/bcd405b98c12afaf1e32d85ad8ce7f23.svg
Kaiyuan Chen
user
Lucky2022
6850cf555e07650ecce88fe3
Yixin Ren
6850cf555e07650ecce88fe4
Yang Liu
6850cf555e07650ecce88fe5
Xiaobo Hu
6850cf555e07650ecce88fe6
Haotong Tian
6850cf555e07650ecce88fe7
Tianbao Xie
claimed_verified
2025-08-14T13:41:06.512Z
618767e4238063b4615d042b
https://cdn-avatars.huggingface.co/v1/production/uploads/1636263880877-noauth.jpeg
Tianbao Xie
user
tianbaoxiexxx
6850cf555e07650ecce88fe8
Fangfu Liu
claimed_verified
2025-06-18T12:16:52.421Z
6505a02f9310ce8c400edc63
/avatars/bbf781594fc8c812316711aa8e2797aa.svg
Fangfu Liu
user
Liuff23
6850cf555e07650ecce88fe9
Haoye Zhang
6850cf555e07650ecce88fea
Hongzhang Liu
claimed_verified
2025-07-29T07:11:02.332Z
6632160088f75d987d1a156f
https://cdn-avatars.huggingface.co/v1/production/uploads/6632160088f75d987d1a156f/mYlMQfK1BGWeEbOSMmeSb.jpeg
Hongzhang Liu
user
Alphamasterliu
6850cf555e07650ecce88feb
Yuan Gong
6850cf555e07650ecce88fec
Chen Sun
6850cf555e07650ecce88fed
Han Hou
6850cf555e07650ecce88fee
Hui Yang
6850cf555e07650ecce88fef
James Pan
6850cf555e07650ecce88ff0
Jianan Lou
6850cf555e07650ecce88ff1
Jiayi Mao
6850cf555e07650ecce88ff2
Jizheng Liu
6850cf555e07650ecce88ff3
Jinpeng Li
6850cf555e07650ecce88ff4
Kangyi Liu
6850cf555e07650ecce88ff5
Kenkun Liu
6850cf555e07650ecce88ff6
Rui Wang
6850cf555e07650ecce88ff7
Run Li
6850cf555e07650ecce88ff8
Tong Niu
6850cf555e07650ecce88ff9
Wenlong Zhang
6850cf555e07650ecce88ffa
Wenqi Yan
6850cf555e07650ecce88ffb
Xuanzheng Wang
6850cf555e07650ecce88ffc
Yuchen Zhang
6850cf555e07650ecce88ffd
Yi-Hsin Hung
6850cf555e07650ecce88ffe
Yuan Jiang
6850cf555e07650ecce88fff
Zexuan Liu
6850cf555e07650ecce89000
Zihan Yin
6850cf555e07650ecce89001
Zijian Ma
6850cf555e07650ecce89002
Zhiwen Mo
xbench: Tracking Agents Productivity Scaling with Profession-Aligned
  Real-World Evaluations
We introduce xbench, a dynamic, profession-aligned evaluation suite designed
to bridge the gap between AI agent capabilities and real-world productivity.
While existing benchmarks often focus on isolated technical skills, they may
not accurately reflect the economic value agents deliver in professional
settings. To address this, xbench targets commercially significant domains with
evaluation tasks defined by industry professionals. Our framework creates
metrics that strongly correlate with productivity value, enables prediction of
Technology-Market Fit (TMF), and facilitates tracking of product capabilities
over time. As our initial implementations, we present two benchmarks:
Recruitment and Marketing. For Recruitment, we collect 50 tasks from real-world
headhunting business scenarios to evaluate agents' abilities in company
mapping, information retrieval, and talent sourcing. For Marketing, we assess
agents' ability to match influencers with advertiser needs, evaluating their
performance across 50 advertiser requirements using a curated pool of 836
candidate influencers. We present initial evaluation results for leading
contemporary agents, establishing a baseline for these professional domains.
Our continuously updated evalsets and evaluations are available at
https://xbench.org.