Towards Personalized Deep Research: Benchmarks and Evaluations
Deep Research Agents (DRAs) can autonomously conduct complex investigations
and generate comprehensive reports, demonstrating strong real-world potential.
However, existing evaluations mostly rely on close-ended benchmarks, while
open-ended deep research benchmarks remain scarce and typically neglect
personalized scenarios. To bridge this gap, we introduce Personalized Deep
Research Bench, the first benchmark for evaluating personalization in DRAs. It
pairs 50 diverse research tasks across 10 domains with 25 authentic user
profiles that combine structured persona attributes with dynamic real-world
contexts, yielding 250 realistic user-task queries. To assess system
performance, we propose the PQR Evaluation Framework, which jointly measures
(P) Personalization Alignment, (Q) Content Quality, and (R) Factual
Reliability. Our experiments on a range of systems highlight current
capabilities and limitations in handling personalized deep research. This work
establishes a rigorous foundation for developing and evaluating the next
generation of truly personalized AI research assistants.
68db7847d2bf1f4b15ec7720
Yuan Liang
68db7847d2bf1f4b15ec7721
Jiaxian Li
68db7847d2bf1f4b15ec7722
Yuqing Wang
claimed_verified
2025-09-30T07:12:30.169Z
68528ed95eb3deddd065648a
/avatars/e55960126fa7a2ceb43dd0f2bc8190cb.svg
wang
user
yuqing666
68db7847d2bf1f4b15ec7723
Piaohong Wang
68db7847d2bf1f4b15ec7724
Motong Tian
68db7847d2bf1f4b15ec7725
Pai Liu
68db7847d2bf1f4b15ec7726
Shuofei Qiao
68db7847d2bf1f4b15ec7727
Runnan Fang
68db7847d2bf1f4b15ec7728
He Zhu
68db7847d2bf1f4b15ec7729
Ge Zhang
68db7847d2bf1f4b15ec772a
Minghao Liu
claimed_verified
2025-10-24T16:15:11.031Z
6417d9ea8f689506e7148417
https://cdn-avatars.huggingface.co/v1/production/uploads/6417d9ea8f689506e7148417/bAYcruWNw4WvmuQcGgcwC.jpeg
minghao
user
Liam-Liu
68db7847d2bf1f4b15ec772b
Yuchen Eleanor Jiang
68db7847d2bf1f4b15ec772c
Ningyu Zhang
claimed_verified
2025-09-30T06:36:05.963Z
620b3bbb0668e435407c8d0a
/avatars/e0fccbb2577d76088e09f054c35cffbc.svg
Ningyu Zhang
user
Ningyu
68db7847d2bf1f4b15ec772d
Wangchunshu Zhou
Towards Personalized Deep Research: Benchmarks and Evaluations
Deep Research Agents (DRAs) can autonomously conduct complex investigations
and generate comprehensive reports, demonstrating strong real-world potential.
However, existing evaluations mostly rely on close-ended benchmarks, while
open-ended deep research benchmarks remain scarce and typically neglect
personalized scenarios. To bridge this gap, we introduce Personalized Deep
Research Bench, the first benchmark for evaluating personalization in DRAs. It
pairs 50 diverse research tasks across 10 domains with 25 authentic user
profiles that combine structured persona attributes with dynamic real-world
contexts, yielding 250 realistic user-task queries. To assess system
performance, we propose the PQR Evaluation Framework, which jointly measures
(P) Personalization Alignment, (Q) Content Quality, and (R) Factual
Reliability. Our experiments on a range of systems highlight current
capabilities and limitations in handling personalized deep research. This work
establishes a rigorous foundation for developing and evaluating the next
generation of truly personalized AI research assistants.
A new benchmark, Personalized Deep Research Bench, evaluates the personalization capabilities of Deep Research Agents across diverse tasks and user profiles using the PQR Evaluation Framework.
Deep Research Agents Personalized Deep Research Bench PQR Evaluation Framework Personalization Alignment Content Quality Factual Reliability