DreamBench++: A Human-Aligned Benchmark for Personalized Image
  Generation
Personalized image generation holds great promise in assisting humans in
everyday work and life due to its impressive function in creatively generating
personalized content. However, current evaluations either are automated but
misalign with humans or require human evaluations that are time-consuming and
expensive. In this work, we present DreamBench++, a human-aligned benchmark
automated by advanced multimodal GPT models. Specifically, we systematically
design the prompts to let GPT be both human-aligned and self-aligned, empowered
with task reinforcement. Further, we construct a comprehensive dataset
comprising diverse images and prompts. By benchmarking 7 modern generative
models, we demonstrate that DreamBench++ results in significantly more
human-aligned evaluation, helping boost the community with innovative findings.
667a2da1d25dfd6fef20d30b
Yuang Peng
claimed_verified
2024-06-25T07:33:16.296Z
631ee086c1a8269da39265c6
https://cdn-avatars.huggingface.co/v1/production/uploads/631ee086c1a8269da39265c6/wUa1epGtTGcUv2mvrLUcD.png
Yuang Peng
user
yuangpeng
667a2da1d25dfd6fef20d30c
Yuxin Cui
claimed_verified
2024-06-26T08:05:06.157Z
655f17215afa950b64de6788
/avatars/a6a5f9769c03579fa686ae5aa1912002.svg
cyx
user
cyxbest
667a2da1d25dfd6fef20d30d
Haomiao Tang
admin_assigned
2024-06-25T07:48:11.274Z
62bafb8668bc5c82747b3cf9
/avatars/21b1dadeaa7ee2ca2be7150c8a8c27c3.svg
Haomiao Tang
user
Me0W
667a2da1d25dfd6fef20d30e
Zekun Qi
admin_assigned
2024-06-25T07:48:19.255Z
63c3e8abc7d7f4c63a515a02
https://cdn-avatars.huggingface.co/v1/production/uploads/63c3e8abc7d7f4c63a515a02/npMHnVP2hHLbvoUGe7C4O.jpeg
Zekun Qi
user
qizekun
667a2da1d25dfd6fef20d30f
Runpei Dong
claimed_verified
2024-06-25T07:33:18.443Z
6201fc5d91d53938a6432fbf
https://cdn-avatars.huggingface.co/v1/production/uploads/6201fc5d91d53938a6432fbf/VLs8ZYaZrop4KBpZn53fH.jpeg
Runpei Dong
user
RunpeiDong
667a2da1d25dfd6fef20d310
Jing Bai
admin_assigned
2024-06-25T07:48:34.002Z
65b291bbda72b2526d05a54c
/avatars/ac873a2bf07349386f88e085f9c16ad7.svg
baijing
user
baijing163
667a2da1d25dfd6fef20d311
Chunrui Han
667a2da1d25dfd6fef20d312
Zheng Ge
667a2da1d25dfd6fef20d313
Xiangyu Zhang
667a2da1d25dfd6fef20d314
Shu-Tao Xia
DreamBench++: A Human-Aligned Benchmark for Personalized Image
  Generation
Personalized image generation holds great promise in assisting humans in
everyday work and life due to its impressive function in creatively generating
personalized content. However, current evaluations either are automated but
misalign with humans or require human evaluations that are time-consuming and
expensive. In this work, we present DreamBench++, a human-aligned benchmark
automated by advanced multimodal GPT models. Specifically, we systematically
design the prompts to let GPT be both human-aligned and self-aligned, empowered
with task reinforcement. Further, we construct a comprehensive dataset
comprising diverse images and prompts. By benchmarking 7 modern generative
models, we demonstrate that DreamBench++ results in significantly more
human-aligned evaluation, helping boost the community with innovative findings.
dreambench++ uses advanced multimodal GPT models to create human-aligned evaluations for generative models in image generation, improving assessment accuracy and efficiency.
GPT models multimodal human-aligned self-aligned task reinforcement comprehensive dataset generative models