ViStoryBench: Comprehensive Benchmark Suite for Story Visualization
Story visualization, which aims to generate a sequence of visually coherent
images aligning with a given narrative and reference images, has seen
significant progress with recent advancements in generative models. To further
enhance the performance of story visualization frameworks in real-world
scenarios, we introduce a comprehensive evaluation benchmark, ViStoryBench. We
collect a diverse dataset encompassing various story types and artistic styles,
ensuring models are evaluated across multiple dimensions such as different
plots (e.g., comedy, horror) and visual aesthetics (e.g., anime, 3D
renderings). ViStoryBench is carefully curated to balance narrative structures
and visual elements, featuring stories with single and multiple protagonists to
test models' ability to maintain character consistency. Additionally, it
includes complex plots and intricate world-building to challenge models in
generating accurate visuals. To ensure comprehensive comparisons, our benchmark
incorporates a wide range of evaluation metrics assessing critical aspects.
This structured and multifaceted framework enables researchers to thoroughly
identify both the strengths and weaknesses of different models, fostering
targeted improvements.
683d54f364b44c0ccabb9e65
Cailin Zhuang
683d54f364b44c0ccabb9e66
Ailin Huang
683d54f364b44c0ccabb9e67
Wei Cheng
claimed_verified
2025-06-02T07:40:49.393Z
64b914c8ace99c0723ad83a9
https://cdn-avatars.huggingface.co/v1/production/uploads/64b914c8ace99c0723ad83a9/B4gxNByeVY_xaOcjwiN1j.jpeg
Wei Cheng
user
wchengad
683d54f364b44c0ccabb9e68
Jingwei Wu
683d54f364b44c0ccabb9e69
Yaoqi Hu
683d54f364b44c0ccabb9e6a
Jiaqi Liao
683d54f364b44c0ccabb9e6b
Zhewei Huang
claimed_verified
2025-07-16T08:16:16.535Z
63ae768220176b2d216ac807
/avatars/d658b98f469bd12f5bc3bb9c12811780.svg
Zhewei Huang
user
hzwer
683d54f364b44c0ccabb9e6c
Hongyuan Wang
683d54f364b44c0ccabb9e6d
Xinyao Liao
683d54f364b44c0ccabb9e6e
Weiwei Cai
683d54f364b44c0ccabb9e6f
Hengyuan Xu
683d54f364b44c0ccabb9e70
Xuanyang Zhang
683d54f364b44c0ccabb9e71
Xianfang Zeng
683d54f364b44c0ccabb9e72
Gang Yu
claimed_verified
2025-06-04T09:03:17.238Z
63417332c5565a4b8d43a0d8
https://cdn-avatars.huggingface.co/v1/production/uploads/63417332c5565a4b8d43a0d8/MmnYG7Wu2Z_lqCBvTfJmy.png
Gang Yu
user
skicy
683d54f364b44c0ccabb9e73
Chi Zhang
ViStoryBench: Comprehensive Benchmark Suite for Story Visualization
Story visualization, which aims to generate a sequence of visually coherent
images aligning with a given narrative and reference images, has seen
significant progress with recent advancements in generative models. To further
enhance the performance of story visualization frameworks in real-world
scenarios, we introduce a comprehensive evaluation benchmark, ViStoryBench. We
collect a diverse dataset encompassing various story types and artistic styles,
ensuring models are evaluated across multiple dimensions such as different
plots (e.g., comedy, horror) and visual aesthetics (e.g., anime, 3D
renderings). ViStoryBench is carefully curated to balance narrative structures
and visual elements, featuring stories with single and multiple protagonists to
test models' ability to maintain character consistency. Additionally, it
includes complex plots and intricate world-building to challenge models in
generating accurate visuals. To ensure comprehensive comparisons, our benchmark
incorporates a wide range of evaluation metrics assessing critical aspects.
This structured and multifaceted framework enables researchers to thoroughly
identify both the strengths and weaknesses of different models, fostering
targeted improvements.
ViStoryBench is a comprehensive evaluation benchmark for story visualization frameworks, featuring diverse datasets and metrics to assess model performance across narrative and visual dimensions.
generative models story visualization evaluation benchmark diverse dataset plots visual aesthetics narrative structures visual elements character consistency complex plots world-building evaluation metrics