LAION-SG: An Enhanced Large-Scale Dataset for Training Complex
  Image-Text Models with Structural Annotations
Recent advances in text-to-image (T2I) generation have shown remarkable
success in producing high-quality images from text. However, existing T2I
models show decayed performance in compositional image generation involving
multiple objects and intricate relationships. We attribute this problem to
limitations in existing datasets of image-text pairs, which lack precise
inter-object relationship annotations with prompts only. To address this
problem, we construct LAION-SG, a large-scale dataset with high-quality
structural annotations of scene graphs (SG), which precisely describe
attributes and relationships of multiple objects, effectively representing the
semantic structure in complex scenes. Based on LAION-SG, we train a new
foundation model SDXL-SG to incorporate structural annotation information into
the generation process. Extensive experiments show advanced models trained on
our LAION-SG boast significant performance improvements in complex scene
generation over models on existing datasets. We also introduce CompSG-Bench, a
benchmark that evaluates models on compositional image generation, establishing
a new standard for this domain.
675a6094ca1f2b4cd6b2bfac
Zejian Li
admin_assigned
2024-12-12T08:28:01.032Z
63a06cebe648d425374f3ea3
/avatars/2e15a761aac16bfdc3da46dd5eef1adf.svg
Zejian Li
user
hyllbd
675a6094ca1f2b4cd6b2bfad
Chenye Meng
admin_assigned
2024-12-12T08:27:39.200Z
66d1fb162e0412fa2aa4ffb0
/avatars/20620dd03d388f0262124f0c3523080d.svg
Chenye Meng
user
mengcy
675a6094ca1f2b4cd6b2bfae
Yize Li
admin_assigned
2024-12-12T08:28:06.791Z
6552d3f69fa2f7205a1f94a2
/avatars/8b857fe89586b25b54864da91ce1b35a.svg
Yize Li
user
yeezlee
675a6094ca1f2b4cd6b2bfaf
Ling Yang
claimed_verified
2025-02-11T15:34:08.086Z
64fde4e252e82dd432b74ce9
https://cdn-avatars.huggingface.co/v1/production/uploads/64fde4e252e82dd432b74ce9/-CQZbBP7FsPPyawYrsi4z.jpeg
Ling Yang
user
Lingaaaaaaa
675a6094ca1f2b4cd6b2bfb0
Shengyuan Zhang
admin_assigned
2024-12-12T08:27:07.929Z
63943c882b9483beb473ec25
/avatars/abd2aae43e68c34770159c15a01c8297.svg
Shengyuan Zhang
user
SYZhang0805
675a6094ca1f2b4cd6b2bfb1
Jiarui Ma
admin_assigned
2024-12-12T08:28:15.616Z
6618ae26a7f8bb5a98ce4164
/avatars/5656997d49be6fd0f3fd793136098806.svg
JIARUI MA
user
MAJIARUI
675a6094ca1f2b4cd6b2bfb2
Jiayi Li
675a6094ca1f2b4cd6b2bfb3
Guang Yang
675a6094ca1f2b4cd6b2bfb4
Changyuan Yang
675a6094ca1f2b4cd6b2bfb5
Zhiyuan Yang
675a6094ca1f2b4cd6b2bfb6
Jinxiong Chang
675a6094ca1f2b4cd6b2bfb7
Lingyun Sun
admin_assigned
2024-12-12T08:25:33.476Z
662a5c0649e03000ed1adab4
/avatars/961e4b9bf923923fcd871672d156f50c.svg
Lingyun Sun
user
slysun
LAION-SG: An Enhanced Large-Scale Dataset for Training Complex
  Image-Text Models with Structural Annotations
Recent advances in text-to-image (T2I) generation have shown remarkable
success in producing high-quality images from text. However, existing T2I
models show decayed performance in compositional image generation involving
multiple objects and intricate relationships. We attribute this problem to
limitations in existing datasets of image-text pairs, which lack precise
inter-object relationship annotations with prompts only. To address this
problem, we construct LAION-SG, a large-scale dataset with high-quality
structural annotations of scene graphs (SG), which precisely describe
attributes and relationships of multiple objects, effectively representing the
semantic structure in complex scenes. Based on LAION-SG, we train a new
foundation model SDXL-SG to incorporate structural annotation information into
the generation process. Extensive experiments show advanced models trained on
our LAION-SG boast significant performance improvements in complex scene
generation over models on existing datasets. We also introduce CompSG-Bench, a
benchmark that evaluates models on compositional image generation, establishing
a new standard for this domain.
A new dataset with structural scene graph annotations improves text-to-image generation performance on complex scenes, benchmarked by CompSG-Bench.
text-to-image (T2I) compositional image generation LAION-SG scene graphs (SG) SDXL-SG CompSG-Bench