ART: Anonymous Region Transformer for Variable Multi-Layer Transparent
  Image Generation
Multi-layer image generation is a fundamental task that enables users to
isolate, select, and edit specific image layers, thereby revolutionizing
interactions with generative models. In this paper, we introduce the Anonymous
Region Transformer (ART), which facilitates the direct generation of variable
multi-layer transparent images based on a global text prompt and an anonymous
region layout. Inspired by Schema theory suggests that knowledge is organized
in frameworks (schemas) that enable people to interpret and learn from new
information by linking it to prior knowledge.}, this anonymous region layout
allows the generative model to autonomously determine which set of visual
tokens should align with which text tokens, which is in contrast to the
previously dominant semantic layout for the image generation task. In addition,
the layer-wise region crop mechanism, which only selects the visual tokens
belonging to each anonymous region, significantly reduces attention computation
costs and enables the efficient generation of images with numerous distinct
layers (e.g., 50+). When compared to the full attention approach, our method is
over 12 times faster and exhibits fewer layer conflicts. Furthermore, we
propose a high-quality multi-layer transparent image autoencoder that supports
the direct encoding and decoding of the transparency of variable multi-layer
images in a joint manner. By enabling precise control and scalable layer
generation, ART establishes a new paradigm for interactive content creation.
67be81414084d82ee69ad4a2
Yifan Pu
admin_assigned
2025-02-26T08:58:24.942Z
647e83257f9ad5e44babe82a
/avatars/2d9593775c49856fe5dfa5bd23dfcda7.svg
yifan pu
user
yifanpu001
67be81414084d82ee69ad4a3
Yiming Zhao
claimed_verified
2025-02-27T09:17:43.946Z
637a2be47ce76c3b8347aae2
https://cdn-avatars.huggingface.co/v1/production/uploads/637a2be47ce76c3b8347aae2/rQdt1j35MA2OXJnkGQfHJ.jpeg
Yiming Zhao
user
ZYMPKU
67be81414084d82ee69ad4a4
Zhicong Tang
67be81414084d82ee69ad4a5
Ruihong Yin
67be81414084d82ee69ad4a6
Haoxing Ye
admin_assigned
2025-02-26T08:58:52.821Z
65229f2f6b01183a67e86370
/avatars/b218207fce28497b30e22c807d44b2d2.svg
Haoxing Ye
user
131131yhx
67be81414084d82ee69ad4a7
Yuhui Yuan
claimed_verified
2025-03-28T08:38:28.668Z
631f108bb45367a05fe74260
/avatars/c20da6800b643728062712d9a2771648.svg
Researcher
user
YuanYuhui
67be81414084d82ee69ad4a8
Dong Chen
admin_assigned
2025-02-26T08:59:16.526Z
666470a28f5513b0cf11e850
/avatars/7beea758882677ad32a12ce56d4d084a.svg
Dong Chen
user
DongChen06
67be81414084d82ee69ad4a9
Jianmin Bao
admin_assigned
2025-02-26T08:59:22.654Z
646b2f4bb1202bc77c0fb396
/avatars/6b09dec5d5affe817ad6acda60f61740.svg
Jianmin_bao
user
JianminBao
67be81414084d82ee69ad4aa
Sirui Zhang
admin_assigned
2025-02-26T08:59:30.766Z
64f7f119a92703ef65d9a717
/avatars/118524faab66cecba6d4da622034b44b.svg
Sirui Zhang
user
zsr200901
67be81414084d82ee69ad4ab
Yanbin Wang
admin_assigned
2025-02-26T08:59:38.138Z
67965a5a9f57883759a6efc3
/avatars/9138a879fbe1f60c2f4720810bfdfda6.svg
Yanbin Wang
user
yanbinwang
67be81414084d82ee69ad4ac
Lin Liang
67be81414084d82ee69ad4ad
Lijuan Wang
admin_assigned
2025-02-26T09:00:05.520Z
6672e20d1dbdf7da8310dd92
/avatars/5d2fb23f92a7f9ff025a5be17a26de4d.svg
lijuanwang
user
lijuanwang228
67be81414084d82ee69ad4ae
Ji Li
67be81414084d82ee69ad4af
Xiu Li
67be81414084d82ee69ad4b0
Zhouhui Lian
admin_assigned
2025-02-26T08:59:57.943Z
64c882f7527d7636555bbb2c
/avatars/578a118a945dd6fa62fd3be9d6e4e986.svg
Zhouhui Lian
user
lianzhouhui
67be81414084d82ee69ad4b1
Gao Huang
67be81414084d82ee69ad4b2
Baining Guo
ART: Anonymous Region Transformer for Variable Multi-Layer Transparent
  Image Generation
Multi-layer image generation is a fundamental task that enables users to
isolate, select, and edit specific image layers, thereby revolutionizing
interactions with generative models. In this paper, we introduce the Anonymous
Region Transformer (ART), which facilitates the direct generation of variable
multi-layer transparent images based on a global text prompt and an anonymous
region layout. Inspired by Schema theory suggests that knowledge is organized
in frameworks (schemas) that enable people to interpret and learn from new
information by linking it to prior knowledge.}, this anonymous region layout
allows the generative model to autonomously determine which set of visual
tokens should align with which text tokens, which is in contrast to the
previously dominant semantic layout for the image generation task. In addition,
the layer-wise region crop mechanism, which only selects the visual tokens
belonging to each anonymous region, significantly reduces attention computation
costs and enables the efficient generation of images with numerous distinct
layers (e.g., 50+). When compared to the full attention approach, our method is
over 12 times faster and exhibits fewer layer conflicts. Furthermore, we
propose a high-quality multi-layer transparent image autoencoder that supports
the direct encoding and decoding of the transparency of variable multi-layer
images in a joint manner. By enabling precise control and scalable layer
generation, ART establishes a new paradigm for interactive content creation.
The Anonymous Region Transformer (ART) enables efficient generation of multi-layer transparent images using text prompts and anonymous region layouts, outperforming full attention methods in speed and layer conflict reduction.
Anonymous Region Transformer (ART) schema theory anonymous region layout visual tokens text tokens layer-wise region crop mechanism attention computation multi-layer transparent image autoencoder