Cobra: Efficient Line Art COlorization with BRoAder References
The comic production industry requires reference-based line art colorization
with high accuracy, efficiency, contextual consistency, and flexible control. A
comic page often involves diverse characters, objects, and backgrounds, which
complicates the coloring process. Despite advancements in diffusion models for
image generation, their application in line art colorization remains limited,
facing challenges related to handling extensive reference images,
time-consuming inference, and flexible control. We investigate the necessity of
extensive contextual image guidance on the quality of line art colorization. To
address these challenges, we introduce Cobra, an efficient and versatile method
that supports color hints and utilizes over 200 reference images while
maintaining low latency. Central to Cobra is a Causal Sparse DiT architecture,
which leverages specially designed positional encodings, causal sparse
attention, and Key-Value Cache to effectively manage long-context references
and ensure color identity consistency. Results demonstrate that Cobra achieves
accurate line art colorization through extensive contextual reference,
significantly enhancing inference speed and interactivity, thereby meeting
critical industrial demands. We release our codes and models on our project
page: https://zhuang2002.github.io/Cobra/.
680057b49031335df49732fc
Junhao Zhuang
claimed_verified
2025-04-17T08:04:09.222Z
64970d3d9c3b29dca8633f87
/avatars/11e3c9c66d28490d6d09925f9aa47cd1.svg
JunhaoZhuang
user
JunhaoZhuang
680057b49031335df49732fd
Lingen Li
admin_assigned
2025-04-17T08:09:48.492Z
66837d3c48edefb453b0640a
/avatars/b16385eaa612578728e2c6460a76b38f.svg
Lingen Li
user
l-li
680057b49031335df49732fe
Xuan Ju
admin_assigned
2025-04-17T08:09:55.870Z
62d4577bc85b0fcf7fde39bb
/avatars/a3a5729e33ae89ce9ba408830db3c835.svg
Xuan Ju
user
juxuan27
680057b49031335df49732ff
Zhaoyang Zhang
claimed_verified
2025-04-20T15:03:34.890Z
658409ceca19ccf6d9989add
/avatars/3ac1dbd25e52435185babdeb3da28875.svg
Zhaoyang Zhang
user
ZyZcuhk
680057b49031335df4973300
Chun Yuan
680057b49031335df4973301
Ying Shan
admin_assigned
2025-04-17T08:12:47.014Z
63ca3ddc04c979828310bfcb
/avatars/615e0d8622950b4408b40d550f02a894.svg
Ying Shan
user
yshan2u
Cobra: Efficient Line Art COlorization with BRoAder References
The comic production industry requires reference-based line art colorization
with high accuracy, efficiency, contextual consistency, and flexible control. A
comic page often involves diverse characters, objects, and backgrounds, which
complicates the coloring process. Despite advancements in diffusion models for
image generation, their application in line art colorization remains limited,
facing challenges related to handling extensive reference images,
time-consuming inference, and flexible control. We investigate the necessity of
extensive contextual image guidance on the quality of line art colorization. To
address these challenges, we introduce Cobra, an efficient and versatile method
that supports color hints and utilizes over 200 reference images while
maintaining low latency. Central to Cobra is a Causal Sparse DiT architecture,
which leverages specially designed positional encodings, causal sparse
attention, and Key-Value Cache to effectively manage long-context references
and ensure color identity consistency. Results demonstrate that Cobra achieves
accurate line art colorization through extensive contextual reference,
significantly enhancing inference speed and interactivity, thereby meeting
critical industrial demands. We release our codes and models on our project
page: https://zhuang2002.github.io/Cobra/.
Cobra, a method utilizing a Causal Sparse DiT architecture, achieves accurate, efficient, and consistent line art colorization using extensive reference images and color hints.
diffusion models line art colorization reference images Causal Sparse DiT positional encodings causal sparse attention Key-Value Cache color identity consistency