Training-free Diffusion Acceleration with Bottleneck Sampling
Diffusion models have demonstrated remarkable capabilities in visual content
generation but remain challenging to deploy due to their high computational
cost during inference. This computational burden primarily arises from the
quadratic complexity of self-attention with respect to image or video
resolution. While existing acceleration methods often compromise output quality
or necessitate costly retraining, we observe that most diffusion models are
pre-trained at lower resolutions, presenting an opportunity to exploit these
low-resolution priors for more efficient inference without degrading
performance. In this work, we introduce Bottleneck Sampling, a training-free
framework that leverages low-resolution priors to reduce computational overhead
while preserving output fidelity. Bottleneck Sampling follows a high-low-high
denoising workflow: it performs high-resolution denoising in the initial and
final stages while operating at lower resolutions in intermediate steps. To
mitigate aliasing and blurring artifacts, we further refine the resolution
transition points and adaptively shift the denoising timesteps at each stage.
We evaluate Bottleneck Sampling on both image and video generation tasks, where
extensive experiments demonstrate that it accelerates inference by up to
3times for image generation and 2.5times for video generation, all while
maintaining output quality comparable to the standard full-resolution sampling
process across multiple evaluation metrics. Code is available at:
https://github.com/tyfeld/Bottleneck-Sampling
67e21b305d20ec3277dac34a
Ye Tian
claimed_verified
2025-03-25T08:20:24.659Z
64e357dd825f4133e7427bf8
https://cdn-avatars.huggingface.co/v1/production/uploads/64e357dd825f4133e7427bf8/HwaWhINrzkbXG6SHG2oyf.jpeg
tyfeld
user
tyfeld
67e21b305d20ec3277dac34b
Xin Xia
claimed_verified
2025-03-26T20:49:20.461Z
63089a78ff78e2aead8d10e7
/avatars/f326fd08abee7e31599a78923be30003.svg
XinXia
user
XiaXin-Aloys
67e21b305d20ec3277dac34c
Yuxi Ren
admin_assigned
2025-03-25T09:19:25.116Z
6618d5e83b412cdc85334ca8
/avatars/5fe356d58c4c822a60370dbee8d78a69.svg
renyuxi
user
renyuxi
67e21b305d20ec3277dac34d
Shanchuan Lin
claimed_verified
2025-06-11T16:02:52.029Z
645863f7dc18eb1a9b5d29df
https://cdn-avatars.huggingface.co/v1/production/uploads/645863f7dc18eb1a9b5d29df/t49Nnyl4tbkUn7CmQqKZh.jpeg
Peter Lin
user
PeterL1n
67e21b305d20ec3277dac34e
Xing Wang
67e21b305d20ec3277dac34f
Xuefeng Xiao
admin_assigned
2025-03-25T09:19:05.020Z
646b7f71df2609a541c1ab9f
/avatars/48b82e5fd9b06f41ff825507c36816cd.svg
Xuefeng Xiao
user
xiaoxuefeng
67e21b305d20ec3277dac350
Yunhai Tong
67e21b305d20ec3277dac351
Ling Yang
admin_assigned
2025-03-25T09:19:44.463Z
64fde4e252e82dd432b74ce9
https://cdn-avatars.huggingface.co/v1/production/uploads/64fde4e252e82dd432b74ce9/-CQZbBP7FsPPyawYrsi4z.jpeg
Ling Yang
user
Lingaaaaaaa
67e21b305d20ec3277dac352
Bin Cui
admin_assigned
2025-03-25T09:18:48.809Z
67b2795f0bd4ddcd84426bb4
/avatars/d4346ac5a0ebbaeb828d832cc6ca9f0b.svg
Bin Cui
user
lazybone128
Training-free Diffusion Acceleration with Bottleneck Sampling
Diffusion models have demonstrated remarkable capabilities in visual content
generation but remain challenging to deploy due to their high computational
cost during inference. This computational burden primarily arises from the
quadratic complexity of self-attention with respect to image or video
resolution. While existing acceleration methods often compromise output quality
or necessitate costly retraining, we observe that most diffusion models are
pre-trained at lower resolutions, presenting an opportunity to exploit these
low-resolution priors for more efficient inference without degrading
performance. In this work, we introduce Bottleneck Sampling, a training-free
framework that leverages low-resolution priors to reduce computational overhead
while preserving output fidelity. Bottleneck Sampling follows a high-low-high
denoising workflow: it performs high-resolution denoising in the initial and
final stages while operating at lower resolutions in intermediate steps. To
mitigate aliasing and blurring artifacts, we further refine the resolution
transition points and adaptively shift the denoising timesteps at each stage.
We evaluate Bottleneck Sampling on both image and video generation tasks, where
extensive experiments demonstrate that it accelerates inference by up to
3times for image generation and 2.5times for video generation, all while
maintaining output quality comparable to the standard full-resolution sampling
process across multiple evaluation metrics. Code is available at:
https://github.com/tyfeld/Bottleneck-Sampling
Bottleneck Sampling accelerates diffusion model inference by using low-resolution priors while maintaining output fidelity in image and video generation.
diffusion models computational cost inference quadratic complexity self-attention low-resolution priors Bottleneck Sampling high-low-high denoising workflow resolution transition points adaptive shifting