SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step
  Diffusion
Recent advances in text-guided image editing enable users to perform image
edits through simple text inputs, leveraging the extensive priors of multi-step
diffusion-based text-to-image models. However, these methods often fall short
of the speed demands required for real-world and on-device applications due to
the costly multi-step inversion and sampling process involved. In response to
this, we introduce SwiftEdit, a simple yet highly efficient editing tool that
achieve instant text-guided image editing (in 0.23s). The advancement of
SwiftEdit lies in its two novel contributions: a one-step inversion framework
that enables one-step image reconstruction via inversion and a mask-guided
editing technique with our proposed attention rescaling mechanism to perform
localized image editing. Extensive experiments are provided to demonstrate the
effectiveness and efficiency of SwiftEdit. In particular, SwiftEdit enables
instant text-guided image editing, which is extremely faster than previous
multi-step methods (at least 50 times faster) while maintain a competitive
performance in editing results. Our project page is at:
https://swift-edit.github.io/
67566090ae453181a5367717
Trong-Tung Nguyen
claimed_verified
2024-12-09T10:30:50.477Z
640052b2f4ff62c2616af567
https://cdn-avatars.huggingface.co/v1/production/uploads/640052b2f4ff62c2616af567/PmMNDQtSgdJ_74IFoYdpp.jpeg
NGUYEN TRONG TUNG
user
Tung11
67566090ae453181a5367718
Quang Nguyen
67566090ae453181a5367719
Khoi Nguyen
67566090ae453181a536771a
Anh Tran
admin_assigned
2024-12-09T15:18:05.535Z
64b3eb404c3cc95a7562563d
/avatars/5313d53807663e3b874391ec3f1a974a.svg
ANH TRAN
user
anhtran
67566090ae453181a536771b
Cuong Pham
SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step
  Diffusion
Recent advances in text-guided image editing enable users to perform image
edits through simple text inputs, leveraging the extensive priors of multi-step
diffusion-based text-to-image models. However, these methods often fall short
of the speed demands required for real-world and on-device applications due to
the costly multi-step inversion and sampling process involved. In response to
this, we introduce SwiftEdit, a simple yet highly efficient editing tool that
achieve instant text-guided image editing (in 0.23s). The advancement of
SwiftEdit lies in its two novel contributions: a one-step inversion framework
that enables one-step image reconstruction via inversion and a mask-guided
editing technique with our proposed attention rescaling mechanism to perform
localized image editing. Extensive experiments are provided to demonstrate the
effectiveness and efficiency of SwiftEdit. In particular, SwiftEdit enables
instant text-guided image editing, which is extremely faster than previous
multi-step methods (at least 50 times faster) while maintain a competitive
performance in editing results. Our project page is at:
https://swift-edit.github.io/
SwiftEdit performs instant text-guided image editing with high efficiency using a one-step inversion framework and mask-guided editing with attention rescaling.
diffusion-based text-to-image models multi-step inversion one-step inversion framework mask-guided editing attention rescaling mechanism