DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag
  Editing
Drag-based image editing has long suffered from distortions in the target
region, largely because the priors of earlier base models, Stable Diffusion,
are insufficient to project optimized latents back onto the natural image
manifold. With the shift from UNet-based DDPMs to more scalable DiT with flow
matching (e.g., SD3.5, FLUX), generative priors have become significantly
stronger, enabling advances across diverse editing tasks. However, drag-based
editing has yet to benefit from these stronger priors. This work proposes the
first framework to effectively harness FLUX's rich prior for drag-based
editing, dubbed DragFlow, achieving substantial gains over baselines. We first
show that directly applying point-based drag editing to DiTs performs poorly:
unlike the highly compressed features of UNets, DiT features are insufficiently
structured to provide reliable guidance for point-wise motion supervision. To
overcome this limitation, DragFlow introduces a region-based editing paradigm,
where affine transformations enable richer and more consistent feature
supervision. Additionally, we integrate pretrained open-domain personalization
adapters (e.g., IP-Adapter) to enhance subject consistency, while preserving
background fidelity through gradient mask-based hard constraints. Multimodal
large language models (MLLMs) are further employed to resolve task ambiguities.
For evaluation, we curate a novel Region-based Dragging benchmark (ReD Bench)
featuring region-level dragging instructions. Extensive experiments on
DragBench-DR and ReD Bench show that DragFlow surpasses both point-based and
region-based baselines, setting a new state-of-the-art in drag-based image
editing. Code and datasets will be publicly available upon publication.
68df2c09df49fb0df1e03bf4
Zihan Zhou
claimed_verified
2025-10-03T12:32:56.222Z
66923522e32997bdf7f37462
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/-RE4FqyZnDF9PcpY6ZBGH.png
Zihan Zhou
user
Edennnnn
68df2c09df49fb0df1e03bf5
Shilin Lu
claimed_verified
2025-10-03T12:32:53.604Z
631c4a23aa346997917bcb89
/avatars/4a562ba78e6be289049027c27798cc6e.svg
Shilin Lu
user
Shilin-LU
68df2c09df49fb0df1e03bf6
Shuli Leng
claimed_verified
2025-10-03T12:30:08.812Z
68debc040c8d2ad3d623a17e
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/74XAnVrry28utBLJx3RbV.png
Shuli Leng
user
Leahahah
68df2c09df49fb0df1e03bf7
Shaocong Zhang
68df2c09df49fb0df1e03bf8
Zhuming Lian
68df2c09df49fb0df1e03bf9
Xinlei Yu
68df2c09df49fb0df1e03bfa
Adams Wai-Kin Kong
DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag
  Editing
Drag-based image editing has long suffered from distortions in the target
region, largely because the priors of earlier base models, Stable Diffusion,
are insufficient to project optimized latents back onto the natural image
manifold. With the shift from UNet-based DDPMs to more scalable DiT with flow
matching (e.g., SD3.5, FLUX), generative priors have become significantly
stronger, enabling advances across diverse editing tasks. However, drag-based
editing has yet to benefit from these stronger priors. This work proposes the
first framework to effectively harness FLUX's rich prior for drag-based
editing, dubbed DragFlow, achieving substantial gains over baselines. We first
show that directly applying point-based drag editing to DiTs performs poorly:
unlike the highly compressed features of UNets, DiT features are insufficiently
structured to provide reliable guidance for point-wise motion supervision. To
overcome this limitation, DragFlow introduces a region-based editing paradigm,
where affine transformations enable richer and more consistent feature
supervision. Additionally, we integrate pretrained open-domain personalization
adapters (e.g., IP-Adapter) to enhance subject consistency, while preserving
background fidelity through gradient mask-based hard constraints. Multimodal
large language models (MLLMs) are further employed to resolve task ambiguities.
For evaluation, we curate a novel Region-based Dragging benchmark (ReD Bench)
featuring region-level dragging instructions. Extensive experiments on
DragBench-DR and ReD Bench show that DragFlow surpasses both point-based and
region-based baselines, setting a new state-of-the-art in drag-based image
editing. Code and datasets will be publicly available upon publication.
DragFlow leverages FLUX's strong generative priors and region-based editing with affine transformations to achieve state-of-the-art performance in drag-based image editing.
DragFlow FLUX flow matching DiT UNet DDPMs affine transformations pretrained open-domain personalization adapters IP-Adapter gradient mask-based hard constraints multimodal large language models MLLMs Region-based Dragging benchmark ReD Bench DragBench-DR