AnyMoLe: Any Character Motion In-betweening Leveraging Video Diffusion
  Models
Despite recent advancements in learning-based motion in-betweening, a key
limitation has been overlooked: the requirement for character-specific
datasets. In this work, we introduce AnyMoLe, a novel method that addresses
this limitation by leveraging video diffusion models to generate motion
in-between frames for arbitrary characters without external data. Our approach
employs a two-stage frame generation process to enhance contextual
understanding. Furthermore, to bridge the domain gap between real-world and
rendered character animations, we introduce ICAdapt, a fine-tuning technique
for video diffusion models. Additionally, we propose a ``motion-video
mimicking'' optimization technique, enabling seamless motion generation for
characters with arbitrary joint structures using 2D and 3D-aware features.
AnyMoLe significantly reduces data dependency while generating smooth and
realistic transitions, making it applicable to a wide range of motion
in-betweening tasks.
67d15c5bac9173a540aec890
Kwan Yun
claimed_verified
2025-03-12T10:44:58.153Z
639d445524af4747d8d2af52
/avatars/6ca870edc993fd3db6b0db4e4848ef7a.svg
kwan yun
user
kwanY
67d15c5bac9173a540aec891
Seokhyeon Hong
67d15c5bac9173a540aec892
Chaelin Kim
67d15c5bac9173a540aec893
Junyong Noh
AnyMoLe: Any Character Motion In-betweening Leveraging Video Diffusion
  Models
Despite recent advancements in learning-based motion in-betweening, a key
limitation has been overlooked: the requirement for character-specific
datasets. In this work, we introduce AnyMoLe, a novel method that addresses
this limitation by leveraging video diffusion models to generate motion
in-between frames for arbitrary characters without external data. Our approach
employs a two-stage frame generation process to enhance contextual
understanding. Furthermore, to bridge the domain gap between real-world and
rendered character animations, we introduce ICAdapt, a fine-tuning technique
for video diffusion models. Additionally, we propose a ``motion-video
mimicking'' optimization technique, enabling seamless motion generation for
characters with arbitrary joint structures using 2D and 3D-aware features.
AnyMoLe significantly reduces data dependency while generating smooth and
realistic transitions, making it applicable to a wide range of motion
in-betweening tasks.
AnyMoLe uses video diffusion models and ICAdapt fine-tuning to generate motion in-between frames for arbitrary characters without extensive datasets, ensuring smooth and realistic transitions.
video diffusion models ICAdapt motion-video mimicking 2D and 3D-aware features