Articulated Kinematics Distillation from Video Diffusion Models
We present Articulated Kinematics Distillation (AKD), a framework for
generating high-fidelity character animations by merging the strengths of
skeleton-based animation and modern generative models. AKD uses a
skeleton-based representation for rigged 3D assets, drastically reducing the
Degrees of Freedom (DoFs) by focusing on joint-level control, which allows for
efficient, consistent motion synthesis. Through Score Distillation Sampling
(SDS) with pre-trained video diffusion models, AKD distills complex,
articulated motions while maintaining structural integrity, overcoming
challenges faced by 4D neural deformation fields in preserving shape
consistency. This approach is naturally compatible with physics-based
simulation, ensuring physically plausible interactions. Experiments show that
AKD achieves superior 3D consistency and motion quality compared with existing
works on text-to-4D generation. Project page:
https://research.nvidia.com/labs/dir/akd/
67edf4bf5e87fcaa485a0ad9
Xuan Li
admin_assigned
2025-04-03T14:04:06.298Z
6387064a2ee2261893d85c0e
https://cdn-avatars.huggingface.co/v1/production/uploads/6387064a2ee2261893d85c0e/LznJi69uQwm1Le5ma6Zb_.jpeg
xuan li
user
xuanli
67edf4bf5e87fcaa485a0ada
Qianli Ma
67edf4bf5e87fcaa485a0adb
Tsung-Yi Lin
admin_assigned
2025-04-03T14:03:42.992Z
63b738acbd2d1535227daa4c
https://cdn-avatars.huggingface.co/v1/production/uploads/63b738acbd2d1535227daa4c/dbPQFvHwC-Cf-ssMGYUo6.jpeg
Tsung-Yi Lin
user
tsungyi
67edf4bf5e87fcaa485a0adc
Yongxin Chen
admin_assigned
2025-04-03T14:03:36.411Z
66f4cf1a03b5ba8a7f1f6522
/avatars/2768d6e37d3f280194cfb8ed274f6015.svg
Yongxin Chen
user
Ema11
67edf4bf5e87fcaa485a0add
Chenfanfu Jiang
admin_assigned
2025-04-03T14:03:29.907Z
655683727be68c0961673f45
/avatars/cddca36c041fa04860a4d42c0feaa07f.svg
Chenfanfu Jiang
user
cffjiang
67edf4bf5e87fcaa485a0ade
Ming-Yu Liu
admin_assigned
2025-04-03T14:03:21.297Z
62f049afdf4b93aad5c7f2d6
/avatars/e272e58ad996733d7098e50248e5b57e.svg
Ming-Yu Liu
user
mingyuliutw
67edf4bf5e87fcaa485a0adf
Donglai Xiang
Articulated Kinematics Distillation from Video Diffusion Models
We present Articulated Kinematics Distillation (AKD), a framework for
generating high-fidelity character animations by merging the strengths of
skeleton-based animation and modern generative models. AKD uses a
skeleton-based representation for rigged 3D assets, drastically reducing the
Degrees of Freedom (DoFs) by focusing on joint-level control, which allows for
efficient, consistent motion synthesis. Through Score Distillation Sampling
(SDS) with pre-trained video diffusion models, AKD distills complex,
articulated motions while maintaining structural integrity, overcoming
challenges faced by 4D neural deformation fields in preserving shape
consistency. This approach is naturally compatible with physics-based
simulation, ensuring physically plausible interactions. Experiments show that
AKD achieves superior 3D consistency and motion quality compared with existing
works on text-to-4D generation. Project page:
https://research.nvidia.com/labs/dir/akd/
Articulated Kinematics Distillation merges skeletal animation and diffusion models to generate high-fidelity, structurally consistent, and physically plausible character animations.
skeleton-based animation generative models Degrees of Freedom (DoFs) Score Distillation Sampling (SDS) video diffusion models shape consistency physics-based simulation