HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
Creating digital avatars from textual prompts has long been a desirable yet
challenging task. Despite the promising outcomes obtained through 2D diffusion
priors in recent works, current methods face challenges in achieving
high-quality and animated avatars effectively. In this paper, we present
HeadStudio, a novel framework that utilizes 3D Gaussian splatting to
generate realistic and animated avatars from text prompts. Our method drives 3D
Gaussians semantically to create a flexible and achievable appearance through
the intermediate FLAME representation. Specifically, we incorporate the FLAME
into both 3D representation and score distillation: 1) FLAME-based 3D Gaussian
splatting, driving 3D Gaussian points by rigging each point to a FLAME mesh. 2)
FLAME-based score distillation sampling, utilizing FLAME-based fine-grained
control signal to guide score distillation from the text prompt. Extensive
experiments demonstrate the efficacy of HeadStudio in generating animatable
avatars from textual prompts, exhibiting visually appealing appearances. The
avatars are capable of rendering high-quality real-time (geq 40 fps) novel
views at a resolution of 1024. They can be smoothly controlled by real-world
speech and video. We hope that HeadStudio can advance digital avatar creation
and that the present method can widely be applied across various domains.
65c98f15d908bd52a457b462
Zhenglin Zhou
admin_assigned
2024-02-12T16:15:42.140Z
6425318d175bd2952281065e
/avatars/37deb6ceb1552dece43a1c8c13c1c871.svg
ZhenglinZhou
user
zhenglin
65c98f15d908bd52a457b463
Fan Ma
admin_assigned
2024-02-12T16:18:33.627Z
652d3da8072563249e8c7824
/avatars/9e24b3528774a4d7635c800b29a3588e.svg
Fan
user
Flowerfan
65c98f15d908bd52a457b464
Hehe Fan
admin_assigned
2024-02-12T16:16:12.167Z
64ad04020fb9b20dbabbd30e
/avatars/a6bae4a3a4bcd6b54c33860fe14c7923.svg
Hehe Fan
user
hehefan
65c98f15d908bd52a457b465
Yi Yang
HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
Creating digital avatars from textual prompts has long been a desirable yet
challenging task. Despite the promising outcomes obtained through 2D diffusion
priors in recent works, current methods face challenges in achieving
high-quality and animated avatars effectively. In this paper, we present
HeadStudio, a novel framework that utilizes 3D Gaussian splatting to
generate realistic and animated avatars from text prompts. Our method drives 3D
Gaussians semantically to create a flexible and achievable appearance through
the intermediate FLAME representation. Specifically, we incorporate the FLAME
into both 3D representation and score distillation: 1) FLAME-based 3D Gaussian
splatting, driving 3D Gaussian points by rigging each point to a FLAME mesh. 2)
FLAME-based score distillation sampling, utilizing FLAME-based fine-grained
control signal to guide score distillation from the text prompt. Extensive
experiments demonstrate the efficacy of HeadStudio in generating animatable
avatars from textual prompts, exhibiting visually appealing appearances. The
avatars are capable of rendering high-quality real-time (geq 40 fps) novel
views at a resolution of 1024. They can be smoothly controlled by real-world
speech and video. We hope that HeadStudio can advance digital avatar creation
and that the present method can widely be applied across various domains.
HeadStudio uses 3D Gaussian splatting and FLAME representation to generate high-quality, animated digital avatars from text prompts with real-time rendering capabilities.
Gaussian splatting FLAME score distillation rigging FLAME mesh real-time rendering avatars animated avatars textual prompts controlled by speech and video