GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly
  Enhanced Quality
Recently, 3D Gaussian splatting (3D-GS) has achieved great success in
reconstructing and rendering real-world scenes. To transfer the high rendering
quality to generation tasks, a series of research works attempt to generate
3D-Gaussian assets from text. However, the generated assets have not achieved
the same quality as those in reconstruction tasks. We observe that Gaussians
tend to grow without control as the generation process may cause indeterminacy.
Aiming at highly enhancing the generation quality, we propose a novel framework
named GaussianDreamerPro. The main idea is to bind Gaussians to reasonable
geometry, which evolves over the whole generation process. Along different
stages of our framework, both the geometry and appearance can be enriched
progressively. The final output asset is constructed with 3D Gaussians bound to
mesh, which shows significantly enhanced details and quality compared with
previous methods. Notably, the generated asset can also be seamlessly
integrated into downstream manipulation pipelines, e.g. animation, composition,
and simulation etc., greatly promoting its potential in wide applications.
Demos are available at https://taoranyi.com/gaussiandreamerpro/.
667e60c9b0f62e5e077f41d4
Taoran Yi
claimed_verified
2024-07-01T07:46:59.957Z
64e5ee4b93d04e3439f4e988
https://cdn-avatars.huggingface.co/v1/production/uploads/64e5ee4b93d04e3439f4e988/g-THJvunoSPUyQ2v_fChU.jpeg
taoranyi
user
thewhole
667e60c9b0f62e5e077f41d5
Jiemin Fang
admin_assigned
2024-07-01T09:31:05.128Z
652cf49cc6857682d3168f5a
/avatars/9ccffa04832429aad37320a301ea8e36.svg
Jiemin Fang
user
JieminFang
667e60c9b0f62e5e077f41d6
Zanwei Zhou
admin_assigned
2024-07-01T09:31:13.566Z
656b2c240bbc114fe6e29e05
/avatars/ad28bc90a3820265501b95bfa5bb9418.svg
Zhou
user
Zanwei
667e60c9b0f62e5e077f41d7
Junjie Wang
667e60c9b0f62e5e077f41d8
Guanjun Wu
admin_assigned
2024-07-01T09:31:38.299Z
65297efc802e3d1a4f7e23e8
/avatars/09dc58dbbce5684e9edcb813bf078cc9.svg
Guanjun Wu
user
SnowGeraltOfRivia
667e60c9b0f62e5e077f41d9
Lingxi Xie
667e60c9b0f62e5e077f41da
Xiaopeng Zhang
admin_assigned
2024-07-01T09:31:52.464Z
640bea9cb4f73086cddbe0a6
/avatars/ae460dd971de1d04660b266b22f81f9d.svg
Xiaopeng Zhang
user
xpzhang
667e60c9b0f62e5e077f41db
Wenyu Liu
667e60c9b0f62e5e077f41dc
Xinggang Wang
admin_assigned
2024-07-01T09:32:34.158Z
62600de6d47e3dbae32ce1ce
/avatars/a536417cfec6e10ac415091bd1829426.svg
Xinggang Wang
user
xinggangw
667e60c9b0f62e5e077f41dd
Qi Tian
GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly
  Enhanced Quality
Recently, 3D Gaussian splatting (3D-GS) has achieved great success in
reconstructing and rendering real-world scenes. To transfer the high rendering
quality to generation tasks, a series of research works attempt to generate
3D-Gaussian assets from text. However, the generated assets have not achieved
the same quality as those in reconstruction tasks. We observe that Gaussians
tend to grow without control as the generation process may cause indeterminacy.
Aiming at highly enhancing the generation quality, we propose a novel framework
named GaussianDreamerPro. The main idea is to bind Gaussians to reasonable
geometry, which evolves over the whole generation process. Along different
stages of our framework, both the geometry and appearance can be enriched
progressively. The final output asset is constructed with 3D Gaussians bound to
mesh, which shows significantly enhanced details and quality compared with
previous methods. Notably, the generated asset can also be seamlessly
integrated into downstream manipulation pipelines, e.g. animation, composition,
and simulation etc., greatly promoting its potential in wide applications.
Demos are available at https://taoranyi.com/gaussiandreamerpro/.
GaussianDreamerPro enhances the quality of 3D-Gaussian asset generation by binding Gaussians to evolving geometry, improving details and facilitating integration into downstream applications.
3D Gaussian splatting generation tasks 3D-Gaussian assets Gaussians geometry appearance GaussianDreamerPro mesh animation composition simulation