Structured 3D Latents for Scalable and Versatile 3D Generation
We introduce a novel 3D generation method for versatile and high-quality 3D
asset creation. The cornerstone is a unified Structured LATent (SLAT)
representation which allows decoding to different output formats, such as
Radiance Fields, 3D Gaussians, and meshes. This is achieved by integrating a
sparsely-populated 3D grid with dense multiview visual features extracted from
a powerful vision foundation model, comprehensively capturing both structural
(geometry) and textural (appearance) information while maintaining flexibility
during decoding. We employ rectified flow transformers tailored for SLAT as our
3D generation models and train models with up to 2 billion parameters on a
large 3D asset dataset of 500K diverse objects. Our model generates
high-quality results with text or image conditions, significantly surpassing
existing methods, including recent ones at similar scales. We showcase flexible
output format selection and local 3D editing capabilities which were not
offered by previous models. Code, model, and data will be released.
674f2822ecb7d1fab211ac7b
Jianfeng Xiang
admin_assigned
2024-12-06T10:43:35.349Z
6513df3175940371506cb73e
/avatars/5f48fd02377f62864c5db5555b9bf413.svg
Jianfeng Xiang
user
JeffreyXiang
674f2822ecb7d1fab211ac7c
Zelong Lv
admin_assigned
2024-12-06T10:43:14.516Z
674ec756d7e624639d198b7c
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/dLuxrPo-Nhc3SHy74EUDU.png
Zelong Lv
user
Maxtir
674f2822ecb7d1fab211ac7d
Sicheng Xu
claimed_verified
2024-12-06T09:09:52.189Z
641d402c043963b1c0a578b8
/avatars/d1a7297ca7d4cdbbe484a54d7d223551.svg
Sicheng Xu
user
sicxu
674f2822ecb7d1fab211ac7e
Yu Deng
claimed_verified
2024-12-09T11:07:35.530Z
660bbb03c50f8393c5719e67
/avatars/4a52e36e19066335bd1955b583220a1e.svg
Yu Deng
user
bEijuuu
674f2822ecb7d1fab211ac7f
Ruicheng Wang
admin_assigned
2024-12-06T10:43:08.729Z
629d87735a13ba8233e63dbd
https://cdn-avatars.huggingface.co/v1/production/uploads/629d87735a13ba8233e63dbd/4G1r1otoOzszvSr-HeM9f.jpeg
Ruicheng Wang
user
Ruicheng
674f2822ecb7d1fab211ac80
Bowen Zhang
admin_assigned
2024-12-06T10:42:58.378Z
64560bb04cfac492278df590
/avatars/cf7acf16ac452a551d32a774ff172d8a.svg
Bowen Zhang
user
bowenzhang
674f2822ecb7d1fab211ac81
Dong Chen
674f2822ecb7d1fab211ac82
Xin Tong
674f2822ecb7d1fab211ac83
Jiaolong Yang
admin_assigned
2024-12-06T10:42:47.364Z
66a59f6b94d2b190a22b7c80
/avatars/9b59c0bb3e171d5246e3cb3aa8377a77.svg
jiaolong yang
user
godjiaolongge
Structured 3D Latents for Scalable and Versatile 3D Generation
We introduce a novel 3D generation method for versatile and high-quality 3D
asset creation. The cornerstone is a unified Structured LATent (SLAT)
representation which allows decoding to different output formats, such as
Radiance Fields, 3D Gaussians, and meshes. This is achieved by integrating a
sparsely-populated 3D grid with dense multiview visual features extracted from
a powerful vision foundation model, comprehensively capturing both structural
(geometry) and textural (appearance) information while maintaining flexibility
during decoding. We employ rectified flow transformers tailored for SLAT as our
3D generation models and train models with up to 2 billion parameters on a
large 3D asset dataset of 500K diverse objects. Our model generates
high-quality results with text or image conditions, significantly surpassing
existing methods, including recent ones at similar scales. We showcase flexible
output format selection and local 3D editing capabilities which were not
offered by previous models. Code, model, and data will be released.
A 3D generation method using a unified SLAT representation and rectified flow transformers achieves high-quality results across different formats and conditions.
Structured LATent (SLAT) Radiance Fields 3D Gaussians meshes sparsely-populated 3D grid dense multiview visual features rectified flow transformers