CAT3D: Create Anything in 3D with Multi-View Diffusion Models
Advances in 3D reconstruction have enabled high-quality 3D capture, but
require a user to collect hundreds to thousands of images to create a 3D scene.
We present CAT3D, a method for creating anything in 3D by simulating this
real-world capture process with a multi-view diffusion model. Given any number
of input images and a set of target novel viewpoints, our model generates
highly consistent novel views of a scene. These generated views can be used as
input to robust 3D reconstruction techniques to produce 3D representations that
can be rendered from any viewpoint in real-time. CAT3D can create entire 3D
scenes in as little as one minute, and outperforms existing methods for single
image and few-view 3D scene creation. See our project page for results and
interactive demos at https://cat3d.github.io .
6646c0361a95b953729a1aa6
Ruiqi Gao
admin_assigned
2024-05-17T09:35:41.476Z
6137d46d1c0a1ca53676925f
/avatars/f3d884a3971a858adc49e0f3b1932078.svg
Gao
user
Ruiqi
6646c0361a95b953729a1aa7
Aleksander Holynski
admin_assigned
2024-05-17T09:35:47.984Z
62f6e2792e53c2efd33faa92
/avatars/85d94b4022577747b8d2d10a82c2f3c7.svg
Aleksander Holynski
user
holynski
6646c0361a95b953729a1aa8
Philipp Henzler
6646c0361a95b953729a1aa9
Arthur Brussee
admin_assigned
2024-05-17T09:36:00.825Z
631e2f3de4b67f5168fa6578
/avatars/dbb974595595996957e0a36f3f58027e.svg
Arthur Brussee
user
bakfiets
6646c0361a95b953729a1aaa
Ricardo Martin-Brualla
6646c0361a95b953729a1aab
Pratul Srinivasan
6646c0361a95b953729a1aac
Jonathan T. Barron
6646c0361a95b953729a1aad
Ben Poole
admin_assigned
2024-05-17T09:36:23.058Z
63213768d2d45f315183abc3
/avatars/521f52f430b73e514afb06e3a9d6779d.svg
Ben Poole
user
doinkda
CAT3D: Create Anything in 3D with Multi-View Diffusion Models
Advances in 3D reconstruction have enabled high-quality 3D capture, but
require a user to collect hundreds to thousands of images to create a 3D scene.
We present CAT3D, a method for creating anything in 3D by simulating this
real-world capture process with a multi-view diffusion model. Given any number
of input images and a set of target novel viewpoints, our model generates
highly consistent novel views of a scene. These generated views can be used as
input to robust 3D reconstruction techniques to produce 3D representations that
can be rendered from any viewpoint in real-time. CAT3D can create entire 3D
scenes in as little as one minute, and outperforms existing methods for single
image and few-view 3D scene creation. See our project page for results and
interactive demos at https://cat3d.github.io .
CAT3D generates consistent 3D views from limited input using a multi-view diffusion model, enabling fast and accurate 3D reconstruction.
multi-view diffusion model