LDM3D: Latent Diffusion Model for 3D
This research paper proposes a Latent Diffusion Model for 3D (LDM3D) that
generates both image and depth map data from a given text prompt, allowing
users to generate RGBD images from text prompts. The LDM3D model is fine-tuned
on a dataset of tuples containing an RGB image, depth map and caption, and
validated through extensive experiments. We also develop an application called
DepthFusion, which uses the generated RGB images and depth maps to create
immersive and interactive 360-degree-view experiences using TouchDesigner. This
technology has the potential to transform a wide range of industries, from
entertainment and gaming to architecture and design. Overall, this paper
presents a significant contribution to the field of generative AI and computer
vision, and showcases the potential of LDM3D and DepthFusion to revolutionize
content creation and digital experiences. A short video summarizing the
approach can be found at https://t.ly/tdi2.
6466d92acdea48159aa50ea4
Gabriela Ben Melech Stan
extracted_confirmed
2023-05-20T07:01:12.409Z
63174cfddc97a974718f373a
/avatars/f5a1d5d90abf8aafe8864bc4f1b076cc.svg
gabriela ben melech
user
gabsm
6466d92acdea48159aa50ea5
Diana Wofk
extracted_confirmed
2024-09-03T17:05:44.455Z
66d740a519214d743cc30335
/avatars/bc0839af30a183d5fae0a353d02733e2.svg
Diana Wofk
user
dwofk
6466d92acdea48159aa50ea6
Scottie Fox
6466d92acdea48159aa50ea7
Alex Redden
6466d92acdea48159aa50ea8
Will Saxton
6466d92acdea48159aa50ea9
Jean Yu
extracted_pending
2023-05-19T02:04:28.167Z
61041e8e7d91607780688a39
https://cdn-avatars.huggingface.co/v1/production/uploads/1627659976701-61041e8e7d91607780688a39.png
Jean Yu
user
jean1yu
6466d92acdea48159aa50eaa
Estelle Aflalo
extracted_confirmed
2024-12-18T08:42:40.260Z
64575266900b28f7841090e5
/avatars/13dc0a370bb24271653c352897a2673e.svg
Estelle Aflalo
user
estellea
6466d92acdea48159aa50eab
Shao-Yen Tseng
6466d92acdea48159aa50eac
Fabio Nonato
6466d92acdea48159aa50ead
Matthias Muller
6466d92acdea48159aa50eae
Vasudev Lal
extracted_pending
2023-05-19T02:04:28.167Z
6454021413dba495b2dfebd1
/avatars/16f019f7c321aa24000364a50a1975fe.svg
Vasudev Lal
user
vasudevlal
LDM3D: Latent Diffusion Model for 3D
This research paper proposes a Latent Diffusion Model for 3D (LDM3D) that
generates both image and depth map data from a given text prompt, allowing
users to generate RGBD images from text prompts. The LDM3D model is fine-tuned
on a dataset of tuples containing an RGB image, depth map and caption, and
validated through extensive experiments. We also develop an application called
DepthFusion, which uses the generated RGB images and depth maps to create
immersive and interactive 360-degree-view experiences using TouchDesigner. This
technology has the potential to transform a wide range of industries, from
entertainment and gaming to architecture and design. Overall, this paper
presents a significant contribution to the field of generative AI and computer
vision, and showcases the potential of LDM3D and DepthFusion to revolutionize
content creation and digital experiences. A short video summarizing the
approach can be found at https://t.ly/tdi2.
Latent Diffusion Model for 3D (LDM3D) generates RGBD images from text prompts and is used to create immersive 360-degree-view experiences.
Latent Diffusion Model for 3D LDM3D RGBD images depth map fine-tuning TouchDesigner 360-degree-view generative AI computer vision content creation digital experiences