Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation
Diffusion models have achieved great success in generating 2D images.
However, the quality and generalizability of 3D content generation remain
limited. State-of-the-art methods often require large-scale 3D assets for
training, which are challenging to collect. In this work, we introduce
Kiss3DGen (Keep It Simple and Straightforward in 3D Generation), an efficient
framework for generating, editing, and enhancing 3D objects by repurposing a
well-trained 2D image diffusion model for 3D generation. Specifically, we
fine-tune a diffusion model to generate ''3D Bundle Image'', a tiled
representation composed of multi-view images and their corresponding normal
maps. The normal maps are then used to reconstruct a 3D mesh, and the
multi-view images provide texture mapping, resulting in a complete 3D model.
This simple method effectively transforms the 3D generation problem into a 2D
image generation task, maximizing the utilization of knowledge in pretrained
diffusion models. Furthermore, we demonstrate that our Kiss3DGen model is
compatible with various diffusion model techniques, enabling advanced features
such as 3D editing, mesh and texture enhancement, etc. Through extensive
experiments, we demonstrate the effectiveness of our approach, showcasing its
ability to produce high-quality 3D models efficiently.
67c691673ff65c55829685a0
Jiantao Lin
admin_assigned
2025-03-04T10:52:36.682Z
6332e2689bf698ce68a22e8c
/avatars/c1922acfda2e6d2fe7b03194a404eb10.svg
JIANTAO LIN
user
LTT
67c691673ff65c55829685a1
Xin Yang
67c691673ff65c55829685a2
Meixi Chen
admin_assigned
2025-03-04T10:52:44.047Z
63641f09a53b71b7a1b02955
/avatars/2f43703cbbc56f3e3f98090f44bccfe6.svg
Meixi Chen
user
MeixiChen
67c691673ff65c55829685a3
Yingjie Xu
67c691673ff65c55829685a4
Dongyu Yan
claimed_verified
2025-03-04T08:34:56.252Z
64049ae20ab5e22719f35103
https://cdn-avatars.huggingface.co/v1/production/uploads/1678023295407-noauth.jpeg
Dongyu Yan
user
StarYDY
67c691673ff65c55829685a5
Leyi Wu
claimed_verified
2025-06-07T13:34:04.450Z
6622f3e1c80be2cc569fb5e1
/avatars/f4bacc6e090ec6e6d9f89b279783f1bd.svg
LeyiWu
user
YUEVII
67c691673ff65c55829685a6
Xinli Xu
admin_assigned
2025-03-04T10:53:15.555Z
64b4ab62eec33e27dcd733b5
/avatars/0a9bf220c9a5efe7279f9b287b087d36.svg
Xinli XU
user
Xxlbigbrother
67c691673ff65c55829685a7
Lie XU
67c691673ff65c55829685a8
Shunsi Zhang
67c691673ff65c55829685a9
Ying-Cong Chen
admin_assigned
2025-03-04T10:53:33.509Z
655cba1d87b67834000590e8
/avatars/3bd43b7c9351f65b8f38f4c8237a0146.svg
Yingcong Chen
user
yingcongchen
Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation
Diffusion models have achieved great success in generating 2D images.
However, the quality and generalizability of 3D content generation remain
limited. State-of-the-art methods often require large-scale 3D assets for
training, which are challenging to collect. In this work, we introduce
Kiss3DGen (Keep It Simple and Straightforward in 3D Generation), an efficient
framework for generating, editing, and enhancing 3D objects by repurposing a
well-trained 2D image diffusion model for 3D generation. Specifically, we
fine-tune a diffusion model to generate ''3D Bundle Image'', a tiled
representation composed of multi-view images and their corresponding normal
maps. The normal maps are then used to reconstruct a 3D mesh, and the
multi-view images provide texture mapping, resulting in a complete 3D model.
This simple method effectively transforms the 3D generation problem into a 2D
image generation task, maximizing the utilization of knowledge in pretrained
diffusion models. Furthermore, we demonstrate that our Kiss3DGen model is
compatible with various diffusion model techniques, enabling advanced features
such as 3D editing, mesh and texture enhancement, etc. Through extensive
experiments, we demonstrate the effectiveness of our approach, showcasing its
ability to produce high-quality 3D models efficiently.
Kiss3DGen leverages a 2D diffusion model to generate high-quality 3D models by fine-tuning for 3D bundle images and using normal maps for mesh reconstruction.
diffusion models 3D generation 3D Bundle Image normal maps 3D mesh texture mapping 3D editing mesh enhancement texture enhancement