SynCity: Training-Free Generation of 3D Worlds
We address the challenge of generating 3D worlds from textual descriptions.
We propose SynCity, a training- and optimization-free approach, which leverages
the geometric precision of pre-trained 3D generative models and the artistic
versatility of 2D image generators to create large, high-quality 3D spaces.
While most 3D generative models are object-centric and cannot generate
large-scale worlds, we show how 3D and 2D generators can be combined to
generate ever-expanding scenes. Through a tile-based approach, we allow
fine-grained control over the layout and the appearance of scenes. The world is
generated tile-by-tile, and each new tile is generated within its world-context
and then fused with the scene. SynCity generates compelling and immersive
scenes that are rich in detail and diversity.
67dd8e2b0824309332ce3b97
Paul Engstler
claimed_verified
2025-03-24T08:53:16.508Z
62262603a8218a9b862b18cc
https://cdn-avatars.huggingface.co/v1/production/uploads/1648321672399-62262603a8218a9b862b18cc.jpeg
Paul Engstler
user
paulengstler
67dd8e2b0824309332ce3b98
Aleksandar Shtedritski
67dd8e2b0824309332ce3b99
Iro Laina
67dd8e2b0824309332ce3b9a
Christian Rupprecht
67dd8e2b0824309332ce3b9b
Andrea Vedaldi
SynCity: Training-Free Generation of 3D Worlds
We address the challenge of generating 3D worlds from textual descriptions.
We propose SynCity, a training- and optimization-free approach, which leverages
the geometric precision of pre-trained 3D generative models and the artistic
versatility of 2D image generators to create large, high-quality 3D spaces.
While most 3D generative models are object-centric and cannot generate
large-scale worlds, we show how 3D and 2D generators can be combined to
generate ever-expanding scenes. Through a tile-based approach, we allow
fine-grained control over the layout and the appearance of scenes. The world is
generated tile-by-tile, and each new tile is generated within its world-context
and then fused with the scene. SynCity generates compelling and immersive
scenes that are rich in detail and diversity.
SynCity combines 3D and 2D generative models to create large, high-quality, and immersive 3D worlds from textual descriptions.
3D generative models 2D image generators object-centric models tile-based approach scene fusion world-context