SynCity: Training-Free Generation of 3D Worlds
We address the challenge of generating 3D worlds from textual descriptions.
We propose SynCity, a training- and optimization-free approach, which leverages
the geometric precision of pre-trained 3D generative models and the artistic
versatility of 2D image generators to create large, high-quality 3D spaces.
While most 3D generative models are object-centric and cannot generate
large-scale worlds, we show how 3D and 2D generators can be combined to
generate ever-expanding scenes. Through a tile-based approach, we allow
fine-grained control over the layout and the appearance of scenes. The world is
generated tile-by-tile, and each new tile is generated within its world-context
and then fused with the scene. SynCity generates compelling and immersive
scenes that are rich in detail and diversity.
67dd8e2b0824309332ce3b97
Paul Engstler
claimed_verified
2025-03-24T08:53:16.508Z
62262603a8218a9b862b18cc
https://cdn-avatars.huggingface.co/v1/production/uploads/1648321672399-62262603a8218a9b862b18cc.jpeg
Paul Engstler
user
paulengstler
67dd8e2b0824309332ce3b98
Aleksandar Shtedritski
67dd8e2b0824309332ce3b99
Iro Laina
67dd8e2b0824309332ce3b9a
Christian Rupprecht
67dd8e2b0824309332ce3b9b
Andrea Vedaldi
SynCity: Training-Free Generation of 3D Worlds
We address the challenge of generating 3D worlds from textual descriptions.
We propose SynCity, a training- and optimization-free approach, which leverages
the geometric precision of pre-trained 3D generative models and the artistic
versatility of 2D image generators to create large, high-quality 3D spaces.
While most 3D generative models are object-centric and cannot generate
large-scale worlds, we show how 3D and 2D generators can be combined to
generate ever-expanding scenes. Through a tile-based approach, we allow
fine-grained control over the layout and the appearance of scenes. The world is
generated tile-by-tile, and each new tile is generated within its world-context
and then fused with the scene. SynCity generates compelling and immersive
scenes that are rich in detail and diversity.
3D generative models 2D image generators object-centric large-scale worlds tile-based approach world-context compelling and immersive scenes