Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite
  Imagery
Synthesizing large-scale, explorable, and geometrically accurate 3D urban
scenes is a challenging yet valuable task in providing immersive and embodied
applications. The challenges lie in the lack of large-scale and high-quality
real-world 3D scans for training generalizable generative models. In this
paper, we take an alternative route to create large-scale 3D scenes by
synergizing the readily available satellite imagery that supplies realistic
coarse geometry and the open-domain diffusion model for creating high-quality
close-up appearances. We propose Skyfall-GS, the first city-block
scale 3D scene creation framework without costly 3D annotations, also featuring
real-time, immersive 3D exploration. We tailor a curriculum-driven iterative
refinement strategy to progressively enhance geometric completeness and
photorealistic textures. Extensive experiments demonstrate that Skyfall-GS
provides improved cross-view consistent geometry and more realistic textures
compared to state-of-the-art approaches. Project page:
https://skyfall-gs.jayinnn.dev/
68f593468589920bf4d320d3
Jie-Ying Lee
claimed_verified
2025-10-20T12:11:07.295Z
655f1770f74fa124d1172ec1
https://cdn-avatars.huggingface.co/v1/production/uploads/655f1770f74fa124d1172ec1/bdYocZ1qN50CAfb2z2YLA.png
Jie-Ying Lee
user
jayinnn
68f593468589920bf4d320d4
Yi-Ruei Liu
68f593468589920bf4d320d5
Shr-Ruei Tsai
68f593468589920bf4d320d6
Wei-Cheng Chang
68f593468589920bf4d320d7
Chung-Ho Wu
68f593468589920bf4d320d8
Jiewen Chan
68f593468589920bf4d320d9
Zhenjun Zhao
68f593468589920bf4d320da
Chieh Hubert Lin
68f593468589920bf4d320db
Yu-Lun Liu
Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite
  Imagery
Synthesizing large-scale, explorable, and geometrically accurate 3D urban
scenes is a challenging yet valuable task in providing immersive and embodied
applications. The challenges lie in the lack of large-scale and high-quality
real-world 3D scans for training generalizable generative models. In this
paper, we take an alternative route to create large-scale 3D scenes by
synergizing the readily available satellite imagery that supplies realistic
coarse geometry and the open-domain diffusion model for creating high-quality
close-up appearances. We propose Skyfall-GS, the first city-block
scale 3D scene creation framework without costly 3D annotations, also featuring
real-time, immersive 3D exploration. We tailor a curriculum-driven iterative
refinement strategy to progressively enhance geometric completeness and
photorealistic textures. Extensive experiments demonstrate that Skyfall-GS
provides improved cross-view consistent geometry and more realistic textures
compared to state-of-the-art approaches. Project page:
https://skyfall-gs.jayinnn.dev/
Skyfall-GS creates large-scale, high-quality 3D urban scenes using satellite imagery and diffusion models, offering real-time exploration and improved geometry and texture consistency.
diffusion model Skyfall-GS curriculum-driven iterative refinement geometric completeness photorealistic textures cross-view consistent geometry