HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation
Scene-level 3D generation represents a critical frontier in multimedia and
computer graphics, yet existing approaches either suffer from limited object
categories or lack editing flexibility for interactive applications. In this
paper, we present HiScene, a novel hierarchical framework that bridges the gap
between 2D image generation and 3D object generation and delivers high-fidelity
scenes with compositional identities and aesthetic scene content. Our key
insight is treating scenes as hierarchical "objects" under isometric views,
where a room functions as a complex object that can be further decomposed into
manipulatable items. This hierarchical approach enables us to generate 3D
content that aligns with 2D representations while maintaining compositional
structure. To ensure completeness and spatial alignment of each decomposed
instance, we develop a video-diffusion-based amodal completion technique that
effectively handles occlusions and shadows between objects, and introduce shape
prior injection to ensure spatial coherence within the scene. Experimental
results demonstrate that our method produces more natural object arrangements
and complete object instances suitable for interactive applications, while
maintaining physical plausibility and alignment with user inputs.
6805bfc5e332a61dd90160b0
Wenqi Dong
6805bfc5e332a61dd90160b1
Bangbang Yang
claimed_verified
2025-04-22T09:52:51.612Z
63d748ff6f49aa82306b7e48
/avatars/9f0b8b8a09b14d76e52ed1bd312e6b63.svg
BB Yang
user
ybbbbt
6805bfc5e332a61dd90160b2
Zesong Yang
6805bfc5e332a61dd90160b3
Yuan Li
6805bfc5e332a61dd90160b4
Tao Hu
claimed_verified
2025-07-02T07:41:39.393Z
638f3c7fb0525fa370494de8
/avatars/39f51d218af0008f2000a7bd221841fe.svg
Tao Hu
user
yihouxiang
6805bfc5e332a61dd90160b5
Hujun Bao
6805bfc5e332a61dd90160b6
Yuewen Ma
6805bfc5e332a61dd90160b7
Zhaopeng Cui
HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation
Scene-level 3D generation represents a critical frontier in multimedia and
computer graphics, yet existing approaches either suffer from limited object
categories or lack editing flexibility for interactive applications. In this
paper, we present HiScene, a novel hierarchical framework that bridges the gap
between 2D image generation and 3D object generation and delivers high-fidelity
scenes with compositional identities and aesthetic scene content. Our key
insight is treating scenes as hierarchical "objects" under isometric views,
where a room functions as a complex object that can be further decomposed into
manipulatable items. This hierarchical approach enables us to generate 3D
content that aligns with 2D representations while maintaining compositional
structure. To ensure completeness and spatial alignment of each decomposed
instance, we develop a video-diffusion-based amodal completion technique that
effectively handles occlusions and shadows between objects, and introduce shape
prior injection to ensure spatial coherence within the scene. Experimental
results demonstrate that our method produces more natural object arrangements
and complete object instances suitable for interactive applications, while
maintaining physical plausibility and alignment with user inputs.
A hierarchical framework called HiScene combines 2D image and 3D object generation using video-diffusion for amodal completion and shape priors to produce coherent, high-fidelity, interactive 3D scenes.
hierarchical framework 2D image generation 3D object generation isometric views video-diffusion amodal completion spatial coherence compositional identities aesthetic scene content natural object arrangements physical plausibility user inputs