PanoDreamer: 3D Panorama Synthesis from a Single Image
In this paper, we present PanoDreamer, a novel method for producing a
coherent 360^circ 3D scene from a single input image. Unlike existing
methods that generate the scene sequentially, we frame the problem as
single-image panorama and depth estimation. Once the coherent panoramic image
and its corresponding depth are obtained, the scene can be reconstructed by
inpainting the small occluded regions and projecting them into 3D space. Our
key contribution is formulating single-image panorama and depth estimation as
two optimization tasks and introducing alternating minimization strategies to
effectively solve their objectives. We demonstrate that our approach
outperforms existing techniques in single-image 360^circ scene
reconstruction in terms of consistency and overall quality.
67571984b7e7a3a88b153420
Avinash Paliwal
admin_assigned
2024-12-18T13:48:37.553Z
66f1849b811e666a828556b4
/avatars/d01d9233a3e229223e1226d84270e1f8.svg
Avinash Paliwal
user
avinashpaliwal
67571984b7e7a3a88b153421
Xilong Zhou
67571984b7e7a3a88b153422
Andrii Tsarov
67571984b7e7a3a88b153423
Nima Khademi Kalantari
PanoDreamer: 3D Panorama Synthesis from a Single Image
In this paper, we present PanoDreamer, a novel method for producing a
coherent 360^circ 3D scene from a single input image. Unlike existing
methods that generate the scene sequentially, we frame the problem as
single-image panorama and depth estimation. Once the coherent panoramic image
and its corresponding depth are obtained, the scene can be reconstructed by
inpainting the small occluded regions and projecting them into 3D space. Our
key contribution is formulating single-image panorama and depth estimation as
two optimization tasks and introducing alternating minimization strategies to
effectively solve their objectives. We demonstrate that our approach
outperforms existing techniques in single-image 360^circ scene
reconstruction in terms of consistency and overall quality.
A new method, PanoDreamer, reconstructs a 360° 3D scene from a single image by formulating panorama and depth estimation as optimization tasks and using alternating minimization.
single-image panorama depth estimation optimization tasks alternating minimization