Unposed Sparse Views Room Layout Reconstruction in the Age of Pretrain
  Model
Room layout estimation from multiple-perspective images is poorly
investigated due to the complexities that emerge from multi-view geometry,
which requires muti-step solutions such as camera intrinsic and extrinsic
estimation, image matching, and triangulation. However, in 3D reconstruction,
the advancement of recent 3D foundation models such as DUSt3R has shifted the
paradigm from the traditional multi-step structure-from-motion process to an
end-to-end single-step approach. To this end, we introduce Plane-DUSt3R, a
novel method for multi-view room layout estimation leveraging the 3D foundation
model DUSt3R. Plane-DUSt3R incorporates the DUSt3R framework and fine-tunes on
a room layout dataset (Structure3D) with a modified objective to estimate
structural planes. By generating uniform and parsimonious results, Plane-DUSt3R
enables room layout estimation with only a single post-processing step and 2D
detection results. Unlike previous methods that rely on single-perspective or
panorama image, Plane-DUSt3R extends the setting to handle multiple-perspective
images. Moreover, it offers a streamlined, end-to-end solution that simplifies
the process and reduces error accumulation. Experimental results demonstrate
that Plane-DUSt3R not only outperforms state-of-the-art methods on the
synthetic dataset but also proves robust and effective on in the wild data with
different image styles such as cartoon.Our code is available at:
https://github.com/justacar/Plane-DUSt3R
67c65c06e116e361574405e9
Yaxuan Huang
claimed_verified
2025-03-04T08:51:27.582Z
642bdfc65edcc5760cb1ea12
/avatars/599b0bbb379b43cd39097c204c946075.svg
huang
user
yxuan
67c65c06e116e361574405ea
Xili Dai
67c65c06e116e361574405eb
Jianan Wang
67c65c06e116e361574405ec
Xianbiao Qi
admin_assigned
2025-03-04T11:01:12.106Z
6494483aa13255720397287a
/avatars/61ff2e0371df513194246cf6fbb2b78a.svg
Xianbiao Qi
user
qixianbiao
67c65c06e116e361574405ed
Yixing Yuan
67c65c06e116e361574405ee
Xiangyu Yue
admin_assigned
2025-03-04T11:00:56.439Z
666a8f24e2990b0cb16b7bf9
/avatars/fcbaf8f1e3e53a2a4a819b7cb2c53aa4.svg
Xiangyu Yue
user
xyyue
Unposed Sparse Views Room Layout Reconstruction in the Age of Pretrain
  Model
Room layout estimation from multiple-perspective images is poorly
investigated due to the complexities that emerge from multi-view geometry,
which requires muti-step solutions such as camera intrinsic and extrinsic
estimation, image matching, and triangulation. However, in 3D reconstruction,
the advancement of recent 3D foundation models such as DUSt3R has shifted the
paradigm from the traditional multi-step structure-from-motion process to an
end-to-end single-step approach. To this end, we introduce Plane-DUSt3R, a
novel method for multi-view room layout estimation leveraging the 3D foundation
model DUSt3R. Plane-DUSt3R incorporates the DUSt3R framework and fine-tunes on
a room layout dataset (Structure3D) with a modified objective to estimate
structural planes. By generating uniform and parsimonious results, Plane-DUSt3R
enables room layout estimation with only a single post-processing step and 2D
detection results. Unlike previous methods that rely on single-perspective or
panorama image, Plane-DUSt3R extends the setting to handle multiple-perspective
images. Moreover, it offers a streamlined, end-to-end solution that simplifies
the process and reduces error accumulation. Experimental results demonstrate
that Plane-DUSt3R not only outperforms state-of-the-art methods on the
synthetic dataset but also proves robust and effective on in the wild data with
different image styles such as cartoon.Our code is available at:
https://github.com/justacar/Plane-DUSt3R
Plane-DUSt3R leverages a 3D foundation model to estimate room layouts from multiple-perspective images, offering a single-step, end-to-end solution that outperforms existing methods.
3D foundation models DUSt3R multi-view geometry room layout estimation multi-step structure-from-motion camera intrinsic and extrinsic estimation image matching triangulation end-to-end approach structural planes uniform and parsimonious results single post-processing step 2D detection results multiple-perspective images in-the-wild data