AlphaTablets: A Generic Plane Representation for 3D Planar
  Reconstruction from Monocular Videos
We introduce AlphaTablets, a novel and generic representation of 3D planes
that features continuous 3D surface and precise boundary delineation. By
representing 3D planes as rectangles with alpha channels, AlphaTablets combine
the advantages of current 2D and 3D plane representations, enabling accurate,
consistent and flexible modeling of 3D planes. We derive differentiable
rasterization on top of AlphaTablets to efficiently render 3D planes into
images, and propose a novel bottom-up pipeline for 3D planar reconstruction
from monocular videos. Starting with 2D superpixels and geometric cues from
pre-trained models, we initialize 3D planes as AlphaTablets and optimize them
via differentiable rendering. An effective merging scheme is introduced to
facilitate the growth and refinement of AlphaTablets. Through iterative
optimization and merging, we reconstruct complete and accurate 3D planes with
solid surfaces and clear boundaries. Extensive experiments on the ScanNet
dataset demonstrate state-of-the-art performance in 3D planar reconstruction,
underscoring the great potential of AlphaTablets as a generic 3D plane
representation for various applications. Project page is available at:
https://hyzcluster.github.io/alphatablets
674d422720c42228e89c477e
Yuze He
admin_assigned
2024-12-02T09:20:25.901Z
64c903957b4d0d947ce86bc6
/avatars/61d70a3ba00c83a5950f5c909a1a06f8.svg
Yuze He
user
hyz317
674d422720c42228e89c477f
Wang Zhao
claimed_verified
2024-12-02T09:34:05.024Z
66054d519af76210c2ee4b8e
/avatars/c1854765b1e45ec33602b2cb9443f82a.svg
Wang Zhao
user
thuzhaowang
674d422720c42228e89c4780
Shaohui Liu
admin_assigned
2024-12-02T09:20:34.937Z
635265ff3d604ecb3936e3d0
/avatars/53e7cd1a216f97c45fc3e51e3a8bae35.svg
Shaohui Liu
user
lshmouse
674d422720c42228e89c4781
Yubin Hu
admin_assigned
2024-12-02T09:20:40.445Z
672a099e6077b009b3c9972d
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/lduG_xVw-XFElSKhZrava.jpeg
Yubin Hu
user
AlbertHuyb
674d422720c42228e89c4782
Yushi Bai
admin_assigned
2024-12-02T09:20:45.506Z
64ed568ccf6118a9379a61b8
/avatars/6d040cbcb4a9b624cbe64c9d01cd5c88.svg
Yushi Bai
user
bys0318
674d422720c42228e89c4783
Yu-Hui Wen
674d422720c42228e89c4784
Yong-Jin Liu
AlphaTablets: A Generic Plane Representation for 3D Planar
  Reconstruction from Monocular Videos
We introduce AlphaTablets, a novel and generic representation of 3D planes
that features continuous 3D surface and precise boundary delineation. By
representing 3D planes as rectangles with alpha channels, AlphaTablets combine
the advantages of current 2D and 3D plane representations, enabling accurate,
consistent and flexible modeling of 3D planes. We derive differentiable
rasterization on top of AlphaTablets to efficiently render 3D planes into
images, and propose a novel bottom-up pipeline for 3D planar reconstruction
from monocular videos. Starting with 2D superpixels and geometric cues from
pre-trained models, we initialize 3D planes as AlphaTablets and optimize them
via differentiable rendering. An effective merging scheme is introduced to
facilitate the growth and refinement of AlphaTablets. Through iterative
optimization and merging, we reconstruct complete and accurate 3D planes with
solid surfaces and clear boundaries. Extensive experiments on the ScanNet
dataset demonstrate state-of-the-art performance in 3D planar reconstruction,
underscoring the great potential of AlphaTablets as a generic 3D plane
representation for various applications. Project page is available at:
https://hyzcluster.github.io/alphatablets
AlphaTablets, a new 3D plane representation, combines 2D and 3D advantages, enabling precise 3D planar reconstruction from monocular videos.
AlphaTablets 3D planes continuous 3D surface precise boundary delineation differentiable rasterization bottom-up pipeline 3D planar reconstruction monocular videos 2D superpixels geometric cues pre-trained models iterative optimization merging ScanNet dataset