ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via
  Gaussian Splatting
3D Gaussian Splatting is renowned for its high-fidelity reconstructions and
real-time novel view synthesis, yet its lack of semantic understanding limits
object-level perception. In this work, we propose ObjectGS, an object-aware
framework that unifies 3D scene reconstruction with semantic understanding.
Instead of treating the scene as a unified whole, ObjectGS models individual
objects as local anchors that generate neural Gaussians and share object IDs,
enabling precise object-level reconstruction. During training, we dynamically
grow or prune these anchors and optimize their features, while a one-hot ID
encoding with a classification loss enforces clear semantic constraints. We
show through extensive experiments that ObjectGS not only outperforms
state-of-the-art methods on open-vocabulary and panoptic segmentation tasks,
but also integrates seamlessly with applications like mesh extraction and scene
editing. Project page: https://ruijiezhu94.github.io/ObjectGS_page
68805c4300f4b5a05f2fbe60
Ruijie Zhu
admin_assigned
2025-07-23T13:30:45.047Z
6697ac8427e4e21a3a92da27
https://cdn-avatars.huggingface.co/v1/production/uploads/6697ac8427e4e21a3a92da27/9vn07-1_BBDk9zfDtDpcG.png
Ruijie Zhu
user
RuijieZhu
68805c4300f4b5a05f2fbe61
Mulin Yu
68805c4300f4b5a05f2fbe62
Linning Xu
68805c4300f4b5a05f2fbe63
Lihan Jiang
68805c4300f4b5a05f2fbe64
Yixuan Li
68805c4300f4b5a05f2fbe65
Tianzhu Zhang
admin_assigned
2025-07-23T13:31:27.940Z
662b8d0083de3e26a6d9f1d1
/avatars/d9566ba1881f86413f5de10a45f24673.svg
Tianzhu Zhang
user
ztz1989
68805c4300f4b5a05f2fbe66
Jiangmiao Pang
admin_assigned
2025-07-23T13:31:33.842Z
65783ee6ee33d547aecc3ffc
https://cdn-avatars.huggingface.co/v1/production/uploads/65783ee6ee33d547aecc3ffc/lWZX88c-0dCsN-yB9Jhlf.jpeg
Jiangmiao Pang
user
Jiangmiao
68805c4300f4b5a05f2fbe67
Bo Dai
ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via
  Gaussian Splatting
3D Gaussian Splatting is renowned for its high-fidelity reconstructions and
real-time novel view synthesis, yet its lack of semantic understanding limits
object-level perception. In this work, we propose ObjectGS, an object-aware
framework that unifies 3D scene reconstruction with semantic understanding.
Instead of treating the scene as a unified whole, ObjectGS models individual
objects as local anchors that generate neural Gaussians and share object IDs,
enabling precise object-level reconstruction. During training, we dynamically
grow or prune these anchors and optimize their features, while a one-hot ID
encoding with a classification loss enforces clear semantic constraints. We
show through extensive experiments that ObjectGS not only outperforms
state-of-the-art methods on open-vocabulary and panoptic segmentation tasks,
but also integrates seamlessly with applications like mesh extraction and scene
editing. Project page: https://ruijiezhu94.github.io/ObjectGS_page
ObjectGS combines 3D scene reconstruction with semantic understanding by modeling individual objects as neural Gaussians, achieving superior performance in segmentation and integration with applications like mesh extraction and scene editing.
Gaussian Splatting object-aware framework neural Gaussians one-hot ID encoding classification loss open-vocabulary segmentation panoptic segmentation mesh extraction scene editing