OmniPart: Part-Aware 3D Generation with Semantic Decoupling and
  Structural Cohesion
The creation of 3D assets with explicit, editable part structures is crucial
for advancing interactive applications, yet most generative methods produce
only monolithic shapes, limiting their utility. We introduce OmniPart, a novel
framework for part-aware 3D object generation designed to achieve high semantic
decoupling among components while maintaining robust structural cohesion.
OmniPart uniquely decouples this complex task into two synergistic stages: (1)
an autoregressive structure planning module generates a controllable,
variable-length sequence of 3D part bounding boxes, critically guided by
flexible 2D part masks that allow for intuitive control over part decomposition
without requiring direct correspondences or semantic labels; and (2) a
spatially-conditioned rectified flow model, efficiently adapted from a
pre-trained holistic 3D generator, synthesizes all 3D parts simultaneously and
consistently within the planned layout. Our approach supports user-defined part
granularity, precise localization, and enables diverse downstream applications.
Extensive experiments demonstrate that OmniPart achieves state-of-the-art
performance, paving the way for more interpretable, editable, and versatile 3D
content.
686ddd5ccb5725779c60b430
Yunhan Yang
686ddd5ccb5725779c60b431
Yufan Zhou
claimed_verified
2025-07-11T08:03:49.175Z
65b79f1f9ce658d5b2841ba0
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/RzEW1ytRsjAKWdmOYsrRb.jpeg
WiserZhou
user
WiserZhou
686ddd5ccb5725779c60b432
Yuan-Chen Guo
686ddd5ccb5725779c60b433
Zi-Xin Zou
686ddd5ccb5725779c60b434
Yukun Huang
claimed_verified
2025-07-10T13:14:40.292Z
638ee900ee7e45e0474a5712
https://cdn-avatars.huggingface.co/v1/production/uploads/638ee900ee7e45e0474a5712/KLli_eCbWwffKR7oLDmV3.jpeg
Yukun Huang
user
KevinHuang
686ddd5ccb5725779c60b435
Ying-Tian Liu
686ddd5ccb5725779c60b436
Hao Xu
claimed_verified
2025-07-11T13:12:45.517Z
6490148563a79cb3e72336c3
/avatars/1effb5f0817288b42a129ff1ddacef45.svg
Hao Xu
user
xh38
686ddd5ccb5725779c60b437
Ding Liang
686ddd5ccb5725779c60b438
Yan-Pei Cao
686ddd5ccb5725779c60b439
Xihui Liu
OmniPart: Part-Aware 3D Generation with Semantic Decoupling and
  Structural Cohesion
The creation of 3D assets with explicit, editable part structures is crucial
for advancing interactive applications, yet most generative methods produce
only monolithic shapes, limiting their utility. We introduce OmniPart, a novel
framework for part-aware 3D object generation designed to achieve high semantic
decoupling among components while maintaining robust structural cohesion.
OmniPart uniquely decouples this complex task into two synergistic stages: (1)
an autoregressive structure planning module generates a controllable,
variable-length sequence of 3D part bounding boxes, critically guided by
flexible 2D part masks that allow for intuitive control over part decomposition
without requiring direct correspondences or semantic labels; and (2) a
spatially-conditioned rectified flow model, efficiently adapted from a
pre-trained holistic 3D generator, synthesizes all 3D parts simultaneously and
consistently within the planned layout. Our approach supports user-defined part
granularity, precise localization, and enables diverse downstream applications.
Extensive experiments demonstrate that OmniPart achieves state-of-the-art
performance, paving the way for more interpretable, editable, and versatile 3D
content.
OmniPart generates part-aware 3D objects with high semantic decoupling and structural cohesion using an autoregressive structure planning module and a spatially-conditioned rectified flow model.
autoregressive structure planning module 3D part bounding boxes 2D part masks spatially-conditioned rectified flow model holistic 3D generator