Image Sculpting: Precise Object Editing with 3D Geometry Control
We present Image Sculpting, a new framework for editing 2D images by
incorporating tools from 3D geometry and graphics. This approach differs
markedly from existing methods, which are confined to 2D spaces and typically
rely on textual instructions, leading to ambiguity and limited control. Image
Sculpting converts 2D objects into 3D, enabling direct interaction with their
3D geometry. Post-editing, these objects are re-rendered into 2D, merging into
the original image to produce high-fidelity results through a coarse-to-fine
enhancement process. The framework supports precise, quantifiable, and
physically-plausible editing options such as pose editing, rotation,
translation, 3D composition, carving, and serial addition. It marks an initial
step towards combining the creative freedom of generative models with the
precision of graphics pipelines.
65961c518bd8ed3949c44980
Jiraphon Yenphraphai
claimed_verified
2024-01-22T10:31:43.883Z
63daa44df03c3d71ef33da2d
/avatars/3193967d40b82a7d678b58a8e4d0ec1a.svg
Jiraphon Yenphraphai
user
domejiraphon
65961c518bd8ed3949c44981
Xichen Pan
claimed_verified
2024-01-17T21:18:06.834Z
63172831c92fd6fee3181f50
/avatars/0f57068a138cb181e9451bfc1ed3d1c0.svg
Xichen Pan
user
xcpan
65961c518bd8ed3949c44982
Sainan Liu
65961c518bd8ed3949c44983
Daniele Panozzo
65961c518bd8ed3949c44984
Saining Xie
Image Sculpting: Precise Object Editing with 3D Geometry Control
We present Image Sculpting, a new framework for editing 2D images by
incorporating tools from 3D geometry and graphics. This approach differs
markedly from existing methods, which are confined to 2D spaces and typically
rely on textual instructions, leading to ambiguity and limited control. Image
Sculpting converts 2D objects into 3D, enabling direct interaction with their
3D geometry. Post-editing, these objects are re-rendered into 2D, merging into
the original image to produce high-fidelity results through a coarse-to-fine
enhancement process. The framework supports precise, quantifiable, and
physically-plausible editing options such as pose editing, rotation,
translation, 3D composition, carving, and serial addition. It marks an initial
step towards combining the creative freedom of generative models with the
precision of graphics pipelines.
Image Sculpting integrates 3D geometry and graphics for precise 2D image editing, offering high-fidelity results through a conversion to 3D and re-rendering process.
3D geometry graphics 2D images pose editing rotation translation 3D composition carving serial addition generative models graphics pipelines