3D-OTT: Texture Transfer for 3D Objects from a Single Reference Image
Xiao Cao, Beibei Lin, Bo Wang, Zhiyong Huang, Robby Tan
Image-based 3D texture transfer from a single 2D reference image enables practical customization of 3D object appearances with minimal manual effort.Adapted 2D editing and text-driven 3D editing approaches can serve this purpose. However, 2D editing typically involves frame-by-frame manipulation, often resulting in inconsistencies across views, while text-driven 3D editing struggles to preserve texture characteristics from reference images.To tackle these challenges, we introduce 3D-OTT, a 3D Object Texture Transfer method based on a single reference image, integrating: 1) progressive generation, 2) view-consistency gradient guidance, and 3) prompt-tuned gradient guidance.To ensure view consistency, progressive generation starts by transferring texture from the reference image and gradually propagates it to adjacent views.View-consistency gradient guidance further reinforces coherence by conditioning the generation model on feature differences between consistent and inconsistent outputs.To preserve texture characteristics, prompt-tuning-based gradient guidance learns a token that describes differences between original and reference textures, guiding the transfer for faithful texture preservation across views.Overall, 3D-OTT combines these strategies to achieve effective texture transfer while maintaining structural coherence across viewpoints.Extensive qualitative and quantitative evaluations confirm that our three components enable convincing and effective 2D-to-3D texture transfer. Code will be available upon acceptance.