StrandDesigner: Towards Practical Strand Generation with Sketch Guidance
Realistic hair strand generation is crucial for applications like computer
graphics and virtual reality. While diffusion models can generate hairstyles
from text or images, these inputs lack precision and user-friendliness.
Instead, we propose the first sketch-based strand generation model, which
offers finer control while remaining user-friendly. Our framework tackles key
challenges, such as modeling complex strand interactions and diverse sketch
patterns, through two main innovations: a learnable strand upsampling strategy
that encodes 3D strands into multi-scale latent spaces, and a multi-scale
adaptive conditioning mechanism using a transformer with diffusion heads to
ensure consistency across granularity levels. Experiments on several benchmark
datasets show our method outperforms existing approaches in realism and
precision. Qualitative results further confirm its effectiveness. Code will be
released at [GitHub](https://github.com/fighting-Zhang/StrandDesigner).
68956b8448b0ae5ca2710d91
Na Zhang
68956b8448b0ae5ca2710d92
Moran Li
68956b8448b0ae5ca2710d93
Chengming Xu
68956b8448b0ae5ca2710d94
Han Feng
68956b8448b0ae5ca2710d95
Xiaobin Hu
68956b8448b0ae5ca2710d96
Jiangning Zhang
68956b8448b0ae5ca2710d97
Weijian Cao
68956b8448b0ae5ca2710d98
Chengjie Wang
68956b8448b0ae5ca2710d99
Yanwei Fu
StrandDesigner: Towards Practical Strand Generation with Sketch Guidance
Realistic hair strand generation is crucial for applications like computer
graphics and virtual reality. While diffusion models can generate hairstyles
from text or images, these inputs lack precision and user-friendliness.
Instead, we propose the first sketch-based strand generation model, which
offers finer control while remaining user-friendly. Our framework tackles key
challenges, such as modeling complex strand interactions and diverse sketch
patterns, through two main innovations: a learnable strand upsampling strategy
that encodes 3D strands into multi-scale latent spaces, and a multi-scale
adaptive conditioning mechanism using a transformer with diffusion heads to
ensure consistency across granularity levels. Experiments on several benchmark
datasets show our method outperforms existing approaches in realism and
precision. Qualitative results further confirm its effectiveness. Code will be
released at [GitHub](https://github.com/fighting-Zhang/StrandDesigner).
A sketch-based strand generation model using a learnable upsampling strategy and multi-scale adaptive conditioning mechanism outperforms existing methods in realism and precision for hair strand generation.
diffusion models sketch-based generation learnable strand upsampling multi-scale latent spaces multi-scale adaptive conditioning transformer diffusion heads