Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection
Keypoint detection, integral to modern machine perception, faces challenges
in few-shot learning, particularly when source data from the same distribution
as the query is unavailable. This gap is addressed by leveraging sketches, a
popular form of human expression, providing a source-free alternative. However,
challenges arise in mastering cross-modal embeddings and handling user-specific
sketch styles. Our proposed framework overcomes these hurdles with a
prototypical setup, combined with a grid-based locator and prototypical domain
adaptation. We also demonstrate success in few-shot convergence across novel
keypoints and classes through extensive experiments.
6875a70c257d4f0435370513
Subhajit Maity
claimed_verified
2025-07-15T19:09:47.164Z
66d5279130d7ea0b28d6d5d2
https://cdn-avatars.huggingface.co/v1/production/uploads/66d5279130d7ea0b28d6d5d2/oGFmux--lARBF4PKSkHAu.png
Subhajit Maity
user
maitysubhajit
6875a70c257d4f0435370514
Ayan Kumar Bhunia
6875a70c257d4f0435370515
Subhadeep Koley
6875a70c257d4f0435370516
Pinaki Nath Chowdhury
6875a70c257d4f0435370517
Aneeshan Sain
6875a70c257d4f0435370518
Yi-Zhe Song
Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection
Keypoint detection, integral to modern machine perception, faces challenges
in few-shot learning, particularly when source data from the same distribution
as the query is unavailable. This gap is addressed by leveraging sketches, a
popular form of human expression, providing a source-free alternative. However,
challenges arise in mastering cross-modal embeddings and handling user-specific
sketch styles. Our proposed framework overcomes these hurdles with a
prototypical setup, combined with a grid-based locator and prototypical domain
adaptation. We also demonstrate success in few-shot convergence across novel
keypoints and classes through extensive experiments.
A framework using sketches and prototypical setup addresses few-shot keypoint detection challenges by leveraging cross-modal embeddings and domain adaptation.
keypoint detection few-shot learning sketches cross-modal embeddings prototypical setup grid-based locator prototypical domain adaptation