AnyUp: Universal Feature Upsampling
We introduce AnyUp, a method for feature upsampling that can be applied to
any vision feature at any resolution, without encoder-specific training.
Existing learning-based upsamplers for features like DINO or CLIP need to be
re-trained for every feature extractor and thus do not generalize to different
feature types at inference time. In this work, we propose an inference-time
feature-agnostic upsampling architecture to alleviate this limitation and
improve upsampling quality. In our experiments, AnyUp sets a new state of the
art for upsampled features, generalizes to different feature types, and
preserves feature semantics while being efficient and easy to apply to a wide
range of downstream tasks.
68f25feb37ed56c2c926f902
Thomas Wimmer
claimed_verified
2025-10-18T04:47:49.655Z
638a2350d8e0b272508e6227
/avatars/83d6090eb16530b51941aa94cd51be3c.svg
Thomas Wimmer
user
wimmerth
68f25feb37ed56c2c926f903
Prune Truong
68f25feb37ed56c2c926f904
Marie-Julie Rakotosaona
68f25feb37ed56c2c926f905
Michael Oechsle
68f25feb37ed56c2c926f906
Federico Tombari
68f25feb37ed56c2c926f907
Bernt Schiele
68f25feb37ed56c2c926f908
Jan Eric Lenssen
AnyUp: Universal Feature Upsampling
We introduce AnyUp, a method for feature upsampling that can be applied to
any vision feature at any resolution, without encoder-specific training.
Existing learning-based upsamplers for features like DINO or CLIP need to be
re-trained for every feature extractor and thus do not generalize to different
feature types at inference time. In this work, we propose an inference-time
feature-agnostic upsampling architecture to alleviate this limitation and
improve upsampling quality. In our experiments, AnyUp sets a new state of the
art for upsampled features, generalizes to different feature types, and
preserves feature semantics while being efficient and easy to apply to a wide
range of downstream tasks.
AnyUp is a feature-agnostic upsampling method that generalizes across different vision features and resolutions without requiring re-training.
feature upsampling vision feature inference-time feature-agnostic upsampling architecture DINO CLIP feature extractor feature semantics downstream tasks