EfficientViT-SAM: Accelerated Segment Anything Model Without Performance
  Loss
We present EfficientViT-SAM, a new family of accelerated segment anything
models. We retain SAM's lightweight prompt encoder and mask decoder while
replacing the heavy image encoder with EfficientViT. For the training, we begin
with the knowledge distillation from the SAM-ViT-H image encoder to
EfficientViT. Subsequently, we conduct end-to-end training on the SA-1B
dataset. Benefiting from EfficientViT's efficiency and capacity,
EfficientViT-SAM delivers 48.9x measured TensorRT speedup on A100 GPU over
SAM-ViT-H without sacrificing performance. Our code and pre-trained models are
released at https://github.com/mit-han-lab/efficientvit.
65c46c7bb25522fdb02754b6
Zhuoyang Zhang
admin_assigned
2024-02-08T11:49:27.882Z
650e6ab08f3228d807707735
https://cdn-avatars.huggingface.co/v1/production/uploads/650e6ab08f3228d807707735/yFo6aLuyGH06t9yG8AOp7.png
Zhuoyang Zhang
user
zhuoyang20
65c46c7bb25522fdb02754b7
Han Cai
admin_assigned
2024-02-08T11:50:01.472Z
650e2b14c945dfc9386a7e28
/avatars/0a9be20aa53f4c52a2d1a8b02d4093ea.svg
Han Cai
user
han-cai
65c46c7bb25522fdb02754b8
Song Han
admin_assigned
2024-02-08T11:50:30.700Z
646320386c27a7e33b23de65
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/NAxll5YVxULmr3G38UzbT.jpeg
Song Han
user
SongHanNo1
EfficientViT-SAM: Accelerated Segment Anything Model Without Performance
  Loss
We present EfficientViT-SAM, a new family of accelerated segment anything
models. We retain SAM's lightweight prompt encoder and mask decoder while
replacing the heavy image encoder with EfficientViT. For the training, we begin
with the knowledge distillation from the SAM-ViT-H image encoder to
EfficientViT. Subsequently, we conduct end-to-end training on the SA-1B
dataset. Benefiting from EfficientViT's efficiency and capacity,
EfficientViT-SAM delivers 48.9x measured TensorRT speedup on A100 GPU over
SAM-ViT-H without sacrificing performance. Our code and pre-trained models are
released at https://github.com/mit-han-lab/efficientvit.
EfficientViT-SAM combines SAM's prompt encoder and mask decoder with EfficientViT as the image encoder, achieving significant speedup without losing performance.
EfficientViT-SAM SAM-ViT-H knowledge distillation end-to-end training SA-1B dataset TensorRT A100 GPU