Qwen
/

Qwen3-Next-80B-A3B-Instruct

Text Generation

Model card Files Files and versions

Plan for AWQ?

#8

by hyunw55 - opened Sep 12

hyunw55

Sep 12

Do you have any plans to support awq format?

Sep 12

+1, as llama.cpp support could take a while

wekW

Sep 13

https://huggingface.co/unsloth/Qwen3-Next-80B-A3B-Instruct-bnb-4bit

4 days ago

同问，什么时候可以出官方AWQ量化版本呢？目前手头的卡均不支持FP8

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment