Intel
/

Qwen3-Next-80B-A3B-Instruct-int4-mixed-AutoRound

Text Generation

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

SGLang: ValueError: Unknown quantization method: auto-round.

#3 opened about 2 months ago by

too slow on cpu

#2 opened about 2 months ago by

AttributeError: 'FusedMoE' object has no attribute 'moe' with latest vllm

#1 opened about 2 months ago by