huawei-csl
/

Qwen3-32B-3bit-ASINQ

Text Generation

efficient-inference

Model card Files Files and versions

chiaraboretti commited on 20 days ago

Commit

a1796b0

·

verified ·

1 Parent(s): 1dbb32f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -61,7 +61,7 @@ You can load and use the model with our wrapper based on the 🤗 Transformers l
 from transformers import AutoTokenizer
 from sinq.patch_model import AutoSINQHFModel
-model_name = "huawei-cls/Qwen3-32B-3bit-ASINQ"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 sinq_model = AutoSINQHFModel.from_quantized_safetensors(
     model_name,

 from transformers import AutoTokenizer
 from sinq.patch_model import AutoSINQHFModel
+model_name = "huawei-csl/Qwen3-32B-3bit-ASINQ"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 sinq_model = AutoSINQHFModel.from_quantized_safetensors(
     model_name,