fbaldassarri
/

HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int4-gs128-asym

Text Generation

Transformers.js

text-generation-inference

4-bit precision

intel/auto-round

Model card Files Files and versions

fbaldassarri commited on Jan 4

Commit

b09106d

·

verified ·

1 Parent(s): 76fd0f6

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -30,7 +30,7 @@ quantized_by: fbaldassarri
 ## Model Information
-Quantized version of [HuggingFaceTB/SmolLM2-1.7B-Instruct](HuggingFaceTB/SmolLM2-1.7B-Instruct) using torch.float32 for quantization tuning.
 - 4 bits (INT4)
 - group size = 128
 - Asymmetrical Quantization

 ## Model Information
+Quantized version of [HuggingFaceTB/SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) using torch.float32 for quantization tuning.
 - 4 bits (INT4)
 - group size = 128
 - Asymmetrical Quantization