medmekk HF Staff commited on
Commit
1760ed9
·
verified ·
1 Parent(s): ea89f19

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -1,6 +1,8 @@
1
  ---
2
  base_model:
3
  - medmekk/Llama-3.2-1B-ao-int8wo
 
 
4
  ---
5
  # medmekk/Llama-3.2-1B-ao-int8wo (Quantized)
6
 
@@ -13,3 +15,19 @@ It's quantized using the TorchAO library using the [torchao-my-repo](https://hug
13
  - **Quantization Type**: int8_weight_only
14
  - **Group Size**: None
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  base_model:
3
  - medmekk/Llama-3.2-1B-ao-int8wo
4
+ tags:
5
+ - torchao-my-repo
6
  ---
7
  # medmekk/Llama-3.2-1B-ao-int8wo (Quantized)
8
 
 
15
  - **Quantization Type**: int8_weight_only
16
  - **Group Size**: None
17
 
18
+
19
+
20
+ # 📄 Original Model Information
21
+
22
+
23
+ # medmekk/Llama-3.2-1B-ao-int8wo (Quantized)
24
+
25
+ ## Description
26
+ This model is a quantized version of the original model [`medmekk/Llama-3.2-1B-ao-int8wo`](https://huggingface.co/medmekk/Llama-3.2-1B-ao-int8wo).
27
+
28
+ It's quantized using the TorchAO library using the [torchao-my-repo](https://huggingface.co/spaces/pytorch/torchao-my-repo) space.
29
+
30
+ ## Quantization Details
31
+ - **Quantization Type**: int8_weight_only
32
+ - **Group Size**: None
33
+