ISTA-DASLab
/

Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Model card Files Files and versions

Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16

4.09 GB

3 contributors

History: 10 commits

BlackSamorez's picture

Update tokenizer_config.json

e99ee1b verified over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
README.md

825 Bytes

Update README.md over 1 year ago
config.json

4.34 kB

Uploaded improved version of quantized model over 1 year ago
generation_config.json

126 Bytes

Uploaded Meta-Llama-3-8B-Instruct with AQLM 1x16 quantization over 1 year ago
model.safetensors

4.08 GB
xet

Uploaded improved version of quantized model over 1 year ago
special_tokens_map.json

73 Bytes

Uploaded Meta-Llama-3-8B-Instruct with AQLM 1x16 quantization over 1 year ago
tokenizer.json

9.08 MB

Uploaded Meta-Llama-3-8B-Instruct with AQLM 1x16 quantization over 1 year ago
tokenizer_config.json

51 kB

Update tokenizer_config.json over 1 year ago