ISTA-DASLab
/

Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

Llama-2-7b-AQLM-2Bit-2x8-hf

2.15 GB

3 contributors

History: 2 commits

Andrei Panferov

everythin

aebd979 almost 2 years ago

.gitattributes

1.52 kB

initial commit almost 2 years ago
config.json

2.5 kB

everythin almost 2 years ago
configuration_llama_aqlm.py

421 Bytes

everythin almost 2 years ago
modeling_llama_aqlm.py

65.5 kB

everythin almost 2 years ago
pytorch_model.bin
Detected Pickle imports (5)
- "torch._utils._rebuild_parameter",
- "torch.CharStorage",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
How to fix it?
2.15 GB
xet

everythin almost 2 years ago