6.0bpw EXL3 Quant of BruhzWater/Sapphira-L3.3-70b-0.1

6.0bpw H6 EXL3 quant of BruhzWater/Sapphira-L3.3-70b-0.1 using exllamav3 for quantization.

Downloads last month
6
Safetensors
Model size
27B params
Tensor type
F16
·
I16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kernalkue/Sapphira-L3.3-70b-0.1-exl3-6.0bpw-h6

Quantized
(8)
this model