This is FLUX.2 [klein] 4B optimized using SDNQ with INT8 dynamic quantization and Hadamard Rotation (Group size: 256).

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SamuelTallet/FLUX.2-klein-4B-SDNQ-8bit-dynamic-hadamard256

Quantized
(22)
this model