gg000
/

Cydonia-24B-v4.1-MLX-mixed-4bit

Text Generation

4-bit precision

Model card Files Files and versions

gg000/Cydonia-24B-v4.1-MLX-mixed-4bit

Primarily 4bit, with some 6bit weights. Equivalent to Q4_K_M.

This model gg000/Cydonia-24B-v4.1-MLX-mixed-4bit was converted to MLX format from TheDrummer/Cydonia-24B-v4.1 using mlx-lm version 0.27.1.

Downloads last month: 4

Safetensors

Model size

24B params

Tensor type

BF16

·

U32

·

Model tree for gg000/Cydonia-24B-v4.1-MLX-mixed-4bit

Base model

TheDrummer/Cydonia-24B-v4.1

Quantized

(18)

this model