Text Generation
Transformers
GGUF
conversational

imatrix

#3
by TobDeBer - opened

Thanks for providing the optimized quantized gguf.
I wonder if there will be an update with imatrix quantization at some point?

Unsloth AI org

They are imatrix quantized!

Thank you for the confirmation.
I was looking at the metadata of UD-Q2_K_XL/Ling-1T-UD-Q2_K_XL-00001-of-00008.gguf.
Didn't see the imatrix entries there.

Sign up or log in to comment