imatrix
#3
by
TobDeBer
- opened
Thanks for providing the optimized quantized gguf.
I wonder if there will be an update with imatrix quantization at some point?
They are imatrix quantized!
Thank you for the confirmation.
I was looking at the metadata of UD-Q2_K_XL/Ling-1T-UD-Q2_K_XL-00001-of-00008.gguf.
Didn't see the imatrix entries there.