cerebras

/

GLM-4.5-Air-REAP-82B-A12B

like 80

Follow

Cerebras 919

@Luisz21 bartowski/cerebras_GLM-4.5-Air-REAP-82B-A12B-GGUF

@Luisz21 bartowski/cerebras_GLM-4.5-Air-REAP-82B-A12B-GGUF

@gghfez wow thank you! Is beyond me how I didn't find it before

Np, I think it wasn't public / visible when you posted

Did an experimental quant of it:
https://huggingface.co/noctrex/GLM-4.5-Air-REAP-82B-A12B-MXFP4_MOE-GGUF
Feel free to try it out and share the experience

Did an experimental quant of it:
https://huggingface.co/noctrex/GLM-4.5-Air-REAP-82B-A12B-MXFP4_MOE-GGUF
Feel free to try it out and share the experience

Hello,

Is it possible for you to create an MXFP4 GGUF quant of this model as well?

https://huggingface.co/cerebras/GLM-4.6-REAP-218B-A32B-FP8

I am really digging the MXFP4 quants, so I wanted to test the quality for this model as well! I will also download your Air quant to test.

Thank you for your hard work!

Did an experimental quant of it:
https://huggingface.co/noctrex/GLM-4.5-Air-REAP-82B-A12B-MXFP4_MOE-GGUF
Feel free to try it out and share the experience

Hello,

Is it possible for you to create an MXFP4 GGUF quant of this model as well?

https://huggingface.co/cerebras/GLM-4.6-REAP-218B-A32B-FP8

I am really digging the MXFP4 quants, so I wanted to test the quality for this model as well! I will also download your Air quant to test.

Thank you for your hard work!

I'll try to quant the 218B one in the following days, internet speeds and diskspace permitting

Thank you so much! Take all the time you need, you are doing amazing work!

@InfernalDread sm54 beat me to it :)
https://huggingface.co/sm54/GLM-4.6-REAP-218B-A32B-MXFP4_MOE

@noctrex

Thanks for letting me know! Will be testing soon!