This is a MXFP4_MOE quantization of the model Phi-mini-MoE-instruct
Model quantized with F16 GGUF's from: https://huggingface.co/gabriellarson/Phi-mini-MoE-instruct-GGUF
Original model: https://huggingface.co/microsoft/Phi-mini-MoE-instruct
- Downloads last month
- 77
Hardware compatibility
Log In
to view the estimation
4-bit
Model tree for noctrex/Phi-mini-MoE-instruct-MXFP4_MOE-GGUF
Base model
microsoft/Phi-mini-MoE-instruct