Hugging Face's logo

noctrex
/
Huihui-MoE-12B-A4B-abliterated-MXFP4_MOE-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
Community

This is a MXFP4_MOE quantization of the model Huihui-MoE-12B-A4B-abliterated

Original model: https://huggingface.co/huihui-ai/Huihui-MoE-12B-A4B-abliterated

Downloads last month
28
GGUF
Model size
12B params
Architecture
qwen3moe
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/Huihui-MoE-12B-A4B-abliterated-MXFP4_MOE-GGUF

Base model

Qwen/Qwen3-4B-Base
Finetuned
Qwen/Qwen3-4B
Finetuned
Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v1
Finetuned
huihui-ai/Huihui-MoE-12B-A4B-abliterated
Quantized
(4)
this model

Collection including noctrex/Huihui-MoE-12B-A4B-abliterated-MXFP4_MOE-GGUF