bobchenyx/DeepSeek-V3-0324-508B-A32B-MLA-GGUF

Llamacpp Quantizations of DeepSeek-V3-0324-E192 (MLA version)

This page is going to be deprecated. For other quantized versions, please refer to moxin-org/DeepSeek-V3-0324-Moxin-GGUF for more details.

All quants made based on moxin-org/CC-MoE.

IQ1_S : 103GB (V1)

For V2 Please visit DeepSeek-V3-0324-Moxin-GGUF/V3-Mini-Exp

---

Download Guide

# !pip install huggingface_hub hf_transfer
import os
os.environ["HF_HUB_ENABLE_HF_TRANSFER"] = "1"
from huggingface_hub import snapshot_download
snapshot_download(
    repo_id = "bobchenyx/DeepSeek-V3-0324-508B-A32B-MLA-GGUF",
    local_dir = "bobchenyx/DeepSeek-V3-0324-508B-A32B-MLA-GGUF",
    allow_patterns = ["*IQ1_S*"],
)