Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
unsloth
/
gemma-3-12b-it-qat-GGUF
like
31
Follow
Unsloth AI
11k
Image-Text-to-Text
Transformers
GGUF
gemma3
any-to-any
unsloth
gemma
google
conversational
arxiv:
28 papers
License:
gemma
Model card
Files
Files and versions
xet
Community
3
Deploy
Use this model
20d88e1
gemma-3-12b-it-qat-GGUF
184 GB
2 contributors
History:
26 commits
danielhanchen
Add files using upload-large-folder tool
20d88e1
verified
8 months ago
.gitattributes
3.02 kB
Add files using upload-large-folder tool
8 months ago
README.md
Safe
22.8 kB
Add files using upload-large-folder tool
8 months ago
config.json
Safe
1.66 kB
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-BF16.gguf
23.5 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-F32.gguf
Safe
47.1 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-Q2_K.gguf
4.77 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-Q2_K_L.gguf
4.77 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-Q3_K_M.gguf
6.01 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-Q4_0.gguf
8.07 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-Q4_K_M.gguf
7.3 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-Q5_K_M.gguf
8.45 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-Q6_K.gguf
9.66 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-Q8_0.gguf
Safe
12.5 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-IQ1_M.gguf
4.12 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-IQ1_S.gguf
4 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-IQ2_M.gguf
4.72 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-IQ2_XXS.gguf
4.59 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-IQ3_XXS.gguf
5.71 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-IQ4_XS.gguf
Safe
6.59 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-Q2_K_XL.gguf
5.16 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-Q3_K_XL.gguf
6.14 GB
xet
Add files using upload-large-folder tool
8 months ago
gemma-3-12b-it-qat-UD-Q4_K_XL.gguf
7.06 GB
xet
Add files using upload-large-folder tool
8 months ago
imatrix_unsloth.dat
7.43 MB
xet
Add files using upload-large-folder tool
8 months ago
mmproj-BF16.gguf
Safe
854 MB
xet
Add files using upload-large-folder tool
8 months ago
mmproj-F16.gguf
1.68 GB
xet
Add files using upload-large-folder tool
8 months ago
mmproj-F32.gguf
Safe
1.68 GB
xet
Add files using upload-large-folder tool
8 months ago
