unsloth
/

gemma-3-12b-it-qat-GGUF

Image-Text-to-Text

Model card Files Files and versions

gemma-3-12b-it-qat-GGUF

191 GB

2 contributors

History: 44 commits

danielhanchen's picture

Upload folder using huggingface_hub

1aecad8 verified 7 months ago

.gitattributes

3.5 kB

Add files using upload-large-folder tool 7 months ago
README.md

22.8 kB

Add files using upload-large-folder tool 7 months ago
config.json

1.66 kB

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-qat-BF16.gguf

23.5 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-IQ4_NL.gguf

6.89 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-IQ4_XS.gguf

6.55 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q2_K.gguf

4.77 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q2_K_L.gguf

4.77 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q3_K_M.gguf

6.01 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q3_K_S.gguf

5.46 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q4_0.gguf

6.91 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q4_1.gguf

7.56 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q4_K_M.gguf

7.3 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q5_K_M.gguf

8.45 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q6_K.gguf

9.66 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-Q8_0.gguf

12.5 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-UD-IQ1_M.gguf

3.25 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-qat-UD-IQ1_S.gguf

3.06 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-qat-UD-IQ2_M.gguf

4.37 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-qat-UD-IQ2_XXS.gguf

3.6 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-UD-IQ3_XXS.gguf

4.83 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-qat-UD-IQ4_XS.gguf

6.59 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-UD-Q2_K_XL.gguf

4.86 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-qat-UD-Q3_K_XL.gguf

6.14 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-qat-UD-Q4_K_XL.gguf

7.43 GB
xet

Upload folder using huggingface_hub 7 months ago
gemma-3-12b-it-qat-UD-Q5_K_XL.gguf

8.46 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-UD-Q6_K_XL.gguf

10.6 GB
xet

Add files using upload-large-folder tool 7 months ago
gemma-3-12b-it-qat-UD-Q8_K_XL.gguf

14.4 GB
xet

Add files using upload-large-folder tool 7 months ago
imatrix_unsloth.dat

7.43 MB
xet

Add files using upload-large-folder tool 7 months ago
mmproj-BF16.gguf

854 MB
xet

Add files using upload-large-folder tool 7 months ago
mmproj-F16.gguf

854 MB
xet

Upload folder using huggingface_hub 7 months ago
mmproj-F32.gguf

1.68 GB
xet

Upload folder using huggingface_hub 7 months ago