unsloth
/

Falcon-H1-1.5B-Deep-Instruct-GGUF

Model card Files Files and versions

Falcon-H1-1.5B-Deep-Instruct-GGUF

25.6 GB

1 contributor

History: 29 commits

danielhanchen's picture

Upload folder using huggingface_hub

36ab03e verified 5 months ago

.gitattributes

2.82 kB

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-BF16.gguf

3.11 GB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-IQ4_NL.gguf

902 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-IQ4_XS.gguf

859 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q2_K.gguf

593 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q2_K_L.gguf

612 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q3_K_M.gguf

755 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q3_K_S.gguf

707 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q4_0.gguf

904 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q4_1.gguf

994 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q4_K_M.gguf

938 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q4_K_S.gguf

906 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q5_K_M.gguf

1.1 GB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q5_K_S.gguf

1.09 GB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q6_K.gguf

1.28 GB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-Q8_0.gguf

1.66 GB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-IQ1_M.gguf

422 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-IQ1_S.gguf

395 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-IQ2_M.gguf

564 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-IQ2_XXS.gguf

470 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-IQ3_XXS.gguf

636 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-Q2_K_XL.gguf

621 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-Q3_K_XL.gguf

775 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-Q4_K_XL.gguf

947 MB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-Q5_K_XL.gguf

1.11 GB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-Q6_K_XL.gguf

1.37 GB
xet

Upload folder using huggingface_hub 5 months ago
Falcon-H1-1.5B-Deep-Instruct-UD-Q8_K_XL.gguf

1.9 GB
xet

Upload folder using huggingface_hub 5 months ago
README.md

5.74 kB

Upload folder using huggingface_hub 5 months ago
imatrix_unsloth.dat

3.47 MB
xet

Upload folder using huggingface_hub 5 months ago