Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
neopolita
/
qwen2.5-3b-instruct-gguf
like
0
GGUF
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
qwen2.5-3b-instruct-gguf
19 GB
1 contributor
History:
9 commits
neopolita
Upload qwen2.5-3b-instruct_q8_0.gguf with huggingface_hub
32e41e5
verified
about 1 year ago
.gitattributes
Safe
1.98 kB
Upload qwen2.5-3b-instruct_q8_0.gguf with huggingface_hub
about 1 year ago
README.md
Safe
1.42 kB
Upload README.md with huggingface_hub
about 1 year ago
ggml-model-f16.gguf
6.18 GB
xet
Upload ggml-model-f16.gguf with huggingface_hub
about 1 year ago
qwen2.5-3b-instruct_q2_k.gguf
1.27 GB
xet
Upload qwen2.5-3b-instruct_q2_k.gguf with huggingface_hub
about 1 year ago
qwen2.5-3b-instruct_q3_k_m.gguf
1.59 GB
xet
Upload qwen2.5-3b-instruct_q3_k_m.gguf with huggingface_hub
about 1 year ago
qwen2.5-3b-instruct_q4_k_m.gguf
1.93 GB
xet
Upload qwen2.5-3b-instruct_q4_k_m.gguf with huggingface_hub
about 1 year ago
qwen2.5-3b-instruct_q5_k_m.gguf
2.22 GB
xet
Upload qwen2.5-3b-instruct_q5_k_m.gguf with huggingface_hub
about 1 year ago
qwen2.5-3b-instruct_q6_k.gguf
2.54 GB
xet
Upload qwen2.5-3b-instruct_q6_k.gguf with huggingface_hub
about 1 year ago
qwen2.5-3b-instruct_q8_0.gguf
3.29 GB
xet
Upload qwen2.5-3b-instruct_q8_0.gguf with huggingface_hub
about 1 year ago