olegshulyakov's picture
Create README.md
4b86b6f verified
metadata
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B/blob/main/LICENSE
language:
  - en
base_model:
  - Qwen/Qwen2.5-Coder-1.5B
pipeline_tag: text-generation
library_name: transformers
tags:
  - code
  - qwen
  - qwen-coder
  - codeqwen

Qwen2.5-Coder-1.5B

Model creator: Qwen
Original model: Qwen/Qwen2.5-Coder-1.5B
GGUF quantization: provided by olegshulyakov using llama.cpp

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/olegshulyakov/Qwen2.5-Coder-1.5B-GGUF:Q5_K_M"

Use with LM Studio

lms load "olegshulyakov/Qwen2.5-Coder-1.5B-GGUF"

Use with llama.cpp CLI

llama-cli --hf "olegshulyakov/Qwen2.5-Coder-1.5B-GGUF:Q5_K_M" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf "olegshulyakov/Qwen2.5-Coder-1.5B-GGUF:Q5_K_M" -c 4096