geoffmunn
/

Qwen3-8B

Text Generation

Model card Files Files and versions

geoffmunn commited on Sep 21

Commit

9d433f2

·

verified ·

1 Parent(s): ead5d88

Model info updated

Files changed (1) hide show

Qwen3-8B-Q6_K/README.md +2 -2

Qwen3-8B-Q6_K/README.md CHANGED Viewed

@@ -21,7 +21,7 @@ Quantized version of [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B) at **
 ## Model Info
 - **Format**: GGUF (for llama.cpp and compatible runtimes)
-- **Size**: 6.3G
 - **Precision**: Q6_K
 - **Base Model**: [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B)
 - **Conversion Tool**: [llama.cpp](https://github.com/ggerganov/llama.cpp)
@@ -122,7 +122,7 @@ Here’s how you can query this model via API using `curl` and `jq`. Replace the
 ```bash
 curl http://localhost:11434/api/generate -s -N -d '{
-  "model": "hf.co/geoffmunn/Qwen3-8B:Q6_K;2D",
   "prompt": "Repeat the following instruction exactly as given: Explain why the sky appears blue during the day but red at sunrise and sunset, using physics principles like Rayleigh scattering.",
   "temperature": 0.4,
   "top_p": 0.95,

 ## Model Info
 - **Format**: GGUF (for llama.cpp and compatible runtimes)
+- **Size**: 6.73 GB
 - **Precision**: Q6_K
 - **Base Model**: [Qwen/Qwen3-8B](https://huggingface.co/Qwen/Qwen3-8B)
 - **Conversion Tool**: [llama.cpp](https://github.com/ggerganov/llama.cpp)
 ```bash
 curl http://localhost:11434/api/generate -s -N -d '{
+  "model": "hf.co/geoffmunn/Qwen3-8B:Q6_K",
   "prompt": "Repeat the following instruction exactly as given: Explain why the sky appears blue during the day but red at sunrise and sunset, using physics principles like Rayleigh scattering.",
   "temperature": 0.4,
   "top_p": 0.95,