huihui-ai commited on
Commit
2944347
·
1 Parent(s): d7501ba

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -17,6 +17,23 @@ It was only the text part that was processed, not the image part.
17
 
18
  The abliterated model will no longer say "I can’t describe or analyze this image."
19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20
  ## Chat with Image
21
 
22
  ```
 
17
 
18
  The abliterated model will no longer say "I can’t describe or analyze this image."
19
 
20
+ ## GGUF
21
+
22
+
23
+ [llama.cpp.tr-qwen3-vl-6-b7106-495c611](https://github.com/Thireus/llama.cpp/releases/tag/tr-qwen3-vl-6-b7106-495c611) now supports conversion to GGUF format and can be tested using llama-mtmd-cli.
24
+
25
+ The [GGUF](https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-8B-Thinking-abliterated/tree/main/GGUF) file has been uploaded.
26
+
27
+ ```
28
+ llama-mtmd-cli -m huihui-ai/Huihui-Qwen3-VL-8B-Thinking-abliterated/GGUF/ggml-model-f16.gguf --mmproj huihui-ai/Huihui-Qwen3-VL-8B-Thinking-abliterated/GGUF/mmproj-model-f16.gguf -c 4096 --image png/cc.jpg -p "Describe this image."
29
+ ```
30
+
31
+ If it's just for chatting, you can use llama-cli.
32
+
33
+ ```
34
+ llama-cli -m huihui-ai/Huihui-Qwen3-VL-8B-Thinking-abliterated/GGUF/ggml-model-f16.gguf -c 40960
35
+ ```
36
+
37
  ## Chat with Image
38
 
39
  ```