Hugging Face's logo

noctrex
/
Qwen3-VL-8B-Instruct-GGUF

Image-Text-to-Text
GGUF
conversational
Model card Files
xet
Community

These are quantizations of the model Qwen3-VL-8B-Instruct

Original model: https://huggingface.co/unsloth/Qwen3-VL-8B-Instruct

Download the latest llama.cpp to use them.

Downloads last month
1,367
GGUF
Model size
8B params
Architecture
qwen3vl
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/Qwen3-VL-8B-Instruct-GGUF

Base model

Qwen/Qwen3-VL-8B-Instruct
Quantized
(22)
this model

Collection including noctrex/Qwen3-VL-8B-Instruct-GGUF