Qwen
/

Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

vllm implementation

#9 opened 5 months ago by

AWQ quantization script to Qwen-VL-2.5 7B model

#8 opened 6 months ago by

Necessary transformers version

#7 opened 6 months ago by

lm head in the trained model is not in AWQ format

#6 opened 7 months ago by

pooya-mohammadi

111

#5 opened 7 months ago by

Is AWQ quantization applied only to the anguage model of this model?

#4 opened 7 months ago by

License clarification

#3 opened 7 months ago by

ValerianGuillot

Empty output when using Qwen2.5-VL-7B-Instruct-AWQ example code from README

#2 opened 7 months ago by

Add link to paper and code

#1 opened 9 months ago by