RedHatAI
/

Qwen2-0.5B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Qwen2-0.5B-Instruct-quantized.w4a16 / hellaswag-vllm

7.51 kB

2 contributors

History: 1 commit

abhinavnmagic's picture

Upload folder using huggingface_hub

4599b25 verified over 1 year ago

__cache__abhinav__models__Phase1__gptq-Qwen__Qwen2-0.5B-Instruct-garage-bAInd__Open-Platypus-mse-damp0.01-ns512-seqlen4K
Upload folder using huggingface_hub over 1 year ago