Qwen2.5-72B-Instruct-FP8 / requirements.txt
FINGU-AI's picture
Update requirements.txt
d6e3682 verified
raw
history blame
170 Bytes
torch==2.1.0+cu118
transformers==4.37
vllm @ https://github.com/vllm-project/vllm/releases/download/v0.6.1.post1/vllm-v0.6.1.post1+cu118-cp310-cp310-manylinux1_x86_64.whl