Hugging Face's logo

kishizaki-sci
/
Llama-3.1-405B-Instruct-AWQ-4bit-JP-EN

Text Generation
Transformers
Safetensors
PyTorch
Japanese
English
llama
llama-3
llama-3.1
autoawq
meta
conversational
text-generation-inference
4-bit precision
awq
Model card Files
xet
Community
Llama-3.1-405B-Instruct-AWQ-4bit-JP-EN / inference_vLLM.ipynb

Commit History

Upload inference_vLLM.ipynb
e74261e
verified

kishizaki-sci commited on