Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Llama-3.3-70B-Instruct-quantized.w8a8
like
12
Follow
Red Hat AI
1.6k
Text Generation
Safetensors
8 languages
llama
facebook
meta
llama-3
int8
vllm
chat
neuralmagic
llmcompressor
conversational
8-bit precision
compressed-tensors
8-bit precision
License:
llama3.3
Model card
Files
Files and versions
xet
Community
2
w4a16 variants?
#1
by
cpwan9086
- opened
Feb 28
Discussion
cpwan9086
Feb 28
Are there anything special about the w4a16 variants?
See translation
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
