Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Llama-3.2-3B-Instruct-FP8-dynamic
like
3
Follow
Red Hat AI
1.6k
Text Generation
Safetensors
8 languages
llama
fp8
vllm
conversational
compressed-tensors
License:
llama3.2
Model card
Files
Files and versions
xet
Community
main
Llama-3.2-3B-Instruct-FP8-dynamic
/
config.json
Commit History
Updated compression_config to quantization_config
c308a86
verified
mgoin
commited on
Oct 9, 2024
add model
8f9fd99
Eldar Kurtic
commited on
Sep 25, 2024