Hugging Face's logo

RedHatAI
/
SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation
Transformers
Safetensors
English
llama
int8
vllm
conversational
text-generation-inference
8-bit precision
compressed-tensors
Model card Files
xet
Community
SmolLM-1.7B-Instruct-quantized.w8a8 / config.json

Commit History

Updated compression_config to quantization_config
b16737d
verified

mgoin commited on

Upload folder using huggingface_hub
fe1f31f
verified

alexmarques commited on