Hugging Face's logo

huggingkot
/
Llama-3.1-Nemotron-Nano-8B-v1-q4f16_1-MLC

Text Generation
MLC-LLM
English
web-llm
Model card Files
xet
Community

This is a MLC converted weight from Llama-3.1-Nemotron-Nano-8B-v1 model in MLC format q4f16_1.

The model can be used for projects MLC-LLM and WebLLM.

Downloads last month
-
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for huggingkot/Llama-3.1-Nemotron-Nano-8B-v1-q4f16_1-MLC

Base model

nvidia/Llama-3.1-Nemotron-Nano-8B-v1
Quantized
(29)
this model

Collection including huggingkot/Llama-3.1-Nemotron-Nano-8B-v1-q4f16_1-MLC