nvidia/DeepSeek-R1-0528-FP4
Text Generation
•
Updated
•
90.4k
•
37
Inference Optimized Checkpoints (with Model Optimizer)
A collection of generative models quantized and optimized for inference with TensorRT Model Optimizer.
-
-
nvidia/DeepSeek-R1-0528-FP4-v2
Text Generation • 394B • Updated • 43k • 8 -
nvidia/Llama-3.3-70B-Instruct-FP4
41B • Updated • 19.3k • 23 -
nvidia/Llama-3.3-70B-Instruct-FP8
71B • Updated • 49.2k • 8 -
nvidia/Llama-3.1-8B-Instruct-FP4
5B • Updated • 5.16k -
nvidia/Llama-3.1-8B-Instruct-FP8
Text Generation • 8B • Updated • 49.8k • • 30 -
nvidia/Qwen3-235B-A22B-FP4
Text Generation • Updated • 2.49k • 1 -
nvidia/Qwen3-235B-A22B-FP8
Text Generation • Updated • 373 -
nvidia/Qwen3-30B-A3B-FP4
Text Generation • 16B • Updated • 2.6k • 8 -
nvidia/Qwen3-32B-FP4
Text Generation • 17B • Updated • 10.1k • 1 -
nvidia/Qwen3-14B-FP4
Text Generation • 8B • Updated • 2.45k • 2 -
nvidia/Qwen3-14B-FP8
Text Generation • 15B • Updated • 1.02k -
nvidia/Qwen3-8B-FP4
Text Generation • 5B • Updated • 33k • 3 -
nvidia/Qwen3-8B-FP8
Text Generation • 8B • Updated • 2.06k -
nvidia/Llama-3_3-Nemotron-Super-49B-v1_5-FP8
Text Generation • 50B • Updated • 9.66k • 20 -
nvidia/Llama-3_1-Nemotron-Ultra-253B-v1-FP8
Text Generation • 253B • Updated • 233 • 8 -
nvidia/Llama-4-Scout-17B-16E-Instruct-FP4
56B • Updated • 22.2k • 3 -
nvidia/Llama-4-Scout-17B-16E-Instruct-FP8
109B • Updated • 202k • 6 -
nvidia/Llama-4-Maverick-17B-128E-Instruct-FP8
402B • Updated • 1.14k • 9 -
nvidia/Phi-4-reasoning-plus-FP8
15B • Updated • 175k • 1 -
nvidia/Qwen2.5-VL-7B-Instruct-FP4
Text Generation • 5B • Updated • 41.1k • 3 -
black-forest-labs/FLUX.1-dev-onnx
Text-to-Image • Updated • 97 -
nvidia/DeepSeek-R1-FP4
Text Generation • Updated • 8.38k • 265 -
nvidia/DeepSeek-R1-FP4-v2
Text Generation • 394B • Updated • 469 • 3 -
nvidia/DeepSeek-V3-0324-FP4
Text Generation • Updated • 15.8k • 12 -
nvidia/Llama-3_3-Nemotron-Super-49B-v1-FP8
Text Generation • 50B • Updated • 248 • 9 -
nvidia/Llama-3.1-70B-Instruct-FP8
Text Generation • 71B • Updated • 9.99k • • 13 -
nvidia/Llama-3.1-405B-Instruct-FP8
Text Generation • 406B • Updated • 4.07k • 11 -
nvidia/Llama-3.1-405B-Instruct-FP4
230B • Updated • 2.16k • 5 -
nvidia/Phi-4-multimodal-instruct-FP4
4B • Updated • 667 • 4 -
nvidia/Phi-4-multimodal-instruct-FP8
6B • Updated • 411 • 1 -
nvidia/Phi-4-reasoning-plus-FP4
8B • Updated • 347 • 4 -
nvidia/Qwen2.5-VL-7B-Instruct-FP8
Text Generation • 8B • Updated • 516 • 3