Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

1,375

Full-text search

Active filters: vllm

hO61qjpwxu/Affine_ghs_2

Text Generation • 22B • Updated 6 days ago • 62

fraseque/llama-3.2-1B-FP8-Neuron

Text Generation • 1B • Updated 2 days ago • 44

willchow66/hierarchical-tool-rl-container

Updated 5 days ago

MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs32-0.01

13B • Updated 4 days ago

MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs32

13B • Updated 4 days ago • 26

nm-testing/Llama4-Maverick-Eagle3-Speculators-64k-vocab

Updated 4 days ago • 32

MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs128

12B • Updated 4 days ago • 16

pegasus912/Jinx-Qwen3-4B-Q8_0-GGUF

Text Generation • 4B • Updated 4 days ago • 20

lightonai/mistral-3.2-instruct-forloras

24B • Updated 3 days ago • 30

mratsim/Wayfarer-Large-70B-NVFP4

Text Generation • 41B • Updated about 4 hours ago • 37

RedHatAI/Llama-3.1-8B-Instruct-NVFP4

Text Generation • 5B • Updated 3 days ago • 14

mratsim/Nova-70B-NVFP4

Text Generation • 41B • Updated about 4 hours ago • 7

mratsim/Anubis-70B-v1.1-NVFP4

Text Generation • 41B • Updated about 4 hours ago • 5

mratsim/L3.3-Ignition-v0.1-70B-NVFP4

Text Generation • 41B • Updated about 4 hours ago • 4

mratsim/GoldDiamondGold-L33-70B-NVFP4

Text Generation • 41B • Updated about 4 hours ago • 11

mratsim/Strawberrylemonade-L3-70B-v1.1-NVFP4

Text Generation • 41B • Updated about 3 hours ago • 7

mratsim/Wayfarer-Large-70B-NVFP4A16

Text Generation • 41B • Updated about 5 hours ago • 25

edouardpeyrot/aitw-mistral

7B • Updated 1 day ago • 17

JeiganS/ML2-123B-Magnum-Diamond_fp8

Text Generation • 123B • Updated 1 day ago • 24

mratsim/Nova-70B-NVFP4A16

Text Generation • 41B • Updated about 4 hours ago

mratsim/Anubis-70B-v1.1-NVFP4A16

Text Generation • 41B • Updated about 4 hours ago

pivotraze/unsloth-Magistral-Small-2509-mlx-mxfp4

Text Generation • 24B • Updated about 4 hours ago

mratsim/GoldDiamondGold-L33-70B-NVFP4A16

Text Generation • 41B • Updated about 4 hours ago

mratsim/L3.3-Ignition-v0.1-70B-NVFP4A16

Text Generation • 41B • Updated about 4 hours ago

mratsim/Strawberrylemonade-L3-70B-v1.1-NVFP4A16

Text Generation • 41B • Updated about 4 hours ago