Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

52

Full-text search

Active filters: w4a16

abdou-u/MNLP_M3_quantized_model

Text Generation • 0.4B • Updated Jun 8 • 6

RedHatAI/gemma-3-4b-it-quantized.w4a16

Image-Text-to-Text • 2B • Updated Jun 9 • 7.13k • 2

RedHatAI/gemma-3-12b-it-quantized.w4a16

Image-Text-to-Text • 4B • Updated Jun 9 • 2.84k • 2

abdou-u/MNLP_M3_quantized_dpo_mcqa_model

Multiple Choice • 0.4B • Updated Jun 8

RedHatAI/gemma-3-1b-it-quantized.w4a16

Text Generation • 0.7B • Updated Jun 6 • 2.86k

adamrb/mpt-30b-chat-w4a16-gptq

4B • Updated Jul 15 • 3

RedHatAI/SmolLM3-3B-quantized.w4a16

0.9B • Updated Jul 31 • 49 • 1

ramblingpolymath/Qwen3-30B-A3B-Instruct-2507-W4A16

Text Generation • 5B • Updated Aug 3 • 535

ramblingpolymath/Qwen3-Coder-30B-A3B-Instruct-W4A16

Text Generation • 5B • Updated Aug 3 • 482 • 2

ramblingpolymath/Qwen3-30B-A3B-Thinking-2507-W4A16

Text Generation • 5B • Updated Aug 3 • 249 • 3

twhitworth/gpt-oss-120b-awq-w4a16

117B • Updated Aug 19 • 1.79k • 15

TheHouseOfTheDude/Behemoth-R1-123B-v2_Compressed-Tensors

Text Generation • Updated Sep 17 • 11

TheHouseOfTheDude/Behemoth-X-123B-v2_Compressed-Tensors

Text Generation • Updated Sep 3 • 53

TheHouseOfTheDude/GLM-Steam-106B-A12B-v1_Compressed-Tensors

Text Generation • Updated Sep 5 • 4

TheHouseOfTheDude/L3.3-Animus-V10.0_Compressed-Tensors

Text Generation • Updated Sep 5 • 2

TheHouseOfTheDude/Behemoth-ReduX-123B-v1_Compressed-Tensors

Text Generation • Updated Sep 17 • 80

TheHouseOfTheDude/Qwen3-Next-80B-A3B-Instruct_Compressed-Tensors

Text Generation • Updated Sep 19 • 25

TheHouseOfTheDude/Fallen-Command-A-111B-v1_Compresses-Tensors

Text Generation • Updated 24 days ago • 7

TheHouseOfTheDude/Behemoth-ReduX-123B-v1.1_Compressed-Tensors

Text Generation • Updated 16 days ago • 17

TheHouseOfTheDude/L3.3-70B-Animus-V12.0_Compressed-Tensors

Text Generation • Updated 14 days ago • 31

ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v1

Text Generation • 357B • Updated 3 days ago • 95

ModelCloud/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 269B • Updated about 8 hours ago