Edit Models filters

Apps

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

25,778

Full-text search

Active filters: 8-bit

RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Oct 9, 2024 • 3.73k • 2

RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a8

Text Generation • 4B • Updated Oct 9, 2024 • 91

RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8

Text Generation • 14B • Updated Oct 9, 2024 • 16 • 2

RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a8

Text Generation • 2B • Updated Oct 9, 2024 • 298

Xu-Ouyang/pythia-410m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-6.9b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 2B • Updated Aug 17, 2024 • 1

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 2B • Updated Aug 17, 2024

Xu-Ouyang/pythia-6.9b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 2B • Updated Aug 17, 2024

Adeptschneider/dyu_to_fr_v8.0_flan-t5-8bit

0.2B • Updated Jul 12, 2024

Xu-Ouyang/pythia-6.9b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 2B • Updated Aug 17, 2024

Xu-Ouyang/pythia-6.9b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 2B • Updated Aug 17, 2024

nhotin/vistral7B-legalbizai-q8-gguf

Text Generation • 7B • Updated Jul 12, 2024

XelotX/WizardLM-2-8x22B-XelotX-iQuants

Text Generation • 141B • Updated Jul 12, 2024 • 244

RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8

Text Generation • 0.6B • Updated Oct 9, 2024 • 30

RedHatAI/Qwen2-7B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Oct 9, 2024 • 16

PrunaAI/In2Training-FILM-7B-bnb-4bit-smashed

4B • Updated Jul 13, 2024 • 4

Xu-Ouyang/pythia-160m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 99.5M • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-160m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 99.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-160m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 99.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-160m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 99.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-160m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 99.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 22, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 22, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 22, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 22, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 22, 2024 • 1