Edit Models filters

Apps

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

25,541

Full-text search

Active filters: 8-bit

smokxy/agri_bert_classifier_quantized

Text Classification • 0.1B • Updated Jul 14, 2024

RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Oct 9, 2024 • 4

smokxy/roberta-base-squad2-quantized

Question Answering • 0.1B • Updated Aug 5, 2024 • 1

Aung2024/labour_law

Text Generation • 0.7B • Updated Jul 18, 2024

dphn/dolphin-2.9.2-qwen2-72b-eetq

Text Generation • 73B • Updated Jul 15, 2024 • 1 • 1

HRuiii/Llama-2-7b-GPTQ-8bit

Text Generation • Updated Jul 15, 2024

Ksgk-fy/maria_v113_gptq_prompt

Text Generation • 3B • Updated Jul 15, 2024

RedHatAI/Qwen2-72B-Instruct-quantized.w8a8

Text Generation • 73B • Updated Oct 9, 2024 • 6 • 1

FuturisticVibes/Llama-3-Chatty-2x8B-8.0bpw-h8-exl2

Text Generation • Updated Jul 16, 2024

FuturisticVibes/Nous-Hermes-2-Mixtral-8x7B-DPO-8.0bpw-h8-exl2

Text Generation • Updated Jul 16, 2024

FuturisticVibes/Nous-Hermes-2-Mixtral-8x7B-SFT-8.0bpw-h8-exl2

Text Generation • Updated Jul 16, 2024

MaziyarPanahi/mathstral-7B-v0.1-GGUF

Text Generation • 7B • Updated Jul 16, 2024 • 74.5k • 7

bullerwins/mathstral-7B-v0.1-exl2_8.0bpw

Text Generation • Updated Jul 16, 2024 • 5

iaincambeul/mistral-7b-instruct-v0.2-imp-fm-exp

Updated Jul 16, 2024

Toby0830/internlm2_5-7b-chat-1m-gptq-8bits

Feature Extraction • 3B • Updated Jul 16, 2024 • 1

amgadhasan/NeuralDaredevil-7B-exl2-8bpw

Text Generation • Updated Jul 16, 2024 • 2

Xu-Ouyang/pythia-70m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-70m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-70m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024

Xu-Ouyang/pythia-70m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-70m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 56.5M • Updated Aug 16, 2024 • 1

userdata/whisper-largeV2-03-ms-v11-LORA-Merged

Automatic Speech Recognition • 2B • Updated Jul 17, 2024

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 136 • 7

abhinayadutta/deepseek-coder-1.3b-base-int8-Scala-codegen

Text Generation • 1B • Updated Jul 17, 2024

Shaleen123/yi-1.5-9b-maths

Text Generation • 9B • Updated Jul 17, 2024

MaziyarPanahi/Llama-3-Groq-70B-Tool-Use-GGUF

Text Generation • 71B • Updated Jul 17, 2024 • 48 • 5

aryamannningombam/llama-3-GPTQ_g64-8bits

Text Generation • 3B • Updated Jul 17, 2024

AminBH/Llama-3-8B-GPTQ-wiki-8bit

Text Generation • 3B • Updated Jul 17, 2024

Xu-Ouyang/pythia-14m-int8-step36000-GPTQ-wikitext2

Text Generation • 13.2M • Updated Jul 17, 2024 • 1

Xu-Ouyang/pythia-14m-int8-step71000-GPTQ-wikitext2

Text Generation • 13.2M • Updated Jul 17, 2024