Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

375

Base only

Active filters: compression

unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF

Text Generation • 23B • Updated Jan 28 • 18.3k • 227

apple/CLaRa-7B-Instruct

Updated Dec 11, 2025 • 181

Pieces/embeddinggemma-300m-distilled-depth10pct-10-768dim-best

Feature Extraction • 28.4M • Updated Dec 22, 2025 • 5 • 1

huawei-csl/Qwen3-4B-PreSINQ-GGUF

Text Generation • 4B • Updated Feb 10 • 44 • 6

samuelfaj/distill-1.7B-MLX

Text Generation • 2B • Updated about 1 month ago • 108 • 1

RedHatAI/oBERT-teacher-squadv1

Updated Jul 31, 2022 • 21

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-squadv1

Updated Jul 31, 2022 • 12

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-squadv1

Updated Jul 31, 2022 • 12

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-squadv1

Updated Jul 31, 2022 • 4

RedHatAI/oBERT-teacher-mnli

Updated Jul 31, 2022 • 8

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-mnli

Updated Jul 31, 2022 • 12

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-mnli

Updated Jul 31, 2022 • 10

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-mnli

Updated Jul 31, 2022 • 4

RedHatAI/oBERT-teacher-qqp

Updated Jul 31, 2022 • 4

RedHatAI/oBERT-12-downstream-pruned-unstructured-80-qqp

Updated Jul 31, 2022 • 3

RedHatAI/oBERT-12-downstream-pruned-unstructured-90-qqp

Updated Jul 31, 2022 • 10

RedHatAI/oBERT-12-downstream-pruned-unstructured-97-qqp

Updated Jul 31, 2022 • 3

RedHatAI/oBERT-12-upstream-pretrained-dense

Updated Jul 31, 2022 • 3

RedHatAI/oBERT-6-upstream-pretrained-dense

Updated Jul 31, 2022 • 2

RedHatAI/oBERT-3-upstream-pretrained-dense

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pruned-unstructured-90

Updated Jul 31, 2022 • 10

RedHatAI/oBERT-12-upstream-pruned-unstructured-97

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-squadv1

Updated Jul 31, 2022 • 7

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-squadv1

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-mnli

Updated Jul 31, 2022 • 3

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-mnli

Updated Jul 31, 2022 • 4

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-qqp

Updated Jul 31, 2022 • 3

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-qqp

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-downstream-dense-squadv1

Updated Jul 31, 2022 • 6

RedHatAI/oBERT-12-downstream-pruned-block4-80-squadv1

Updated Jul 31, 2022 • 2