llama.cpp

LM Studio

Jan

Backyard AI

Draw Things

DiffusionBee

Jellybox

RecurseChat

Msty

Sanctum

Invoke

JoyFusion

LocalAI

vLLM

node-llama-cpp

Ollama

TGI

MLX LM

Docker Model Runner

Lemonade

Groq

Novita

Nebius AI

Cerebras

SambaNova

Nscale

fal

Hyperbolic

Together AI

Fireworks

Featherless AI

Zai

Replicate

Cohere

Scaleway

Public AI

HF Inference API

WaveSpeed

Inference Endpoints

text-generation-inference

Eval Results

Merge

4-bit precision

custom_code

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions