-
-
-
-
-
-
Inference Providers
Active filters:
awq
openbmb/MiniCPM-o-4_5-awq
Any-to-Any
•
9B
•
Updated
•
557
•
11
mratsim/MiniMax-M2.1-FP8-INT4-AWQ
Text Generation
•
39B
•
Updated
•
5.72k
•
35
bullpoint/Qwen3-Coder-Next-AWQ-4bit
Text Generation
•
14B
•
Updated
•
22.8k
•
3
Text Generation
•
2B
•
Updated
•
28
•
13
Text Generation
•
358B
•
Updated
•
20.1k
•
24
casperhansen/tinyllama-1b-awq
Text Generation
•
Updated
•
67
•
1
TheBloke/TinyLlama-1.1B-Chat-v0.3-AWQ
Text Generation
•
1B
•
Updated
•
75.7k
•
4
TheBloke/deepseek-coder-1.3b-instruct-AWQ
Text Generation
•
1B
•
Updated
•
256
•
5
Text Generation
•
7B
•
Updated
•
2.73k
•
4
TechxGenus/DeepSeek-Coder-V2-Lite-Instruct-AWQ
Text Generation
•
16B
•
Updated
•
3.85k
•
8
TechxGenus/DeepSeek-Coder-V2-Lite-Base-AWQ
Text Generation
•
16B
•
Updated
•
12
•
3
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
•
8B
•
Updated
•
480k
•
86
Qwen/Qwen2.5-32B-Instruct-AWQ
Text Generation
•
33B
•
Updated
•
876k
•
91
Qwen/Qwen2.5-Coder-32B-Instruct-AWQ
Text Generation
•
33B
•
Updated
•
473k
•
33
Qwen/Qwen2.5-Coder-14B-Instruct-AWQ
Text Generation
•
15B
•
Updated
•
43.1k
•
14
casperhansen/llama-3.3-70b-instruct-awq
Text Generation
•
71B
•
Updated
•
194k
•
37
kosbu/Llama-3.3-70B-Instruct-AWQ
Text Generation
•
71B
•
Updated
•
446k
•
10
Qwen/Qwen2.5-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
8B
•
Updated
•
757k
•
99
Text Generation
•
15B
•
Updated
•
927k
•
54
Text Generation
•
4B
•
Updated
•
99.2k
•
23
twhitworth/gpt-oss-120b-awq-w4a16
117B
•
Updated
•
8.05k
•
21
openbmb/MiniCPM-V-4_5-AWQ
Image-Text-to-Text
•
9B
•
Updated
•
3.35k
•
12
QuantTrio/Qwen3-VL-32B-Thinking-AWQ
Image-Text-to-Text
•
33B
•
Updated
•
887
•
5
QuantTrio/DeepSeek-V3.2-AWQ
Text Generation
•
685B
•
Updated
•
40.4k
•
11
QuantTrio/GLM-4.7-Flash-AWQ
Text Generation
•
31B
•
Updated
•
101k
•
4
casperhansen/mpt-7b-8k-chat-awq
Text Generation
•
Updated
•
8
•
3
casperhansen/falcon-7b-awq
Text Generation
•
Updated
•
9
•
1
casperhansen/vicuna-7b-v1.5-awq
Text Generation
•
Updated
•
7
•
3
casperhansen/vicuna-7b-v1.5-awq-gemv
Text Generation
•
Updated
•
6
•
1
casperhansen/mpt-7b-8k-chat-awq-gemv
Text Generation
•
Updated
•
6