-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
huihui-ai/Huihui-GLM-4.6-abliterated-mlx-4bit
Text Generation
•
353B
•
Updated
•
646
•
15
Disty0/Z-Image-Turbo-SDNQ-uint4-svd-r32
Text-to-Image
•
Updated
•
19.2k
•
44
QuantTrio/DeepSeek-V3.2-Speciale-AWQ
Text Generation
•
685B
•
Updated
•
59
•
5
nightmedia/gpt-oss-120b-heretic-v2-mxfp4-q8-hi-mlx
Text Generation
•
117B
•
Updated
•
719
•
6
mlx-community/Llama-3.2-3B-Instruct-4bit
Text Generation
•
0.5B
•
Updated
•
12.7k
•
37
MaziyarPanahi/Ministral-3-3B-Reasoning-2512-GGUF
Text Generation
•
3B
•
Updated
•
29.8k
•
3
huihui-ai/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-mlx-4bit
Text Generation
•
80B
•
Updated
•
88
•
3
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
•
2B
•
Updated
•
198k
•
80
unsloth/Qwen2.5-Coder-7B-bnb-4bit
Text Generation
•
4B
•
Updated
•
14.3k
•
13
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
5B
•
Updated
•
540k
•
40
Intel/DeepSeek-R1-0528-Qwen3-8B-int4-AutoRound
Text Generation
•
2B
•
Updated
•
536
•
6
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit
Text Generation
•
31B
•
Updated
•
143k
•
11
Disty0/FLUX.1-dev-SDNQ-uint4-svd-r32
Text-to-Image
•
Updated
•
194
•
3
Disty0/FLUX.2-dev-SDNQ-uint4-svd-r32
Updated
•
590
•
10
VibeStudio/MiniMax-M2-THRIFT-55-MLX-4bit
106B
•
Updated
•
135
•
2
unsloth/Ministral-3-14B-Base-2512-bnb-4bit
14B
•
Updated
•
144
•
2
QuantTrio/DeepSeek-V3.2-AWQ
Text Generation
•
685B
•
Updated
•
1.48k
•
2
steampunque/Ministral-3-3B-Instruct-2512-Hybrid-GGUF
3B
•
Updated
•
114
•
2
mlx-community/GLM-4.6V-Flash-4bit
Image-Text-to-Text
•
Updated
•
290
•
2
MaziyarPanahi/GLM-4.6V-Flash-GGUF
Text Generation
•
9B
•
Updated
•
3.19k
•
2
mlx-community/GLM-4.6V-4bit
Image-Text-to-Text
•
Updated
•
222
•
2
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
4B
•
Updated
•
47.5k
•
590
TheBloke/vicuna-7B-v1.5-GPTQ
Text Generation
•
1B
•
Updated
•
78
•
17
TheBloke/deepseek-coder-1.3b-instruct-AWQ
Text Generation
•
0.3B
•
Updated
•
111
•
4
jxy/Tongyi-Finance-14B-Chat-Int4
Text Generation
•
Updated
•
12
•
2
TheBloke/saiga_mistral_7b-AWQ
Text Generation
•
1B
•
Updated
•
144
•
4
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
•
6B
•
Updated
•
322k
•
140
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation
•
4B
•
Updated
•
10.8k
•
34
unsloth/mistral-7b-instruct-v0.1-bnb-4bit
Text Generation
•
4B
•
Updated
•
545
•
7
unsloth/llama-3-70b-bnb-4bit
Text Generation
•
37B
•
Updated
•
1.56k
•
47