Inference Providers
Active filters: 4bit
mlx-community/Qwen3.5-9B-MLX-4bit
2B • Updated • 103k
• 60
Sepolian/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M
Text Generation
• 27B • Updated • 1.8k
• 11
0xSero/GLM-4.7-REAP-218B-A32B-W4A16
Text Generation
• 2B • Updated • 246
• 24
bullpoint/Qwen3-Coder-Next-AWQ-4bit
Text Generation
• 14B • Updated • 1M
• 19
0xSero/GLM-4.7-REAP-50-W4A16
Text Generation
• 2B • Updated • 149
• 69
mlx-community/Qwen3.5-0.8B-OptiQ-4bit
Text Generation
• 0.2B • Updated • 2.84k
• 5
legraphista/glm-4-9b-chat-GGUF
Text Generation
• 9B • Updated • 9.89k
• 21
0xSero/GLM-4.6-REAP-218B-A32B-W4A16-AutoRound
Text Generation
• 2B • Updated • 132
• 8
smkrv/Qwen3-0.6B-CoreML-4bit
Text Generation
• Updated • 34
• 2
0xSero/GLM-4.7-REAP-40-W4A16
Text Generation
• 2B • Updated • 49
• 7
unsloth/Z-Image-Turbo-unsloth-bnb-4bit
Text-to-Image
• Updated • 696
• 4
RunPod/FLUX.2-klein-4B-mflux-4bit
Text-to-Image
• Updated • 2
mlx-community/Qwen3.5-4B-MLX-4bit
1.0B • Updated • 30.5k
• 11
mlx-community/Qwen3.5-2B-OptiQ-4bit
Text Generation
• 0.4B • Updated • 3.85k
• 2
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation
• 0.8B • Updated • 5.11k
• 8
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 6.66k
• 13
Text Generation
• Updated • 49
• 1
Chun121/Qwen3-4B-RPG-Roleplay-V2
Text Generation
• 4B • Updated • 10.4k
• 43
mayaeary/pygmalion-6b-4bit-128g
Text Generation
• Updated • 24
• 40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
• Updated • 20
• 121
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
• Updated • 11
• 2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
• Updated • 3
• 2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
• Updated • 10
• 5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
• Updated • 33
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
• Updated • 6
• 1
4bit/pygmalion-6b-4bit-128g
Text Generation
• Updated • 4
• 3
Text Generation
• Updated • 7
• 1
seonglae/opt-125m-4bit-gptq
Text Generation
• Updated • 25
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
• Updated • 1
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
• Updated • 6