Inference Providers
Active filters: 5-bit
MaziyarPanahi/Nemotron-Orchestrator-8B-GGUF
Text Generation
• 8B • Updated • 59.6k
• 6
MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF
Text Generation
• 1B • Updated • 86.6k
• 19
MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF
Text Generation
• 3B • Updated • 85.8k
• 15
MaziyarPanahi/Llama-3.2-3B-bf16-GGUF
Text Generation
• 3B • Updated • 191
• 2
roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF
Text Generation
• 8B • Updated • 630
• 2
MaziyarPanahi/Phi-4-mini-instruct-GGUF
Text Generation
• 4B • Updated • 91.6k
• 12
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-5bit
Text Generation
• 31B • Updated • 210k
• 7
MaziyarPanahi/VibeThinker-1.5B-GGUF
Text Generation
• 2B • Updated • 421
• 36
MaziyarPanahi/Ministral-3-8B-Reasoning-2512-GGUF
Text Generation
• 8B • Updated • 178
• 2
MaziyarPanahi/GLM-4.6V-Flash-GGUF
Text Generation
• 9B • Updated • 60.6k
• 5
BlueMoonlight/DeepSeek-R1-Distill-Qwen-14B-mlx-5Bit
Text Generation
• 15B • Updated • 582
• 1
inferencerlabs/Qwen3-Coder-Next-MLX-5.5bit
Text Generation
• 80B • Updated • 420
• 2
LiquidAI/LFM2.5-350M-MLX-5bit
Text Generation
• 66.5M • Updated • 274
• 3
LiquidAI/LFM2.5-VL-450M-MLX-5bit
Image-Text-to-Text
• 0.2B • Updated • 55
• 1
zecanard/gemma-4-31B-it-uncensored-abliterix-MLX-5bit-int5-affine
Image-Text-to-Text
• 9B • Updated • 150
• 1
zecanard/gemma-4-31B-it-Claude-Opus-Distilled-MLX-5bit-int5-affine
Image-Text-to-Text
• 9B • Updated • 71
• 1
zecanard/Qwen3.5-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-MLX-5bit-int5-affine
Image-Text-to-Text
• 9B • Updated • 114
• 1
zecanard/gemma-4-31B-it-Claude-Opus-Distilled-v2-MLX-5bit-int5-affine
Image-Text-to-Text
• 9B • Updated • 48
• 1
zecanard/gemma-4-26B-A4B-it-Claude-Opus-Distilled-v2-MLX-5bit-int5-affine
Image-Text-to-Text
• 6B • Updated • 55
• 1
zecanard/gemma-4-26B-A4B-it-uncensored-abliterix-MLX-5bit-int5-affine
Image-Text-to-Text
• 6B • Updated • 136
• 1
zecanard/Gemopus-4-31B-it-MLX-5bit-int5-affine
Text Generation
• 9B • Updated • 196
• 1
zecanard/Gemopus-4-26B-A4B-it-MLX-5bit-int5-affine
Text Generation
• 6B • Updated • 1
zecanard/Gemopus-4-E4B-it-MLX-5bit-int5-affine
Image-Text-to-Text
• 2B • Updated • 1
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 111k
• 136
LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2
Text Generation
• Updated • 1
Text Generation
• 3B • Updated • 231
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 575
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 561
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 544
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 266
• 3