Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,902

Base only

Active filters: instruct

dotkaio/avis

Text Generation • 15B • Updated Apr 26 • 9

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 834 • 2

mradermacher/Aitana-7B-S-Instruct-v0.1-GGUF

Text Generation • 8B • Updated Jun 3 • 643

rmehan/grandma-qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Apr 18 • 50

lipilipic/Qwen3-4B-Instruct-lora_adapter_NSFW-V2.1

Text Generation • Updated Apr 9 • 4

lipilipic/Qwen3-4B-Instruct_NSFW-V2.1

Text Generation • 4B • Updated Apr 9 • 10

mradermacher/GRM-2.5-Air-GGUF

0.8B • Updated Apr 9 • 214

mradermacher/GRM-2.5-Air-i1-GGUF

0.8B • Updated Apr 21 • 514 • 1

mradermacher/GRM-2.5-GGUF

4B • Updated Apr 9 • 366 • 1

mradermacher/GRM-2.5-i1-GGUF

4B • Updated Apr 21 • 833 • 1

mradermacher/Aitana-7B-S-Instruct-v0.1-i1-GGUF

Text Generation • 8B • Updated Jun 3 • 1.43k

mradermacher/Villanova-2B-2603-GGUF

2B • Updated Apr 9 • 429

HyzeAI/HyzeQwenInstruct-Q4_K_M-GGUF

Image-Text-to-Text • 31B • Updated Apr 20 • 7 • 1

mradermacher/Villanova-2B-2603-i1-GGUF

2B • Updated Apr 10 • 917

ValiantLabs/gemma-4-E2B-it-ShiningValiant3

Image-Text-to-Text • 5B • Updated Apr 13 • 27 • 4

OpenMOSS-Team/MOSS-Audio-4B-Instruct

Audio-Text-to-Text • 5B • Updated Apr 14 • 13.5k • 82

continuum-ai/mixtral-8x7b-instruct-compacted-conservative

Text Generation • 35B • Updated Apr 11 • 184

stukenov/sozkz-core-qwen-500m-kk-instruct-v1

Text Generation • 0.4B • Updated Apr 10

SL-AI/GRaPE-2-Mini

Image-Text-to-Text • 5B • Updated Apr 24 • 20 • 13

SL-AI/GRaPE-2-Mini_GGUF

Image-Text-to-Text • 4B • Updated Apr 24 • 129 • 2

pbhappliedsystems/ministral-3-14b-instruct-2512-gguf-F16

14B • Updated Aug 13 • 40

pbhappliedsystems/ministral-3-14b-instruct-2512-gguf-Q4-K-M

14B • Updated Aug 13 • 303

pthinc/Cicikus_v4_0.3B_Pitircik

Text Generation • 0.3B • Updated May 18 • 155 • 2

pbhappliedsystems/mistral-nemo-instruct-2407-gguf-F16

12B • Updated Aug 13 • 55

pbhappliedsystems/mistral-nemo-instruct-2407-gguf-Q4-K-M

12B • Updated Aug 13 • 55

pbhappliedsystems/qwen-2.5-3B-instruct-gguf-F16

3B • Updated May 5 • 54

pbhappliedsystems/qwen-2.5-3B-instruct-gguf-Q4-K-M

3B • Updated Aug 13 • 289 • 1

pbhappliedsystems/qwen-2.5-7B-instruct-gguf-F16

8B • Updated May 5 • 37

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated Jul 15 • 149 • 2

pbhappliedsystems/qwen-2.5-7B-instruct-gguf-Q4-K-M

8B • Updated May 5 • 447 • 2