Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,877

Base only

Active filters: instruct

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-64

2B • Updated Jun 15 • 11

mradermacher/SmolMoE-4x360M-Instruct-GGUF

1B • Updated Mar 22 • 238 • 1

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-64

2B • Updated Jun 15 • 83

mradermacher/Hunyuan-PythonGOD-0.5B-GGUF

0.5B • Updated Jul 14 • 273

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-128

2B • Updated Jun 15 • 7

mradermacher/SmolMoE-4x360M-Instruct-i1-GGUF

1B • Updated Mar 22 • 255

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-128

2B • Updated Jun 15 • 11

sadi4ek/Qwen2-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Mar 22 • 1

WithinUsAI/Llama3.2-Hermes.Dolphin.Coder-1B

Text Generation • 1B • Updated Mar 24 • 19 • 1

Khurram123/Qwen-Urdu-Shaheen-7B-Instruct-v1

Text Generation • 8B • Updated Mar 26 • 39

11-47/Hunyuan-Python.GOD-0.5B-GGUF

Text Generation • 0.5B • Updated Jun 18 • 220 • 8

DavidCaraballoBulnes/ResidentEvil-QA

Question Answering • 8B • Updated Mar 28 • 8 • 2

WithinUsAI/Llama3.2-Octo.Thinker.iNano-1B

Text Generation • 1B • Updated Mar 24 • 19

mradermacher/Llama-3.2-OctoThinker-iNano-1B-GGUF

1B • Updated Apr 21 • 280

pthinc/pofuduk_cicikus_v4_5B

Text Generation • 5B • Updated May 18 • 30 • 1

CarlosRCDev/EuroLLM-22B-Instruct-2512-awq

Text Generation • 4B • Updated Mar 26 • 126

mradermacher/GigaChat3.1-10B-A1.8B-bf16-GGUF

11B • Updated Mar 25 • 159

mradermacher/GigaChat3.1-10B-A1.8B-bf16-i1-GGUF

11B • Updated Mar 25 • 533 • 2

oracomputing/LlamaOra-5.8B-Instruct

Text Generation • 6B • Updated Mar 28

oracomputing/LlamaOra-6.4B-Instruct

Text Generation • 6B • Updated Mar 28 • 1

leaderaigmbh/Llama3.3-8B-Instruct-Thinking-Heretic-Uncensored-Claude-4.5-Opus-High-Reasoning-i1-GGUF

8B • Updated Mar 26 • 215

respinosamena/Helios-Nova-306M-Instruct

Text Generation • 0.3B • Updated Jun 7 • 20 • 1

Smallthrow22/Hermes-3-Llama-3.1-8B

8B • Updated Mar 27 • 3

xxue752/llama3.2-caiti-full

3B • Updated Mar 28 • 9 • 1

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-32

73B • Updated Jul 3 • 20

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-32

75B • Updated Jul 3 • 21

rautaditya/Qwen3-4B-Instruct-MLX-4bit

Text Generation • 4B • Updated Mar 28 • 21

cygnisai/Cygnis-Alpha-1.7B-v0.1-GGUF

Text Generation • Updated Mar 29 • 40 • 1

matrixdose/OpenAI-gpt-oss-20B-Claude-4.5-Opus-Heretic-Uncensored-i1-GGUF

21B • Updated Mar 30 • 280 • 1

Sweaterdog/GRaPE-1.5

Image-Text-to-Text • 5B • Updated Aug 7 • 31 • 7