Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

368

Full-text search

Active filters: ggml

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated 5 days ago • 5.4k • 15

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 34.3k • 124

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 54.3k • 116

unsloth/LTX-2-GGUF

Image-to-Video • 19B • Updated Jan 22 • 24.7k • 122

ytu-ce-cosmos/Turkish-Gemma-9b-T1-GGUF

9B • Updated Sep 24, 2025 • 2.2k • 16

unsloth/Qwen-Image-GGUF

Text-to-Image • 20B • Updated Dec 22, 2025 • 934 • 25

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 20.7k • 89

unsloth/FLUX.2-klein-base-9B-GGUF

Image-to-Image • 9B • Updated Jan 15 • 8.41k • 27

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 5.32k • 43

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 28.8k • 92

SilentGus/Z-Image-GGUF

Text-to-Image • 6B • Updated 20 days ago • 240 • 1

malteos/bloom-6b4-clp-german

Text Generation • 6B • Updated Apr 6, 2024 • 140 • 37

nouamanetazi/bloomz-560m-ggml

Updated Mar 15, 2023 • 4

maximeseth/alpaca-native-7B-ggml

Updated Mar 26, 2023 • 1

bertin-project/bertin-gpt-j-6B-alpaca

Text Generation • 6B • Updated Nov 10, 2024 • 808 • 7

CRD716/ggml-LLaMa-65B-quantized

Text Generation • Updated Sep 9, 2023 • 30

CRD716/ggml-vicuna-1.1-quantized

Text Generation • Updated Sep 9, 2023 • 43

Drake-AI/GPT-J-6b-Skein-ggml-q4_1

Updated Apr 18, 2023 • 1

Arjay87/bloomz_7b1.cpp

Updated Apr 21, 2023

nicholascao/chatbloom-1b7-sft

Text Generation • 2B • Updated Aug 12, 2023 • 222 • 6

Crataco/Pythia-Deduped-Series-GGML

Text Generation • Updated Oct 1, 2023 • 16

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2

ravenscroftj/CodeGen-2B-multi-ggml-quant

Text Generation • Updated Aug 5, 2023 • 2

ravenscroftj/CodeGen-6B-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 9

ShadowPower/ggml-alpaca-chatgpt

Text Generation • Updated May 12, 2023 • 8

rozek/OpenLLaMA_7B_300BT_q4

Text Generation • Updated May 5, 2023 • 1

mverrilli/dolly-v2-3b-ggml

Updated May 17, 2023 • 2

mverrilli/dolly-v2-12b-ggml

Updated May 8, 2023 • 1

mverrilli/dolly-v2-7b-ggml

Updated May 18, 2023 • 1

Green-Sky/ggml-mpt-7b-storywriter

Updated May 20, 2023 • 14