Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,446

Base only

Active filters: on-device

Cactus-Compute/needle2

Text Generation • Updated 8 days ago • 36.7k • 238

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 580k • 813

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 18 • 541k • • 1.25k

ayousanz/kodama-ja-streaming-small

Automatic Speech Recognition • 0.1B • Updated 6 days ago • 247 • 13

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated 11 days ago • 862k • 1.09k

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.95M • 224

facebook/MobileMoE-L-Base

Text Generation • 5B • Updated 3 days ago • 46 • 7

facebook/MobileMoE-S-Base

Text Generation • 1B • Updated 3 days ago • 66 • 6

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 26.2k • 933

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 261k • 145

facebook/MobileMoE-M-Base

Text Generation • 3B • Updated 3 days ago • 26 • 4

mlboydaisuke/Pocket-TTS-LiteRT

Text-to-Speech • Updated 2 days ago • 52 • 4

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 91.1k • 772

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated Jul 14 • 1.98M • 182

mlboydaisuke/SAM3-LiteRT

Image Segmentation • Updated 8 days ago • 113 • 4

runanywhere/silero-vad-v5

Voice Activity Detection • Updated Feb 13 • 10

prism-ml/Bonsai-8B-mlx-1bit

Text Generation • 0.4B • Updated Apr 18 • 12k • 234

mattmireles/kokoro-coreml

Text-to-Speech • Updated Jul 25 • 2.12k • 10

PeppX/gemma-4-e2b-uncensored-litertlm

Updated Jul 17 • 3.07k • 18

facebook/MobileMoE-S-SFT

Text Generation • 1B • Updated about 13 hours ago • 2

litert-community/Matcha-TTS

Text-to-Speech • Updated 4 days ago • 2.34k • 5

litert-community/MoViNet-A0-Stream-LiteRT

Video Classification • Updated 4 days ago • 51 • 2

litert-community/MedGemma-1.5-4B-IT

Text Generation • Updated about 6 hours ago • 348 • 14

FINAL-Bench/POCKET-KR-GGUF

Text Generation • 23B • Updated 30 days ago • 238 • 35

litert-community/Qwen3.5-4B

Text Generation • Updated 1 day ago • 1.04k • 2

litert-community/Qwen3.5-2B

Text Generation • Updated 3 days ago • 596 • 2

flashvenom/thimble

Text Generation • Updated 3 days ago • 2

Muse-research/Muse2-230M-Base

Text Generation • 0.2B • Updated 3 days ago • 511 • 2

mlboydaisuke/S1-mini-LiteRT

Text Generation • Updated 3 days ago • 13 • 2

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated 11 days ago • 49k • 240