view post Post 133 Run Inkling 2 Mini, the strongest 26.4B model that runs on 16GB RAM.Thinking Machines’ Apache 2.0 MoE model uses a looped transformer arch & scores 48.2% on DeepSWE v1.1, the best for size.Run on Unsloth Desktop or llama.cpp.GGUF: unsloth/Inkling-2-Mini-GGUFGuide: https://unsloth.ai/docs/models/inkling-2-mini See translation 🚀 1 1 ❤️ 1 1 🔥 1 1 + Reply
Unsloth Dynamic 3 Quants Collection Introducing Dynamic v3.1 and v3.0 quants, our new SOTA quantization algorithm - performing the best on Terminal Bench, DeepSWE & more at 512K context. • 12 items • Updated about 12 hours ago • 131