Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

13,669

Base only

Active filters: dpo

NU-World-Model-Embodied-AI/phyworld

Video-to-Video • Updated Aug 7 • 22

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 1.47k • 91

ewin-reg/MiniCPM-V-4.7-1B-Agentic-FwS

Image-Text-to-Text • 2B • Updated about 1 hour ago • 109 • 2

Phase-Technologies/Densy-330M-Chat

Text Generation • 0.5B • Updated about 23 hours ago • 35 • 2

wxzhang/dpo-selective-redteaming

Text Generation • 7B • Updated May 19, 2024 • 117 • 6

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 15.4k • • 298

mradermacher/Qwen2.5-Coder-1.5B-Unsensored-DPO-GGUF

2B • Updated Feb 4 • 1.15k • 1

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated Apr 9 • 206

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated Apr 1 • 3.07k • 20

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated May 11 • 934 • 99

Kyleyee/DrDPO_hh-seed3

Text Generation • 2B • Updated Apr 28 • 10 • 1

tiger26/cinebot-qwen3.5-9b

Text Generation • 9B • Updated May 11 • 18 • 1

CEIA-RL/energy-exp1-dpo-offline

Text Generation • 4B • Updated May 31 • 183 • 7

duarteocarmo/AMALIA-9B-0626-DPO-GGUF

Text Generation • 9B • Updated Jul 1 • 345 • 8

c4tdr0ut/grok-oss-Apollyon-24B

Text Generation • 24B • Updated Jul 9 • 2.05k • • 13

c4tdr0ut/grok-oss-Apollyon-8B

Text Generation • 8B • Updated Jul 9 • 5.52k • • 14

davidnichols-ops/adaptive-operator-v4

Text Generation • 9B • Updated Aug 4 • 49 • 1

prism-drift/qwen35-m0-v4-postfix-rl-checkpoints

Reinforcement Learning • Updated Aug 30 • 1

UnstableLlama/Love-Aligned-31B

Text Generation • 31B • Updated Sep 21 • 308 • 11

mradermacher/DPO-trained-Qwen2.5-Python-Coder-7B-i1-GGUF

8B • Updated Sep 17 • 2.84k • 1

Atharva31/indicslm-from-scratch

Text Generation • Updated 24 days ago • 314 • 1

KeyFicller/tiny-llm-pipeline-29m

Text Generation • Updated 2 days ago • 1

sriyuth/ari-paraphraser-1.5b

Text Generation • 2B • Updated 10 days ago • 1.9k • 3

SwapnilS-15/qwen2.5-0.5b-instructv2-fc

Text Generation • 0.5B • Updated 9 days ago • 23 • 1

liyun0607/CausalSceneNarration-LoRA

Robotics • Updated 6 days ago • 28 • 1

Yousef1258852/llama3-arabic-instruct

Text Generation • Updated 6 days ago • 28 • 1

wesjos/Qwen3.5-4B-StreetTalk-GGUF

Text Generation • 4B • Updated 5 days ago • 195 • 1

zaydsyed/TactLM-Instruction-DPO-Qwen2.5-0.5B

Text Generation • 0.5B • Updated 1 day ago • 22 • 1

zaydsyed/TactLM-Instruction-DPO-GRPO-Qwen2.5-0.5B

Text Generation • 0.5B • Updated 1 day ago • 31 • 1

hokseng789/Qwen3-0.6B-French-DPO

Text Generation • 0.6B • Updated 4 days ago • 14 • 1