Models

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 17

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 58 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 34 • 9

amirali1985/gpt-neo-125m_hh_reward

Text Generation • 0.1B • Updated Apr 27, 2024 • 17

lewtun/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 24

sambar/zephyr-7b-ipo-lora

Text Generation • Updated Jan 5, 2024 • 7

nlee282/moai-dpo-1.0

Updated Jan 5, 2024 • 5

nikkoyabut/merged_model_dpo

Updated Jan 5, 2024 • 5

sambar/zephyr-7b-ipo-lora-5ep

Text Generation • Updated Jan 6, 2024 • 8

alexredna/TinyLlama-1.1B-Chat-v1.0-reasoning-v2-dpo

Text Generation • 1B • Updated Jan 7, 2024 • 26 • 2

AlbelTec/mistral-dpo-old

Updated Jan 7, 2024 • 2

Yaxin1992/mixtral-dpo-1000

Updated Jan 9, 2024 • 9

adhi29/openhermes-mistral-dpo-gptq

Updated Jan 10, 2024

ybelkada/test-tags-model

Text Generation • 1.03M • Updated Jan 9, 2024 • 10

ybelkada/test-tags-model-2

Text Generation • 1.03M • Updated Jan 9, 2024 • 9

justinj92/dpoplatypus-phi2

Text Generation • 3B • Updated Jan 10, 2024

Belred/mistral-dpo

Updated Jan 9, 2024 • 2

lewtun/zephyr-7b-dpo-qlora-8e0975a

Updated Jan 10, 2024 • 3

mecoaoge2/results

Updated Jan 10, 2024 • 6

mecoaoge2/fununun

Updated Jan 10, 2024 • 4

akashkumarbtc/openhermes-mistral-dpo-gptq

Updated Jan 10, 2024

darshan8950/openhermes-mistral-dpo-gptq

Updated Jan 10, 2024

sonu2023/mistral-dpo

Updated Jan 11, 2024

ondevicellm/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 12, 2024 • 14

jdang/openhermes-mistral-dpo-gptq

Updated Jan 20, 2024

winglian/zephyr-deita-dpo

Updated Jan 13, 2024 • 5

winglian/zephyr-deita-kto

Updated Jan 13, 2024 • 9

winglian/zephyr-deita-kto-3ep

Updated Jan 13, 2024 • 3

winglian/zephyr-deita-kto-3ep-v2

8B • Updated Jan 14, 2024 • 6 • 1

jikaixuan/zephyr-7b-dpo-qlora

Updated Feb 20, 2024 • 8