Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

13,604

Base only

Active filters: dpo

NU-World-Model-Embodied-AI/phyworld

Video-to-Video • Updated Aug 7 • 15

mradermacher/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy-GGUF

8B • Updated Feb 19 • 895 • 12

ReXeeD/Luminus-1.5B-Roleplay

Text Generation • 2B • Updated Apr 29 • 63 • 5

UnstableLlama/Love-Aligned-31B

Text Generation • 31B • Updated 25 days ago • 736 • 11

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-Merged-FP16

Text Generation • 1B • Updated Jul 29 • 342 • 19

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 1.39k • 88

anshulVashist/qwen3-vex-master-v44-lora

Text Generation • Updated 5 days ago • 21 • 2

sriyuth/ari-paraphraser-1.5b

Text Generation • 2B • Updated 1 day ago • 1.66k • 2

wxzhang/dpo-selective-redteaming

Text Generation • 7B • Updated May 19, 2024 • 143 • 5

wyan/NeuralDaredevil-8B-abliterated-Q4_K_M-GGUF

8B • Updated Jun 13, 2024 • 341 • 1

RISys-Lab/RedSage-Qwen3-8B-DPO

Text Generation • 8B • Updated Feb 9 • 493 • • 17

mradermacher/RedSage-Qwen3-8B-DPO-GGUF

Text Generation • 8B • Updated Jan 30 • 1.05k • 5

trentmkelly/gpt-4o-distil-Llama-3.1-8B-Instruct

Text Generation • Updated Jan 30 • 35 • 3

Merlin-Research/HybridIntelligence-0.5B

Text Generation • 0.5B • Updated Jul 14 • 90 • 15

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated May 14 • 206 • 44

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated May 11 • 813 • 97

OpenYourMind/OpenYourMind-Qwen3.6-35B-A3B-kuato-DPO-abliterated-uncensored

Image-Text-to-Text • 36B • Updated Jun 16 • 103 • 4

jjzha/tiny-aya-global-dpo_chosen_multilingual-dpo-lr5e-6

Text Generation • Updated May 21 • 8 • 1

MRockatansky/Gemma-4-31B-storymaxxed2-GGUF

Text Generation • 31B • Updated Jul 4 • 308 • 3

CEIA-RL/energy-exp1-dpo-offline

Text Generation • 4B • Updated May 31 • 165 • 6

ranjanrajib/DPO-trained-Qwen2.5-Python-Coder-7B

Text Generation • 8B • Updated 30 days ago • 845 • 6

mradermacher/Love-Aligned-31B-i1-GGUF

31B • Updated Sep 14 • 4.62k • 2

mzoelfakar/Al-Khwarizmi-3B

3B • Updated 3 days ago • 951 • 1

wesjos/Mimo-Qwen3.5-9B-Cold

Text Generation • 9B • Updated 16 days ago • 483 • 1

SneakySpidy/vaidya-mistral-7b-medmcqa

Text Generation • 7B • Updated 3 days ago • 323 • 1

anonytoucan/condescension-trap-act3-adapters

Text Generation • Updated 5 days ago • 1

Hikaf143/Keural-MoE-14B

Text Generation • 15B • Updated 5 days ago • 36 • 1

sriyuth/ari-rewritebot-135m-dpo

Text Generation • 0.1B • Updated 5 days ago • 99 • 1

azguo/cs329x-hw1-dpo-lora

Text Generation • Updated 5 days ago • 17 • 1

bachthetrollface/Qwen3.6-27B-AmberKite-DPO-ckpts

Updated 4 days ago • 1