ORPO: Monolithic Preference Optimization without Reference Model
Paper • 2403.07691 • Published • 73
Neo
SpaceHunterInf
·
AI & ML interests
None yet
Recent Activity
updated a model about 1 month ago
SpaceHunterInf/olmo2-1b-dolmino10b-baseline published a model about 1 month ago
SpaceHunterInf/olmo2-1b-dolmino10b-baseline updated a model 9 months ago
SpaceHunterInf/Q3-1.7B-Dapo-Conc-DPOOrganizations
None yet