trl-lib
/

OpenHermes-2-Mistral-7B-ipo-beta-0.3-steps-200

Model card Files Files and versions Community

README.md exists but content is empty.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .

Collection including trl-lib/OpenHermes-2-Mistral-7B-ipo-beta-0.3-steps-200

Comparing DPO with IPO and KTO

A collection of chat models to explore the differences between three alignment techniques: DPO, IPO, and KTO. • 56 items • Updated Jan 9 • 31