Hugging Face's logo

PJMixers
/
LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA

Safetensors
Model card Files Community
LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA / README.md
xzuyn's picture
xzuyn
Update README.md
6f6da85 verified
preview code
|
raw
history blame
360 Bytes
metadata
datasets:
  - PJMixers/antiven0m_catboros-3.2-dpo-PreferenceShareGPT
  - antiven0m/catboros-3.2-dpo

Chosen/Rejected Reward Graph

Trained on antiven0m/catboros-3.2-dpo.