SamPO - a jiazhengli Collection

jiazhengli 's Collections

RoleMRC

MCTS with Preference Optimisation

SamPO

AERA

SamPO

updated Oct 14, 2024

Resources for EMNLP 2024 Paper: Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence

jiazhengli/Pythia-2.8B-HH-RLHF-Iterative-SamPO

Text Generation • Updated Jun 17, 2024 • 14
jiazhengli/Pythia-2.8B-TLDR-Iterative-SamPO

Text Generation • Updated Jun 17, 2024 • 10
Junrulu/Llama-3-8B-Instruct-Iterative-SamPO

Text Generation • Updated Jun 14, 2024 • 14 • 1
Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence

Paper • 2406.10957 • Published Jun 16, 2024 • 1