Is PTP-small a held out set?

#1
by madhavaggar - opened

Hi want to know if the 5K samples are mutually exclusive from the ptp-full with respect to english only?

ToxicityPrompts org

Hi want to know if the 5K samples are mutually exclusive from the ptp-full with respect to english only?

Hi, thanks for your interest in PTP! The 5K samples are a subset of ptp-full to conduct evaluations with compute constraints. Note that each language has its own small split, so ptp-small contains a total of 85K samples across 17 languages.

Sign up or log in to comment