Javelin-GPTJ / README.md
leaderboard-pr-bot's picture
Adding Evaluation Results
2e62d75
|
raw
history blame
1.15 kB
metadata
license: creativeml-openrail-m

Javelin-GPTJ is an even 25*4 quad merge of KoboldAI's GPT-J classics;

(Janeway + Shinen) + (Adventure + Skein). Janeway + Shinen is listed under JANIN-GPTJ. Adventure + Skein is listed under Adventien-GPTJ.

Original models can all be found under KoboldAI.

This 4x merge is not intended for minors, as it can produce NC-17+ content (mostly from Shinen).

GPT-R merge variant will be released if it adds value to this already "kitchen sink" level of merging.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 35.16
ARC (25-shot) 42.66
HellaSwag (10-shot) 70.45
MMLU (5-shot) 26.2
TruthfulQA (0-shot) 36.08
Winogrande (5-shot) 64.17
GSM8K (5-shot) 1.82
DROP (3-shot) 4.77