Update README.md
Browse files
README.md
CHANGED
@@ -44,7 +44,7 @@ license: llama3.1
|
|
44 |
# Model Summary
|
45 |
Atla Selene Mini is a **state-of-the-art small language model-as-a-judge (SLMJ)**. Selene Mini achieves comparable performance to models 10x its size, **outperforming GPT-4o on [RewardBench](https://huggingface.co/spaces/allenai/reward-bench), [EvalBiasBench](https://arxiv.org/abs/2407.06551), and [AutoJ](https://arxiv.org/html/2310.05470v2)**.
|
46 |
|
47 |
-
Post-trained from Llama-3.1-8B across a wide range of evaluation tasks and scoring criteria, Selene Mini **outperforms prior small
|
48 |
|
49 |
- Absolute scoring, e.g. "Evaluate the harmlessness of this response on a scale of 1-5"
|
50 |
- Classification, e.g. "Does this response address the user query? Answer Yes or No."
|
|
|
44 |
# Model Summary
|
45 |
Atla Selene Mini is a **state-of-the-art small language model-as-a-judge (SLMJ)**. Selene Mini achieves comparable performance to models 10x its size, **outperforming GPT-4o on [RewardBench](https://huggingface.co/spaces/allenai/reward-bench), [EvalBiasBench](https://arxiv.org/abs/2407.06551), and [AutoJ](https://arxiv.org/html/2310.05470v2)**.
|
46 |
|
47 |
+
Post-trained from Llama-3.1-8B across a wide range of evaluation tasks and scoring criteria, Selene Mini **outperforms prior small models overall across 11 benchmarks covering three different types of tasks:**
|
48 |
|
49 |
- Absolute scoring, e.g. "Evaluate the harmlessness of this response on a scale of 1-5"
|
50 |
- Classification, e.g. "Does this response address the user query? Answer Yes or No."
|