metadata
license: cc-by-nc-4.0
datasets:
- Open-Orca/OpenOrca
language:
- en
Merge of Marcoroni-13B and Luban-13B using ties merge.
Weights
Marcoroni-13B: 0.5
Luban-13B: 0.3
Density
Marcoroni-13B: 0.5
Luban-13B: 0.5
Evaluation Results (Open LLM Leaderboard)
| Metric | Value |
|---|---|
| Avg. | 65.21 |
| ARC (25-shot) | 63.65 |
| HellaSwag (10-shot) | 82.92 |
| MMLU (5-shot) | 58.70 |
| TruthfulQA (0-shot) | 55.55 |
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 51.16 |
| ARC (25-shot) | 63.65 |
| HellaSwag (10-shot) | 82.92 |
| MMLU (5-shot) | 58.7 |
| TruthfulQA (0-shot) | 55.55 |
| Winogrande (5-shot) | 77.03 |
| GSM8K (5-shot) | 10.01 |
| DROP (3-shot) | 10.25 |