Update README.md
Browse files
README.md
CHANGED
@@ -19,6 +19,24 @@ Chimera-8B is a merge of the following models using [LazyMergekit](https://colab
|
|
19 |
* [Locutusque/Llama-3-Orca-1.0-8B](https://huggingface.co/Locutusque/Llama-3-Orca-1.0-8B)
|
20 |
* [abacusai/Llama-3-Smaug-8B](https://huggingface.co/abacusai/Llama-3-Smaug-8B)
|
21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
22 |
## 𧩠Configuration
|
23 |
|
24 |
```yaml
|
|
|
19 |
* [Locutusque/Llama-3-Orca-1.0-8B](https://huggingface.co/Locutusque/Llama-3-Orca-1.0-8B)
|
20 |
* [abacusai/Llama-3-Smaug-8B](https://huggingface.co/abacusai/Llama-3-Smaug-8B)
|
21 |
|
22 |
+
|
23 |
+
|
24 |
+
## π Evaluation
|
25 |
+
|
26 |
+
### Nous
|
27 |
+
|
28 |
+
OrpoLlama-4-8B outperforms Llama-3-8B-Instruct on the GPT4All and TruthfulQA datasets.
|
29 |
+
|
30 |
+
Evaluation performed using [LLM AutoEval](https://github.com/mlabonne/llm-autoeval), see the entire leaderboard [here](https://huggingface.co/spaces/mlabonne/Yet_Another_LLM_Leaderboard).
|
31 |
+
|
32 |
+
| Model | Average | AGIEval | GPT4All | TruthfulQA | Bigbench |
|
33 |
+
| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --------: | --------: | --------: | ---------: | --------: |
|
34 |
+
| [**mlabonne/Chimera-8B**](https://huggingface.co/mlabonne/Chimera-8B) [π](https://gist.github.com/mlabonne/28d31153628dccf781b74f8071c7c7e4) | **51.58** | **39.12** | **71.81** | **52.4** | **42.98** |
|
35 |
+
| [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) [π](https://gist.github.com/mlabonne/8329284d86035e6019edb11eb0933628) | 51.34 | 41.22 | 69.86 | 51.65 | 42.64 |
|
36 |
+
| [mlabonne/OrpoLlama-3-8B](https://huggingface.co/mlabonne/OrpoLlama-3-8B) [π](https://gist.github.com/mlabonne/22896a1ae164859931cc8f4858c97f6f) | 48.63 | 34.17 | 70.59 | 52.39 | 37.36 |
|
37 |
+
| [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) [π](https://gist.github.com/mlabonne/616b6245137a9cfc4ea80e4c6e55d847) | 45.42 | 31.1 | 69.95 | 43.91 | 36.7 |
|
38 |
+
|
39 |
+
|
40 |
## 𧩠Configuration
|
41 |
|
42 |
```yaml
|