ArkaAbacus
commited on
Commit
•
0a4f0a2
1
Parent(s):
9540b64
Update README.md
Browse files
README.md
CHANGED
@@ -34,22 +34,22 @@ This model was built using the Smaug recipe for improving performance on real w
|
|
34 |
score
|
35 |
model turn
|
36 |
Llama-3-Smaug-8B 1 8.77500
|
37 |
-
Meta-Llama-3-8B-Instruct 1 8.
|
38 |
########## Second turn ##########
|
39 |
score
|
40 |
model turn
|
41 |
-
Meta-Llama-3-8B-Instruct 2
|
42 |
Llama-3-Smaug-8B 2 7.8875
|
43 |
########## Average ##########
|
44 |
score
|
45 |
model
|
46 |
Llama-3-Smaug-8B 8.331250
|
47 |
-
Meta-Llama-3-8B-Instruct 8.
|
48 |
```
|
49 |
|
50 |
| Model | First turn | Second Turn | Average |
|
51 |
| :---- | ---------: | ----------: | ------: |
|
52 |
| Llama-3-Smaug-8B | 8.78 | 7.89 | 8.33 |
|
53 |
-
| Llama-3-8B-Instruct | 8.
|
54 |
|
55 |
This version of Smaug uses new techniques and new data compared to [Smaug-72B](https://huggingface.co/abacusai/Smaug-72B-v0.1), and more information will be released later on. For now, see the previous Smaug paper: https://arxiv.org/abs/2402.13228.
|
|
|
34 |
score
|
35 |
model turn
|
36 |
Llama-3-Smaug-8B 1 8.77500
|
37 |
+
Meta-Llama-3-8B-Instruct 1 8.31250
|
38 |
########## Second turn ##########
|
39 |
score
|
40 |
model turn
|
41 |
+
Meta-Llama-3-8B-Instruct 2 7.8875
|
42 |
Llama-3-Smaug-8B 2 7.8875
|
43 |
########## Average ##########
|
44 |
score
|
45 |
model
|
46 |
Llama-3-Smaug-8B 8.331250
|
47 |
+
Meta-Llama-3-8B-Instruct 8.10
|
48 |
```
|
49 |
|
50 |
| Model | First turn | Second Turn | Average |
|
51 |
| :---- | ---------: | ----------: | ------: |
|
52 |
| Llama-3-Smaug-8B | 8.78 | 7.89 | 8.33 |
|
53 |
+
| Llama-3-8B-Instruct | 8.31 | 7.89 | 8.10 |
|
54 |
|
55 |
This version of Smaug uses new techniques and new data compared to [Smaug-72B](https://huggingface.co/abacusai/Smaug-72B-v0.1), and more information will be released later on. For now, see the previous Smaug paper: https://arxiv.org/abs/2402.13228.
|