Splend1dchan
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -63,18 +63,18 @@ Breeze-7B-32k-Base clears the tasks with 90+% accuracy, shown in the figure belo
|
|
63 |
|
64 |
#### Long-DRCD Performance
|
65 |
|
66 |
-
| **Model/Performance(EM)** | **DRCD** | **DRCD-16k** | **DRCD-32k** |
|
67 |
-
|
68 |
-
| **Breeze-7B-32k-Instruct-v1\_0** | |
|
69 |
-
| **Breeze-7B-32k-Base-v1\_0** | 79.73 | 69.68 | 61.55 |
|
70 |
-
| **Breeze-7B-Base-v1\_0** | 80.61 | 21.79 | 15.29 |
|
71 |
|
72 |
#### Short-Benchmark Performance
|
73 |
|
74 |
-
| **Model/Performance(EM)** | **TMMLU+** | **MMLU** | **TABLE** |
|
75 |
-
|
76 |
-
| **Breeze-7B-32k-Instruct-v1\_0** |
|
77 |
-
| **Breeze-7B-Instruct-v1\_0** | |
|
78 |
|
79 |
## Use in Transformers
|
80 |
|
@@ -117,4 +117,4 @@ tokenizer.tokenize("你好,我可以幫助您解決各種問題、提供資訊
|
|
117 |
archivePrefix={arXiv},
|
118 |
primaryClass={cs.CL}
|
119 |
}
|
120 |
-
```
|
|
|
63 |
|
64 |
#### Long-DRCD Performance
|
65 |
|
66 |
+
| **Model/Performance(EM)** | **DRCD** | **DRCD-16k** | **DRCD-32k** |
|
67 |
+
|---------------------------|----------|--------------|--------------|
|
68 |
+
| **Breeze-7B-32k-Instruct-v1\_0** | 76.9 | 54.82 | 44.26 |
|
69 |
+
| **Breeze-7B-32k-Base-v1\_0** | 79.73 | 69.68 | 61.55 |
|
70 |
+
| **Breeze-7B-Base-v1\_0** | 80.61 | 21.79 | 15.29 |
|
71 |
|
72 |
#### Short-Benchmark Performance
|
73 |
|
74 |
+
| **Model/Performance(EM)** | **TMMLU+** | **MMLU** | **TABLE** | **MT-Bench-tw** | **MT-Bench** |
|
75 |
+
|---------------------------|----------|--------------|--------------|-----|-----|
|
76 |
+
| **Breeze-7B-32k-Instruct-v1\_0** | 41.37 | 61.34 | 34 | 5.8 | 7.4 |
|
77 |
+
| **Breeze-7B-Instruct-v1\_0** | 42.67 | 62.73 | 39.58 | 6.0 | 7.4 |
|
78 |
|
79 |
## Use in Transformers
|
80 |
|
|
|
117 |
archivePrefix={arXiv},
|
118 |
primaryClass={cs.CL}
|
119 |
}
|
120 |
+
```
|