Splend1dchan commited on
Commit
74f8a66
·
verified ·
1 Parent(s): 2631f0b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -10
README.md CHANGED
@@ -63,18 +63,18 @@ Breeze-7B-32k-Base clears the tasks with 90+% accuracy, shown in the figure belo
63
 
64
  #### Long-DRCD Performance
65
 
66
- | **Model/Performance(EM)** | **DRCD** | **DRCD-16k** | **DRCD-32k** | **DRCD-64k** |
67
- |---------------------------|----------|--------------|--------------|--------------|
68
- | **Breeze-7B-32k-Instruct-v1\_0** | | | | |
69
- | **Breeze-7B-32k-Base-v1\_0** | 79.73 | 69.68 | 61.55 | 25.82 |
70
- | **Breeze-7B-Base-v1\_0** | 80.61 | 21.79 | 15.29 | 12.63 |
71
 
72
  #### Short-Benchmark Performance
73
 
74
- | **Model/Performance(EM)** | **TMMLU+** | **MMLU** | **TABLE** |
75
- |---------------------------|----------|--------------|--------------|
76
- | **Breeze-7B-32k-Instruct-v1\_0** | | | | |
77
- | **Breeze-7B-Instruct-v1\_0** | | | | |
78
 
79
  ## Use in Transformers
80
 
@@ -117,4 +117,4 @@ tokenizer.tokenize("你好,我可以幫助您解決各種問題、提供資訊
117
  archivePrefix={arXiv},
118
  primaryClass={cs.CL}
119
  }
120
- ```
 
63
 
64
  #### Long-DRCD Performance
65
 
66
+ | **Model/Performance(EM)** | **DRCD** | **DRCD-16k** | **DRCD-32k** |
67
+ |---------------------------|----------|--------------|--------------|
68
+ | **Breeze-7B-32k-Instruct-v1\_0** | 76.9 | 54.82 | 44.26 |
69
+ | **Breeze-7B-32k-Base-v1\_0** | 79.73 | 69.68 | 61.55 |
70
+ | **Breeze-7B-Base-v1\_0** | 80.61 | 21.79 | 15.29 |
71
 
72
  #### Short-Benchmark Performance
73
 
74
+ | **Model/Performance(EM)** | **TMMLU+** | **MMLU** | **TABLE** | **MT-Bench-tw** | **MT-Bench** |
75
+ |---------------------------|----------|--------------|--------------|-----|-----|
76
+ | **Breeze-7B-32k-Instruct-v1\_0** | 41.37 | 61.34 | 34 | 5.8 | 7.4 |
77
+ | **Breeze-7B-Instruct-v1\_0** | 42.67 | 62.73 | 39.58 | 6.0 | 7.4 |
78
 
79
  ## Use in Transformers
80
 
 
117
  archivePrefix={arXiv},
118
  primaryClass={cs.CL}
119
  }
120
+ ```