isakzhang commited on
Commit
3bf4916
·
verified ·
1 Parent(s): 63482f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -161,7 +161,14 @@ We briefly compare SeaLLMs-v3-1.5B-Chat with models of similar sizes with the M3
161
 
162
  [M3Exam](https://arxiv.org/abs/2306.05179) consists of local exam questions collected from each country. It reflects the model's world knowledge (e.g., with language or social science subjects) and reasoning abilities (e.g., with mathematics or natural science subjects).
163
 
164
- [[place holder]]
 
 
 
 
 
 
 
165
 
166
 
167
  ## Acknowledgement to Our Linguists
 
161
 
162
  [M3Exam](https://arxiv.org/abs/2306.05179) consists of local exam questions collected from each country. It reflects the model's world knowledge (e.g., with language or social science subjects) and reasoning abilities (e.g., with mathematics or natural science subjects).
163
 
164
+ | Model | en | zh | id | th | vi | avg | avg_sea |
165
+ |--------------------------|------|------|------|------|------|------|---------|
166
+ | gemma-2b-it | 44.1 | 37.4 | 31.5 | 28.2 | 35.8 | 35.4 | 31.8 |
167
+ | Sailor-1.8B-Chat | 43.8 | 35.9 | 34.2 | 32.3 | 37.5 | 36.7 | 34.7 |
168
+ | Sailor-4B-Chat | 54.1 | 48.1 | 40.7 | 35.6 | 42.5 | 44.2 | 39.6 |
169
+ | Qwen2-1.5B-Instruct | 63.4 | 75.3 | 41.2 | 41.2 | 47.2 | 53.7 | 43.2 |
170
+ | **SeaLLMs-v3-1.5B-Chat** | 61.9 | 74.2 | 43.2 | 42.4 | 48.7 | 54.1 | 44.7 |
171
+
172
 
173
 
174
  ## Acknowledgement to Our Linguists