Update README.md
Browse files
README.md
CHANGED
@@ -7,8 +7,14 @@ pipeline_tag: text-generation
|
|
7 |
|
8 |
**Llama3.1-Typhoon2-8B-instruct** is a instruct Thai 🇹🇠large language model with 8 billion parameters, and it is based on Llama3.1-8B.
|
9 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
|
11 |
-
[TODO add one image and table result]
|
12 |
|
13 |
For release post, please see our [blog](...).
|
14 |
*To acknowledge Meta's effort in creating the foundation model and to comply with the license, we explicitly include "llama-3.1" in the model name.
|
|
|
7 |
|
8 |
**Llama3.1-Typhoon2-8B-instruct** is a instruct Thai 🇹🇠large language model with 8 billion parameters, and it is based on Llama3.1-8B.
|
9 |
|
10 |
+
| Model | IFEval - TH | IFEval - EN | MT-Bench TH | MT-Bench EN | Thai Code-Switching(t=0.7) | Thai Code-Switching(t=1.0) | FunctionCall-TH | FunctionCall-EN | GSM8K-TH | GSM8K-EN | MATH-TH | MATH-EN | HumanEval-TH | HumanEval-EN | MBPP-TH | MBPP-EN |
|
11 |
+
|--------------------------------|-------------|-------------|-------------|-------------|--------------------------------|--------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|-------------|-------------|-----------|-----------|
|
12 |
+
| **Llama3.1 8b instruct** | 58.04% | **77.64%** | 5.109 | **8.118** | 93% | 11.2% | 36.92% | 66.06% | 45.18% | 62.4% | 24.42% | 48% | 51.8% | 67.7% | **64.6%** | **66.9%** |
|
13 |
+
| **Typhoon2 llama3 8b instruct**| **72.60%** | 76.43% | **5.7417** | 7.584 | **98.8%** | **98%** | **75.12%** | **79.08%** | **71.72%** | **81.0%** | **38.48%** | **49.04%** | **58.5%** | **68.9%** | 60.8% | 63.0% |
|
14 |
+
|
15 |
+
|
16 |
+
# TODO add image - general / domain specific / long context
|
17 |
|
|
|
18 |
|
19 |
For release post, please see our [blog](...).
|
20 |
*To acknowledge Meta's effort in creating the foundation model and to comply with the license, we explicitly include "llama-3.1" in the model name.
|