Update README.md
Browse files
README.md
CHANGED
@@ -10,4 +10,26 @@ base_model:
|
|
10 |
- meta-llama/Llama-3.2-1B-Instruct
|
11 |
pipeline_tag: text-generation
|
12 |
---
|
13 |
-
![image/webp](https://cdn-uploads.huggingface.co/production/uploads/64633ebb39359568c63b52ad/Z5x6H5xNuFxjGqWwJ0gqH.webp)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
- meta-llama/Llama-3.2-1B-Instruct
|
11 |
pipeline_tag: text-generation
|
12 |
---
|
13 |
+
![image/webp](https://cdn-uploads.huggingface.co/production/uploads/64633ebb39359568c63b52ad/Z5x6H5xNuFxjGqWwJ0gqH.webp)
|
14 |
+
|
15 |
+
|
16 |
+
## Score
|
17 |
+
|
18 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
19 |
+
|----------------|------:|------|-----:|--------|---|-----:|---|------|
|
20 |
+
|kobest_boolq | 1|none | 5|acc |↑ |0.5726|± |0.0132|
|
21 |
+
| | |none | 5|f1 |↑ |0.5725|± | N/A|
|
22 |
+
|kobest_copa | 1|none | 5|acc |↑ |0.5200|± |0.0158|
|
23 |
+
| | |none | 5|f1 |↑ |0.5189|± | N/A|
|
24 |
+
|kobest_hellaswag| 1|none | 5|acc |↑ |0.3640|± |0.0215|
|
25 |
+
| | |none | 5|acc_norm|↑ |0.4380|± |0.0222|
|
26 |
+
| | |none | 5|f1 |↑ |0.3592|± | N/A|
|
27 |
+
|kobest_sentineg | 1|none | 5|acc |↑ |0.5642|± |0.0249|
|
28 |
+
| | |none | 5|f1 |↑ |0.5554|± | N/A|
|
29 |
+
|kobest_wic | 1|none | 5|acc |↑ |0.5087|± |0.0141|
|
30 |
+
| | |none | 5|f1 |↑ |0.4979|± | N/A|
|
31 |
+
|
32 |
+
|Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
|
33 |
+
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|
34 |
+
|gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.2995|± |0.0126|
|
35 |
+
| | |strict-match | 5|exact_match|↑ |0.2987|± |0.0126|
|