CarrotAI commited on
Commit
24e665b
·
verified ·
1 Parent(s): c54e0c7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -1
README.md CHANGED
@@ -10,4 +10,26 @@ base_model:
10
  - meta-llama/Llama-3.2-1B-Instruct
11
  pipeline_tag: text-generation
12
  ---
13
- ![image/webp](https://cdn-uploads.huggingface.co/production/uploads/64633ebb39359568c63b52ad/Z5x6H5xNuFxjGqWwJ0gqH.webp)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  - meta-llama/Llama-3.2-1B-Instruct
11
  pipeline_tag: text-generation
12
  ---
13
+ ![image/webp](https://cdn-uploads.huggingface.co/production/uploads/64633ebb39359568c63b52ad/Z5x6H5xNuFxjGqWwJ0gqH.webp)
14
+
15
+
16
+ ## Score
17
+
18
+ | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
19
+ |----------------|------:|------|-----:|--------|---|-----:|---|------|
20
+ |kobest_boolq | 1|none | 5|acc |↑ |0.5726|± |0.0132|
21
+ | | |none | 5|f1 |↑ |0.5725|± | N/A|
22
+ |kobest_copa | 1|none | 5|acc |↑ |0.5200|± |0.0158|
23
+ | | |none | 5|f1 |↑ |0.5189|± | N/A|
24
+ |kobest_hellaswag| 1|none | 5|acc |↑ |0.3640|± |0.0215|
25
+ | | |none | 5|acc_norm|↑ |0.4380|± |0.0222|
26
+ | | |none | 5|f1 |↑ |0.3592|± | N/A|
27
+ |kobest_sentineg | 1|none | 5|acc |↑ |0.5642|± |0.0249|
28
+ | | |none | 5|f1 |↑ |0.5554|± | N/A|
29
+ |kobest_wic | 1|none | 5|acc |↑ |0.5087|± |0.0141|
30
+ | | |none | 5|f1 |↑ |0.4979|± | N/A|
31
+
32
+ |Tasks|Version| Filter |n-shot| Metric | |Value | |Stderr|
33
+ |-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
34
+ |gsm8k| 3|flexible-extract| 5|exact_match|↑ |0.2995|± |0.0126|
35
+ | | |strict-match | 5|exact_match|↑ |0.2987|± |0.0126|