Hugging Face's logo

aari1995
/
germeo-7b-laser

Text Generation
Transformers
Safetensors
German
mistral
hermeo
laser
conversational
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
3
aari1995 commited on
Commit
5d748fc
·
verified ·
1 Parent(s): b7577f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -30,3 +30,20 @@ Will keep you updated..
30
  | _70B parameters_ | | | | |
31
  | llama-2-70b | 0.597 | 0.674 | 0.561 | 0.611 |
32
  | leo-hessianai-70b | **0.653** | **0.721** | **0.600** | **0.658** |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  | _70B parameters_ | | | | |
31
  | llama-2-70b | 0.597 | 0.674 | 0.561 | 0.611 |
32
  | leo-hessianai-70b | **0.653** | **0.721** | **0.600** | **0.658** |
33
+
34
+
35
+
36
+
37
+ ### English benchmarks
38
+
39
+ | **English tasks:** | **MMLU** | **Hellaswag** | **ARC** | **Average** |
40
+ |------------------------------------|-------------|---------------|--------------|-------------|
41
+ | **Models / Few-shots:** | _(5 shots)_ | _(10 shots)_ | _(24 shots)_ | |
42
+ | llama-2-7b | 0.466 | 0.786 | 0.530 | 0.594 |
43
+ | leolm-hessianai-7b | 0.423 | 0.759 | 0.522 | 0.568 |
44
+ | bloom-6b4-clp-german | 0.264 | 0.525 | 0.328 | 0.372 |
45
+ | mistral-7b | **0.635** | **0.832** | 0.607 | **0.691** |
46
+ | leolm-mistral-hessianai-7b | 0.550 | 0.777 | 0.518 | 0.615 |
47
+ | hermeo-7b | 0.601 | 0.821 | **0.620** | 0.681 |
48
+ | germeo-7b-laser (this model) | 0.601 | 0.828 | 0.608 | 0.679 |
49
+