Hugging Face's logo

ValiantLabs
/
Llama3.1-70B-ShiningValiant2

Text Generation
Safetensors
English
llama
shining-valiant
shining-valiant-2
valiant
valiant-labs
llama-3.1
llama-3.1-instruct
llama-3.1-instruct-70b
llama-3
llama-3-instruct
llama-3-instruct-70b
70b
science
physics
biology
chemistry
compsci
computer-science
engineering
logic
rationality
advanced
expert
technical
conversational
chat
instruct
Eval Results
Model card Files Community
1
sequelbox commited on
Commit
5543662
•
1 Parent(s): 7428c3e

evals

Browse files
Files changed (1) hide show
  1. README.md +123 -0
README.md CHANGED
@@ -36,6 +36,129 @@ datasets:
36
  - sequelbox/Spurline
37
  - sequelbox/Supernova
38
  model_type: llama
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
  license: llama3.1
40
  ---
41
 
 
36
  - sequelbox/Spurline
37
  - sequelbox/Supernova
38
  model_type: llama
39
+ model-index:
40
+ - name: Llama3.1-70B-ShiningValiant2
41
+ results:
42
+ - task:
43
+ type: text-generation
44
+ name: Text Generation
45
+ dataset:
46
+ name: Winogrande (5-Shot)
47
+ type: Winogrande
48
+ args:
49
+ num_few_shot: 5
50
+ metrics:
51
+ - type: acc
52
+ value: 84.93
53
+ name: acc
54
+ - task:
55
+ type: text-generation
56
+ name: Text Generation
57
+ dataset:
58
+ name: MMLU College Biology (5-Shot)
59
+ type: MMLU
60
+ args:
61
+ num_few_shot: 5
62
+ metrics:
63
+ - type: acc
64
+ value: 93.75
65
+ name: acc
66
+ - task:
67
+ type: text-generation
68
+ name: Text Generation
69
+ dataset:
70
+ name: MMLU High School Biology (5-Shot)
71
+ type: MMLU
72
+ args:
73
+ num_few_shot: 5
74
+ metrics:
75
+ - type: acc
76
+ value: 91.94
77
+ name: acc
78
+ - task:
79
+ type: text-generation
80
+ name: Text Generation
81
+ dataset:
82
+ name: MMLU Conceptual Physics (5-Shot)
83
+ type: MMLU
84
+ args:
85
+ num_few_shot: 5
86
+ metrics:
87
+ - type: acc
88
+ value: 81.70
89
+ name: acc
90
+ - task:
91
+ type: text-generation
92
+ name: Text Generation
93
+ dataset:
94
+ name: MMLU College Physics (5-Shot)
95
+ type: MMLU
96
+ args:
97
+ num_few_shot: 5
98
+ metrics:
99
+ - type: acc
100
+ value: 60.78
101
+ name: acc
102
+ - task:
103
+ type: text-generation
104
+ name: Text Generation
105
+ dataset:
106
+ name: MMLU High School Physics (5-Shot)
107
+ type: MMLU
108
+ args:
109
+ num_few_shot: 5
110
+ metrics:
111
+ - type: acc
112
+ value: 62.91
113
+ name: acc
114
+ - task:
115
+ type: text-generation
116
+ name: Text Generation
117
+ dataset:
118
+ name: MMLU College Chemistry (5-Shot)
119
+ type: MMLU
120
+ args:
121
+ num_few_shot: 5
122
+ metrics:
123
+ - type: acc
124
+ value: 55.00
125
+ name: acc
126
+ - task:
127
+ type: text-generation
128
+ name: Text Generation
129
+ dataset:
130
+ name: MMLU High School Chemistry (5-Shot)
131
+ type: MMLU
132
+ args:
133
+ num_few_shot: 5
134
+ metrics:
135
+ - type: acc
136
+ value: 75.86
137
+ name: acc
138
+ - task:
139
+ type: text-generation
140
+ name: Text Generation
141
+ dataset:
142
+ name: MMLU Astronomy (5-Shot)
143
+ type: MMLU
144
+ args:
145
+ num_few_shot: 5
146
+ metrics:
147
+ - type: acc
148
+ value: 89.47
149
+ name: acc
150
+ - task:
151
+ type: text-generation
152
+ name: Text Generation
153
+ dataset:
154
+ name: MMLU College Computer Science (5-Shot)
155
+ type: MMLU
156
+ args:
157
+ num_few_shot: 5
158
+ metrics:
159
+ - type: acc
160
+ value: 66.00
161
+ name: acc
162
  license: llama3.1
163
  ---
164