Hugging Face's logo

OpenLLM-Ro
/
RoLlama2-7b-Base-2024-05-14

Text Generation
Transformers
PyTorch
Romanian
llama
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
mihaimasala commited on
Commit
1bae7d1
·
verified ·
1 Parent(s): 5924d83

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +146 -2
README.md CHANGED
@@ -9,8 +9,8 @@ model-index:
9
  - task:
10
  type: text-generation
11
  dataset:
12
- name: Romanian_Academic_Benchmarks_Average
13
- type: Romanian_Academic_Benchmarks_Average
14
  metrics:
15
  - name: Average
16
  type: accuracy
@@ -69,6 +69,150 @@ model-index:
69
  - name: Average
70
  type: accuracy
71
  value: 44.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72
  ---
73
 
74
  # Model Card for Model ID
 
9
  - task:
10
  type: text-generation
11
  dataset:
12
+ name: Romanian_Academic_Benchmarks
13
+ type: Romanian_Academic_Benchmarks
14
  metrics:
15
  - name: Average
16
  type: accuracy
 
69
  - name: Average
70
  type: accuracy
71
  value: 44.0
72
+ - task:
73
+ type: text-generation
74
+ dataset:
75
+ name: LaRoSeDa_binary
76
+ type: LaRoSeDa_binary
77
+ metrics:
78
+ - name: Average
79
+ type: macro-f1
80
+ value: 83.245
81
+ - task:
82
+ type: text-generation
83
+ dataset:
84
+ name: LaRoSeDa_multiclass
85
+ type: LaRoSeDa_multiclass
86
+ metrics:
87
+ - name: Average
88
+ type: macro-f1
89
+ value: 61.040000000000006
90
+ - task:
91
+ type: text-generation
92
+ dataset:
93
+ name: LaRoSeDa_binary_finetuned
94
+ type: LaRoSeDa_binary_finetuned
95
+ metrics:
96
+ - name: Average
97
+ type: macro-f1
98
+ value: 98.9666527738873
99
+ - task:
100
+ type: text-generation
101
+ dataset:
102
+ name: LaRoSeDa_multiclass_finetuned
103
+ type: LaRoSeDa_multiclass_finetuned
104
+ metrics:
105
+ - name: Average
106
+ type: macro-f1
107
+ value: 87.7198050161592
108
+ - task:
109
+ type: text-generation
110
+ dataset:
111
+ name: WMT_EN-RO
112
+ type: WMT_EN-RO
113
+ metrics:
114
+ - name: Average
115
+ type: bleu
116
+ value: 10.01
117
+ - task:
118
+ type: text-generation
119
+ dataset:
120
+ name: WMT_RO-EN
121
+ type: WMT_RO-EN
122
+ metrics:
123
+ - name: Average
124
+ type: bleu
125
+ value: 13.032499999999999
126
+ - task:
127
+ type: text-generation
128
+ dataset:
129
+ name: WMT_EN-RO_finetuned
130
+ type: WMT_EN-RO_finetuned
131
+ metrics:
132
+ - name: Average
133
+ type: bleu
134
+ value: 27.8468226696502
135
+ - task:
136
+ type: text-generation
137
+ dataset:
138
+ name: WMT_RO-EN_finetuned
139
+ type: WMT_RO-EN_finetuned
140
+ metrics:
141
+ - name: Average
142
+ type: bleu
143
+ value: 39.300054525566104
144
+ - task:
145
+ type: text-generation
146
+ dataset:
147
+ name: XQuAD
148
+ type: XQuAD
149
+ metrics:
150
+ - name: Average
151
+ type: exact_match
152
+ value: 30.14705
153
+ - task:
154
+ type: text-generation
155
+ dataset:
156
+ name: XQuAD
157
+ type: XQuAD
158
+ metrics:
159
+ - name: Average
160
+ type: f1
161
+ value: 47.0304
162
+ - task:
163
+ type: text-generation
164
+ dataset:
165
+ name: XQuAD_finetuned
166
+ type: XQuAD_finetuned
167
+ metrics:
168
+ - name: Average
169
+ type: exact_match
170
+ value: 67.0588235294117
171
+ - task:
172
+ type: text-generation
173
+ dataset:
174
+ name: XQuAD
175
+ type: XQuAD
176
+ metrics:
177
+ - name: Average
178
+ type: f1
179
+ value: 79.9624140326139
180
+ - task:
181
+ type: text-generation
182
+ dataset:
183
+ name: STS
184
+ type: STS
185
+ metrics:
186
+ - name: Average
187
+ type: spearman
188
+ value: 7.886666666666667
189
+ - task:
190
+ type: text-generation
191
+ dataset:
192
+ name: STS
193
+ type: STS
194
+ metrics:
195
+ - name: Average
196
+ type: pearson
197
+ value: 7.976666666666667
198
+ - task:
199
+ type: text-generation
200
+ dataset:
201
+ name: STS_finetuned
202
+ type: STS_finetuned
203
+ metrics:
204
+ - name: Average
205
+ type: spearman
206
+ value: 71.749068976055
207
+ - task:
208
+ type: text-generation
209
+ dataset:
210
+ name: STS_finetuned
211
+ type: STS_finetuned
212
+ metrics:
213
+ - name: Average
214
+ type: pearson
215
+ value: 71.9866084841066
216
  ---
217
 
218
  # Model Card for Model ID