nickprock commited on
Commit
247c3fb
·
verified ·
1 Parent(s): 5b7ce79

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -124,10 +124,10 @@ model-index:
124
  metrics:
125
  - type: cosine_accuracy
126
  value: 0.9089999794960022
127
- name: Cosine Accuracy
128
  - type: cosine_accuracy
129
  value: 0.9210000038146973
130
- name: Cosine Accuracy
131
  ---
132
 
133
  # SentenceTransformer based on DeepMount00/Italian-ModernBERT-base
@@ -233,7 +233,7 @@ You can finetune this model on your own dataset.
233
 
234
  #### Triplet
235
 
236
- * Dataset: `mmarco_dev`
237
  * Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
238
 
239
  | Metric | Value |
@@ -259,7 +259,8 @@ You can finetune this model on your own dataset.
259
  #### mmarco
260
 
261
  * Dataset: mmarco
262
- * Size: 39,780,811 training samples
 
263
  * Columns: <code>query</code>, <code>positive</code>, and <code>negative</code>
264
  * Approximate statistics based on the first 1000 samples:
265
  | | query | positive | negative |
@@ -285,7 +286,7 @@ You can finetune this model on your own dataset.
285
  #### mmarco
286
 
287
  * Dataset: mmarco
288
- * Size: 39,780,811 evaluation samples
289
  * Columns: <code>query</code>, <code>positive</code>, and <code>negative</code>
290
  * Approximate statistics based on the first 1000 samples:
291
  | | query | positive | negative |
@@ -450,6 +451,10 @@ You can finetune this model on your own dataset.
450
  | 0.24 | 750 | 1.4301 | 1.3971 | 0.8930 |
451
  | 0.32 | 1000 | 1.3361 | 1.2686 | 0.8955 |
452
  | **0.4** | **1250** | **1.237** | **1.2151** | **0.909** |
 
 
 
 
453
  | -1 | -1 | - | - | 0.9210 |
454
 
455
  * The bold row denotes the saved checkpoint.
 
124
  metrics:
125
  - type: cosine_accuracy
126
  value: 0.9089999794960022
127
+ name: Cosine Accuracy on Dev
128
  - type: cosine_accuracy
129
  value: 0.9210000038146973
130
+ name: Cosine Accuracy on Test
131
  ---
132
 
133
  # SentenceTransformer based on DeepMount00/Italian-ModernBERT-base
 
233
 
234
  #### Triplet
235
 
236
+ * Dataset: `mmarco_test`
237
  * Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
238
 
239
  | Metric | Value |
 
259
  #### mmarco
260
 
261
  * Dataset: mmarco
262
+ * Total Size: 39,780,811
263
+ * Size: 50,000 training samples
264
  * Columns: <code>query</code>, <code>positive</code>, and <code>negative</code>
265
  * Approximate statistics based on the first 1000 samples:
266
  | | query | positive | negative |
 
286
  #### mmarco
287
 
288
  * Dataset: mmarco
289
+ * Size: 2,000 evaluation samples
290
  * Columns: <code>query</code>, <code>positive</code>, and <code>negative</code>
291
  * Approximate statistics based on the first 1000 samples:
292
  | | query | positive | negative |
 
451
  | 0.24 | 750 | 1.4301 | 1.3971 | 0.8930 |
452
  | 0.32 | 1000 | 1.3361 | 1.2686 | 0.8955 |
453
  | **0.4** | **1250** | **1.237** | **1.2151** | **0.909** |
454
+
455
+ ## Test Logs
456
+ | Epoch | Step | Training Loss | Validation Loss | mmarco_dev_cosine_accuracy |
457
+ |:-------:|:--------:|:-------------:|:---------------:|:--------------------------:|
458
  | -1 | -1 | - | - | 0.9210 |
459
 
460
  * The bold row denotes the saved checkpoint.