Update README.md
Browse files
README.md
CHANGED
@@ -124,10 +124,10 @@ model-index:
|
|
124 |
metrics:
|
125 |
- type: cosine_accuracy
|
126 |
value: 0.9089999794960022
|
127 |
-
name: Cosine Accuracy
|
128 |
- type: cosine_accuracy
|
129 |
value: 0.9210000038146973
|
130 |
-
name: Cosine Accuracy
|
131 |
---
|
132 |
|
133 |
# SentenceTransformer based on DeepMount00/Italian-ModernBERT-base
|
@@ -233,7 +233,7 @@ You can finetune this model on your own dataset.
|
|
233 |
|
234 |
#### Triplet
|
235 |
|
236 |
-
* Dataset: `
|
237 |
* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
|
238 |
|
239 |
| Metric | Value |
|
@@ -259,7 +259,8 @@ You can finetune this model on your own dataset.
|
|
259 |
#### mmarco
|
260 |
|
261 |
* Dataset: mmarco
|
262 |
-
* Size: 39,780,811
|
|
|
263 |
* Columns: <code>query</code>, <code>positive</code>, and <code>negative</code>
|
264 |
* Approximate statistics based on the first 1000 samples:
|
265 |
| | query | positive | negative |
|
@@ -285,7 +286,7 @@ You can finetune this model on your own dataset.
|
|
285 |
#### mmarco
|
286 |
|
287 |
* Dataset: mmarco
|
288 |
-
* Size:
|
289 |
* Columns: <code>query</code>, <code>positive</code>, and <code>negative</code>
|
290 |
* Approximate statistics based on the first 1000 samples:
|
291 |
| | query | positive | negative |
|
@@ -450,6 +451,10 @@ You can finetune this model on your own dataset.
|
|
450 |
| 0.24 | 750 | 1.4301 | 1.3971 | 0.8930 |
|
451 |
| 0.32 | 1000 | 1.3361 | 1.2686 | 0.8955 |
|
452 |
| **0.4** | **1250** | **1.237** | **1.2151** | **0.909** |
|
|
|
|
|
|
|
|
|
453 |
| -1 | -1 | - | - | 0.9210 |
|
454 |
|
455 |
* The bold row denotes the saved checkpoint.
|
|
|
124 |
metrics:
|
125 |
- type: cosine_accuracy
|
126 |
value: 0.9089999794960022
|
127 |
+
name: Cosine Accuracy on Dev
|
128 |
- type: cosine_accuracy
|
129 |
value: 0.9210000038146973
|
130 |
+
name: Cosine Accuracy on Test
|
131 |
---
|
132 |
|
133 |
# SentenceTransformer based on DeepMount00/Italian-ModernBERT-base
|
|
|
233 |
|
234 |
#### Triplet
|
235 |
|
236 |
+
* Dataset: `mmarco_test`
|
237 |
* Evaluated with [<code>TripletEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.TripletEvaluator)
|
238 |
|
239 |
| Metric | Value |
|
|
|
259 |
#### mmarco
|
260 |
|
261 |
* Dataset: mmarco
|
262 |
+
* Total Size: 39,780,811
|
263 |
+
* Size: 50,000 training samples
|
264 |
* Columns: <code>query</code>, <code>positive</code>, and <code>negative</code>
|
265 |
* Approximate statistics based on the first 1000 samples:
|
266 |
| | query | positive | negative |
|
|
|
286 |
#### mmarco
|
287 |
|
288 |
* Dataset: mmarco
|
289 |
+
* Size: 2,000 evaluation samples
|
290 |
* Columns: <code>query</code>, <code>positive</code>, and <code>negative</code>
|
291 |
* Approximate statistics based on the first 1000 samples:
|
292 |
| | query | positive | negative |
|
|
|
451 |
| 0.24 | 750 | 1.4301 | 1.3971 | 0.8930 |
|
452 |
| 0.32 | 1000 | 1.3361 | 1.2686 | 0.8955 |
|
453 |
| **0.4** | **1250** | **1.237** | **1.2151** | **0.909** |
|
454 |
+
|
455 |
+
## Test Logs
|
456 |
+
| Epoch | Step | Training Loss | Validation Loss | mmarco_dev_cosine_accuracy |
|
457 |
+
|:-------:|:--------:|:-------------:|:---------------:|:--------------------------:|
|
458 |
| -1 | -1 | - | - | 0.9210 |
|
459 |
|
460 |
* The bold row denotes the saved checkpoint.
|