Update README.md
Browse files
README.md
CHANGED
|
@@ -68,6 +68,7 @@ It achieves the following results on the evaluation set:
|
|
| 68 |
- Loss: 2.8876
|
| 69 |
- Accuracy: 0.4502
|
| 70 |
|
|
|
|
| 71 |
|
| 72 |
## evals
|
| 73 |
|
|
@@ -86,6 +87,12 @@ It achieves the following results on the evaluation set:
|
|
| 86 |
| | |acc_norm| 0.5664|± |0.0116|
|
| 87 |
|winogrande | 0|acc | 0.5201|± |0.0140|
|
| 88 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 89 |
|
| 90 |
## Training procedure
|
| 91 |
|
|
@@ -130,10 +137,4 @@ The following hyperparameters were used during training:
|
|
| 130 |
| 2.8038 | 1.94 | 8700 | 2.8883 | 0.4504 |
|
| 131 |
| 2.7547 | 1.97 | 8850 | 2.8876 | 0.4502 |
|
| 132 |
|
| 133 |
-
|
| 134 |
-
### Framework versions
|
| 135 |
-
|
| 136 |
-
- Transformers 4.33.3
|
| 137 |
-
- Pytorch 2.2.0.dev20231017+cu121
|
| 138 |
-
- Datasets 2.14.5
|
| 139 |
-
- Tokenizers 0.13.3
|
|
|
|
| 68 |
- Loss: 2.8876
|
| 69 |
- Accuracy: 0.4502
|
| 70 |
|
| 71 |
+
---
|
| 72 |
|
| 73 |
## evals
|
| 74 |
|
|
|
|
| 87 |
| | |acc_norm| 0.5664|± |0.0116|
|
| 88 |
|winogrande | 0|acc | 0.5201|± |0.0140|
|
| 89 |
|
| 90 |
+
| Task |Version| Metric |Value | |Stderr|
|
| 91 |
+
|-------------|------:|--------|-----:|---|-----:|
|
| 92 |
+
|arc_challenge| 0|acc |0.1971|± |0.0116|
|
| 93 |
+
| | |acc_norm|0.2278|± |0.0123|
|
| 94 |
+
|
| 95 |
+
---
|
| 96 |
|
| 97 |
## Training procedure
|
| 98 |
|
|
|
|
| 137 |
| 2.8038 | 1.94 | 8700 | 2.8883 | 0.4504 |
|
| 138 |
| 2.7547 | 1.97 | 8850 | 2.8876 | 0.4502 |
|
| 139 |
|
| 140 |
+
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|