readme file
Browse files
README.md
CHANGED
|
@@ -4,6 +4,9 @@ tags:
|
|
| 4 |
- roberta-base
|
| 5 |
- roberta-base-epoch_0
|
| 6 |
license: mit
|
|
|
|
|
|
|
|
|
|
| 7 |
---
|
| 8 |
|
| 9 |
# RoBERTa, Intermediate Checkpoint - Epoch 0
|
|
@@ -18,7 +21,7 @@ These models were trained in part of a work that studies how simple statistics f
|
|
| 18 |
such as co-occurrences affects model predictions, which are described in the paper
|
| 19 |
[Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions](https://arxiv.org/abs/2207.14251).
|
| 20 |
|
| 21 |
-
This is
|
| 22 |
|
| 23 |
## Model Description
|
| 24 |
|
|
|
|
| 4 |
- roberta-base
|
| 5 |
- roberta-base-epoch_0
|
| 6 |
license: mit
|
| 7 |
+
datasets:
|
| 8 |
+
- wikipedia
|
| 9 |
+
- bookcorpus
|
| 10 |
---
|
| 11 |
|
| 12 |
# RoBERTa, Intermediate Checkpoint - Epoch 0
|
|
|
|
| 21 |
such as co-occurrences affects model predictions, which are described in the paper
|
| 22 |
[Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions](https://arxiv.org/abs/2207.14251).
|
| 23 |
|
| 24 |
+
This is RoBERTa-base epoch_0.
|
| 25 |
|
| 26 |
## Model Description
|
| 27 |
|