Update README.md
Browse files
README.md
CHANGED
@@ -153,8 +153,7 @@ The language adaptation technique used to train Cerebras-1.3B-GL is based in the
|
|
153 |
|
154 |
### Training data
|
155 |
|
156 |
-
[CorpusNÓS](https://zenodo.org/records/10687642 )
|
157 |
-
|
158 |
|
159 |
### Training hyperparameters
|
160 |
|
@@ -172,7 +171,7 @@ The language adaptation technique used to train Cerebras-1.3B-GL is based in the
|
|
172 |
- num_epochs: 1.2
|
173 |
|
174 |
### Framework
|
175 |
-
The
|
176 |
|
177 |
## Evaluation
|
178 |
TO-DO
|
|
|
153 |
|
154 |
### Training data
|
155 |
|
156 |
+
[CorpusNÓS](https://zenodo.org/records/10687642 )
|
|
|
157 |
|
158 |
### Training hyperparameters
|
159 |
|
|
|
171 |
- num_epochs: 1.2
|
172 |
|
173 |
### Framework
|
174 |
+
The training was conducted in the Galicia Supercomputing Center ([CESGA](https://www.cesga.es/en/home-2/)), using 4 nodes with 2 GPUs NVIDIA A100 (8GPUS in total)
|
175 |
|
176 |
## Evaluation
|
177 |
TO-DO
|