pretrain core
Browse files
README.md
CHANGED
|
@@ -59,7 +59,7 @@ Total number of tokens in the optimized dataset '../core-data-0-0-1073741824-409
|
|
| 59 |
```
|
| 60 |
|
| 61 |
```bash
|
| 62 |
-
CUDA_VISIBLE_DEVICES=0 CUDA_LAUNCH_BLOCKING=0 PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True litgpt pretrain --config
|
| 63 |
```
|
| 64 |
|
| 65 |
```
|
|
|
|
| 59 |
```
|
| 60 |
|
| 61 |
```bash
|
| 62 |
+
CUDA_VISIBLE_DEVICES=0 CUDA_LAUNCH_BLOCKING=0 PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True litgpt pretrain --config pretrain_core_model.yaml
|
| 63 |
```
|
| 64 |
|
| 65 |
```
|