File size: 736 Bytes
d90b3a8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
# GPT-NeoX Auxiliary Tools
This directory contains a number of auxiliary tools that are useful for working with GPT-NeoX but not part of the main training code.
## Bash
This directory contains some simple, frequently used bash commands to make working on multiple machines easier.
## Checkpoints
This directory contains tools for manipulating and converting checkpoints including changing the parallelism settings of a pretrained model, converting between GPT-NeoX and the transformers library, and updating checkpoints trained with Version 1.x of this library to be compatible with Version 2.x.
## Datasets
This directory contains tools for downloading and preprocessing datasets to the format expected by the GPT-NeoX library.
|