| # GPT-NeoX Auxiliary Tools | |
| This directory contains a number of auxiliary tools that are useful for working with GPT-NeoX but not part of the main training code. | |
| ## Bash | |
| This directory contains some simple, frequently used bash commands to make working on multiple machines easier. | |
| ## Checkpoints | |
| This directory contains tools for manipulating and converting checkpoints including changing the parallelism settings of a pretrained model, converting between GPT-NeoX and the transformers library, and updating checkpoints trained with Version 1.x of this library to be compatible with Version 2.x. | |
| ## Datasets | |
| This directory contains tools for downloading and preprocessing datasets to the format expected by the GPT-NeoX library. | |