Requires a [custom version](https://github.com/bigcode-project/transformers/tree/sc2-ablations) of the transformers library to run which can be installed with `pip install "git+https://github.com/bigcode-project/transformers.git@sc2-ablations"`