# Models reduced in size and overfitted for testing

Folders structure
```
<model architecture>/<reduced hidden_size>/<either base for the base model or lora for adapter>
```

- `base`: overfitted to complete this [Sagan's Pale Blue Dot paragraph](https://github.com/ltoniazzi/reduce-llms-for-testing/blob/main/data/pale_blue_dot.txt)
- `lora`: overfitted to complete this [Bohemian_Rapshody paragraph](https://github.com/ltoniazzi/reduce-llms-for-testing/blob/main/data/bohemian_rapshody.txt)

Models generated with [this repo](https://github.com/ltoniazzi/reduce-llms-for-testing).