license: apache-2.0 | |
language: | |
- en | |
pipeline_tag: text-generation | |
tags: | |
- persimmon | |
# perSLIMmon-8b-base | |
> persimmon-8b went to the vocab lipo clinic | |
This is a slimmed-down version of [persimmon-8b-base](https://huggingface.co/adept/persimmon-8b-base) that removes the 70,000 unused entries in the model vocab and tokenizer. Should be _slightly_ faster. | |
Credit: [fine-tune-fuyu](https://github.com/phillip-kravtsov/fine-tune-fuyu) (`scripts/surgery.py` was adapted for persimmon) |