TinyLlama-1.1B-2.5T-chat

It was created by starting with the TinyLlama-1.1B-2.5T-chat and training it on the open assistant dataset. We have attached the wandb report in pdf form to view the training run at a glance.

Reson

This model was fine tuned to allow it to follow direction and is a steeping stone to further training, but still would be good for asking qestions about code.

How to use

You will need the transformers>=4.31 Use your normal llama prompt templete


# Referrals
Run Pod - This is who I use to train th emodels on huggingface. If you use it we both get free crdits. - <a href="https://runpod.io?ref=kilq83n1" target="_blank" style="color: #3498db; text-decoration: none; font-weight: bold;">Visit Runpod's Website!</a>

Paypal - If you want to leave a tip, it is appecaheted. - <a href="paypal.me/OpenSourceTraining" target="_blank" style="color: #3498db; text-decoration: none; font-weight: bold;">Visit My Paypal!</a>