File size: 949 Bytes
94077b0 69c8e61 94077b0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
# TinyLlama-1.1B-2.5T-chat
It was created by starting with the TinyLlama-1.1B-2.5T-chat and training it on the open assistant dataset. We have attached the wandb report in pdf form to view the training run at a glance.
# Reson
This model was fine tuned to allow it to follow direction and is a steeping stone to further training, but still would be good for asking qestions about code.
# How to use
You will need the transformers>=4.31
Use your normal llama prompt templete
```
# Referrals
Run Pod - This is who I use to train th emodels on huggingface. If you use it we both get free crdits. - <a href="https://runpod.io?ref=kilq83n1" target="_blank" style="color: #3498db; text-decoration: none; font-weight: bold;">Visit Runpod's Website!</a>
Paypal - If you want to leave a tip, it is appecaheted. - <a href="paypal.me/OpenSourceTraining" target="_blank" style="color: #3498db; text-decoration: none; font-weight: bold;">Visit My Paypal!</a> |