| license: llama2 | |
| Training is currently still underway, but this is the first epoch of a 32k context fine-tuning run of Mistral-7b over the following datasets: | |
| - emrgnt-cmplxty/sciphi-textbooks-are-all-you-need | |
| - open-phi/rag-textbook-instruct-full | |
| - open-phi/programming_books_llama | |
| - open-phi/textbooks | |
| - Open-Orca/SlimOrca | |
| - WizardLM/WizardLM_evol_instruct_70k | |