emrgnt-cmplxty's picture
Create README.md
eaa5f55
|
raw
history blame
384 Bytes
metadata
license: llama2

Training is currently still underway, but this is the first epoch of a 32k context fine-tuning run of Mistral-7b over the following datasets:

  • emrgnt-cmplxty/sciphi-textbooks-are-all-you-need
  • open-phi/rag-textbook-instruct-full
  • open-phi/programming_books_llama
  • open-phi/textbooks
  • Open-Orca/SlimOrca
  • WizardLM/WizardLM_evol_instruct_70k