Fine-tuning on coding tasks

#14
by sgaseretto - opened

Are there plans on making a code generation model on top of this? Like StarCoder, CodeT5, WizardCoder, etc. Is sad that we still don't have a dataset similar to the one "Textbooks is all you need" build for their model

@sgaseretto we are def scoping some work around coding tasks, open to suggestions!

Sign up or log in to comment