Hugging Face's logo

tiiuae
/
falcon-7b-instruct

Text Generation
Transformers
PyTorch
Core ML
Safetensors
English
falcon
conversational
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
125

what is the prompt used for instruction tuning, and why the model is pre-trained on refineweb but also instruction-tuned with it?

#30
by zerolyn - opened
Discussion
zerolyn

can i have the prompts for instruction tuning? I'm also confused about why the model is pre-trained with refineweb but also instruction-tuned with its subset?

ccasimiro

Hi, as requested by @zerolyn , would be very useful to have the exact prompt used for fine-tuning to make the generation more reliable and robust. Thanks a lot for your contribution to the open-source!

kronus86

Can we please get the prompt used for fine-tuning.

michaelomahony

Bump

Sign up or log in to comment