Will any prompt format work?

#1
by Jdods84 - opened

I have an Alpaca prompt format for use with character RP. Will this work?

You would have to check the source repo for details like this - I only provide the quants. In this case, the model author says to use chatml.

Personally, I don't usually care much for the prompt format myself - a good model will understand my prompt format, but without doubt, prompt format has an effect, especially on smaller models. I would suggest to try it and see what the results are, and maybe try with chatml to see if it makes a real difference.

mradermacher changed discussion status to closed

Sign up or log in to comment