Prompt Template

#1
by Marjovl - opened

Hi There. Do you know what the prompt template is? I want to put it on Ollama, but sometimes I get a lot of INST on my local.

Hey @Marjovl , I am also waiting for @SF-Foundation to know the prompt template. I have tried ChatML and Alapaca-Instruct and it works fine.

I don't know how to fix the INST loop issue. I have faced it with other models like Mistroll but this issue seems to be something recurrent from some months ago (https://www.linkedin.com/posts/michal-pogoda_jaskier-56-case-study-activity-7165652768337158144-RsfM/, https://huggingface.co/bardsai/jaskier-7b-dpo-v6.1/discussions/2).

Thank you for replying @mgonzs13

There's something about this model. I tried a few successful templates. The first input message generates a great response; then, when I ask a follow-up question, I get the repeated INST.

I've also seen it respond in my native language, Afrikaans. It looked pretty good! Afrikaans is a relatively small language that's based on old simplified Dutch. So, somehow it understands it, and that's impressive.

@mgonzs13 Seems they removed the model now...

Marjovl changed discussion status to closed

Sign up or log in to comment