GGUF
conversational

What is the prompt template in plain text?

#1
by apepkuss79 - opened

What is the prompt template in plain text?

The three delimiters are <unk>(token_id=0) , reserved_0(token_id=3), reserved_1(token_id=4)

[<unk>]sytem_message[reserved_0]user_message[reserved_1]response

@BitVoyage The tokenizer cannot separate reserved_0/reserved_1 from English text.
Why not add <> to <reserved_0> and <reserved_1> for easier identification?

Index Team org

Good suggestion! We have fixed it in the next version.

AsirAsir changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment