mistral-community

/

pixtral-12b

like 76

Follow

Unofficial Mistral Community 218

Hey @ArthurZ is there a reason why the chat_template isn't present in the tokenizer config? It would be convenient to have the tokenizer/processor work with apply_chat_template by default.

It's here: https://huggingface.co/mistral-community/pixtral-12b/blob/main/chat_template.json. But this is currently getting reworked, see https://github.com/huggingface/transformers/pull/33957 for discussion

This PR should be applied for the convenience of users. Using this model in vllm is currently difficult.

@mgoin please add a missing comma at the end of the added line