Adds the tokenizer configuration file

#2
by lysandre HF staff - opened
ALBERT community org

The tokenizer configuration file is missing and therefore leading to unforeseen errors after the migration of the canonical models.

Refer to the following issue for moreinformation: transformers#29050

ALBERT community org

lgtm

lysandre changed pull request status to open
lysandre changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment