The tokenizer loads too slow.
#1
by
DicoTiar
- opened
At every moment, when I load this model and tokenizer, as the tokenizer is not implemented in fast_tokenizer, it keeps converting to the fast version.
Can anybody from fireact authors, upload or update this issue?
Thank you in advance.