xlm-roberta-flash-implementation / tokenizer_config.json
bwang0911's picture
Update tokenizer_config.json
81a578e verified
raw
history blame
75 Bytes
{
"model_max_length": 8194,
"tokenizer_class": "XLMRobertaTokenizer"
}