Cicciokr's picture
tokenizer
c2944ad verified
raw
history blame
78 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast",
"model_max_length": 512
}