alpaca-loraa / hf_ckpt /tokenizer_config.json
ayuan0324's picture
Update hf_ckpt/tokenizer_config.json
2222c6a
raw
history blame
163 Bytes
{
"bos_token": "",
"eos_token": "",
"model_max_length": 1000000000000000019884624838656,
"tokenizer_class": "LlamaTokenizer",
"unk_token": ""
}