vaibhavad
/

llama-31-mlm

Feature Extraction

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

vaibhavad commited on Sep 16

Commit

4879ed9

•

1 Parent(s): 1510662

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +2 -0

tokenizer_config.json CHANGED Viewed

@@ -2058,5 +2058,7 @@
 "attention_mask"
 ],
 "model_max_length": 131072,
 "tokenizer_class": "PreTrainedTokenizerFast"
 }

 "attention_mask"
 ],
 "model_max_length": 131072,
+"pad_token": "<|end_of_text|>",
+"padding_side": "left",
 "tokenizer_class": "PreTrainedTokenizerFast"
 }