moussaKam commited on
Commit
b419deb
1 Parent(s): a8c53fd

Add tokenizer.json, Modify sentencepiece model

Browse files
Files changed (3) hide show
  1. sentencepiece.bpe.model +0 -0
  2. tokenizer.json +0 -0
  3. vocab.json +0 -0
sentencepiece.bpe.model CHANGED
Binary files a/sentencepiece.bpe.model and b/sentencepiece.bpe.model differ
 
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
vocab.json DELETED
The diff for this file is too large to render. See raw diff