rinna
/

japanese-roberta-base

Inference Endpoints

Model card Files Files and versions Community

tianyuz commited on Aug 27, 2021

Commit

22976fc

·

1 Parent(s): d280bb0

Fix type in readme

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -61,7 +61,7 @@ tokens = tokenizer.tokenize(text)
 print(tokens)  # output: ['[CLS]', '▁4', '年に', '1', '度', 'オリンピック', 'は', '開かれる', '。']
 # mask a token
-masked_idx = 6
 tokens[masked_idx] = tokenizer.mask_token
 print(tokens)  # output: ['[CLS]', '▁4', '年に', '1', '度', '[MASK]', 'は', '開かれる', '。']

 print(tokens)  # output: ['[CLS]', '▁4', '年に', '1', '度', 'オリンピック', 'は', '開かれる', '。']
 # mask a token
+masked_idx = 5
 tokens[masked_idx] = tokenizer.mask_token
 print(tokens)  # output: ['[CLS]', '▁4', '年に', '1', '度', '[MASK]', 'は', '開かれる', '。']