Hugging Face's logo

livinNector
/
tabert-4k

Fill-Mask
Transformers
PyTorch
TensorBoard
distilbert
Inference Endpoints
Model card Files Metrics Community
4
livinNector commited on
Commit
7249087
·
1 Parent(s): 60162c6

Upload tokenizer

Browse files
Files changed (3) hide show
  1. added_tokens.json +7 -22
  2. tokenizer.json +0 -0
  3. vocab.txt +0 -0
added_tokens.json CHANGED
@@ -1,24 +1,9 @@
1
  {
2
- "!": 4002,
3
- "\"": 4011,
4
- "'": 4010,
5
- "(": 4008,
6
- ")": 4009,
7
- ",": 4001,
8
- "-": 4004,
9
- ".": 4000,
10
- "...": 4012,
11
- "/": 4007,
12
- "0": 4013,
13
- "1": 4014,
14
- "2": 4015,
15
- "3": 4016,
16
- "4": 4017,
17
- "5": 4018,
18
- "6": 4019,
19
- "7": 4020,
20
- "8": 4021,
21
- ":": 4005,
22
- ";": 4006,
23
- "?": 4003
24
  }
 
1
  {
2
+ "(": 4004,
3
+ ")": 4005,
4
+ "-": 4000,
5
+ "...": 4006,
6
+ "/": 4003,
7
+ ":": 4001,
8
+ ";": 4002
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  }
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff
 
vocab.txt CHANGED
The diff for this file is too large to render. See raw diff