knowledgator
/

SMILES-FAST-TOKENIZER

Model card Files Files and versions Community

BioMike commited on Mar 29, 2024

Commit

378d7ba

·

verified ·

1 Parent(s): 1dbd139

Update tokenizer.json

Files changed (1) hide show

tokenizer.json +1 -1

tokenizer.json CHANGED Viewed

@@ -64,7 +64,7 @@
       {
         "type": "Split",
         "pattern": {
-          "Regex": "\\[|\\]|0|1|2|3|4|5|6|7|8|9|-|\\+|H|@|/|\\"
         },
         "behavior": "Isolated",
         "invert": false

       {
         "type": "Split",
         "pattern": {
+          "Regex": "\\[|\\]|0|1|2|3|4|5|6|7|8|9|-|\\+|H|@"
         },
         "behavior": "Isolated",
         "invert": false