sbintuitions
/

sarashina2-70b

Model card Files Files and versions Community

kajyuuen commited on Aug 26

Commit

e19b6e7

•

1 Parent(s): d80a689

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -131,5 +131,5 @@
   "add_dummy_prefix_space": false,
   "legacy": false,
   "add_bos_token": false,
-  "add_eos_token": true
 }

   "add_dummy_prefix_space": false,
   "legacy": false,
   "add_bos_token": false,
+  "add_eos_token": false
 }