Change BOS token from 0 to 2 as BOS token is equal to EOS for OPT. See: https://github.com/huggingface/transformers/issues/17431 (#1)

- Change BOS token from 0 to 2 as BOS token is equal to EOS for OPT. See: https://github.com/huggingface/transformers/issues/17431 (7837d7f06a35bfeda356da38dd890cb5b71e4fc5)


Co-authored-by: Patrick von Platen <[email protected]>

config.json

@@ -6,7 +6,7 @@
     "OPTForCausalLM"
   ],
   "attention_dropout": 0.0,
-  "bos_token_id": 0,
+  "bos_token_id": 2,
   "do_layer_norm_before": false,
   "dropout": 0.1,
   "eos_token_id": 2,