jester6136
/

bags-llama3-chat-awq-onnx

Text Generation

onnxruntime_genai

Model card Files Files and versions

jester6136 commited on Jul 6, 2024

Commit

cbef04e

·

verified ·

1 Parent(s): 3449e7c

Update genai_config.json

Files changed (1) hide show

genai_config.json +1 -1

genai_config.json CHANGED Viewed

@@ -31,7 +31,7 @@
             "num_hidden_layers": 32,
             "num_key_value_heads": 8
         },
-        "eos_token_id": 128001,
         "pad_token_id": 128001,
         "type": "llama",
         "vocab_size": 128256

             "num_hidden_layers": 32,
             "num_key_value_heads": 8
         },
+        "eos_token_id": [128001, 128009],
         "pad_token_id": 128001,
         "type": "llama",
         "vocab_size": 128256