mlc-ai
/

Phi-3-mini-128k-instruct-q4f32_1-MLC

Model card Files Files and versions

ruihanglai commited on Dec 13, 2024

Commit

1dedee6

·

verified ·

1 Parent(s): 1c0ae53

Update mlc-chat-config.json

Files changed (1) hide show

mlc-chat-config.json +1 -0

mlc-chat-config.json CHANGED Viewed

@@ -11,6 +11,7 @@
     "intermediate_size": 8192,
     "rms_norm_eps": 1e-05,
     "num_key_value_heads": 32,
     "position_embedding_base": 10000.0,
     "context_window_size": 131072,
     "prefill_chunk_size": 2048,

     "intermediate_size": 8192,
     "rms_norm_eps": 1e-05,
     "num_key_value_heads": 32,
+    "max_position_embeddings": 131072,
     "position_embedding_base": 10000.0,
     "context_window_size": 131072,
     "prefill_chunk_size": 2048,