SUS-Chat-34B

Running

Cookize commited on Dec 6, 2023

Commit

29be349

1 Parent(s): 0db7387

Update .env.local.template

Files changed (1) hide show

.env.local.template CHANGED Viewed

@@ -28,7 +28,7 @@ MODELS=`[
       "top_p": 0.95,
       "repetition_penalty": 1.0,
       "max_tokens": 1024,
-      "top_k": -1,
       "max_new_tokens": 1024
     },
     "endpoints": [{

       "top_p": 0.95,
       "repetition_penalty": 1.0,
       "max_tokens": 1024,
+      "top_k": 2048,
       "max_new_tokens": 1024
     },
     "endpoints": [{