MistriDevLab

Build error

johann22 commited on Dec 21, 2023

Commit

e1383ff

1 Parent(s): 4cb60ac

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -53,7 +53,7 @@ def run_gpt(
     generate_kwargs = dict(
         temperature=0.9,
-        max_new_tokens=512,
         top_p=0.95,
         repetition_penalty=1.0,
         do_sample=True,

     generate_kwargs = dict(
         temperature=0.9,
+        max_new_tokens=256,
         top_p=0.95,
         repetition_penalty=1.0,
         do_sample=True,