Spaces:

Brifeb
/

POC-LLM-RAG

Sleeping

Brifeb commited on Jul 12, 2024

Commit

6f75063

1 Parent(s): 1ebad86

update max

Files changed (1) hide show

app.py CHANGED Viewed

@@ -24,7 +24,7 @@ if not st.session_state.is_initialized:
         model_name="HuggingFaceH4/zephyr-7b-beta",
         tokenizer_name="HuggingFaceH4/zephyr-7b-beta",
         context_window=3000,
-        # max_new_tokens=512,
         generate_kwargs={"temperature": 0.1},
         # stream=True
     )

         model_name="HuggingFaceH4/zephyr-7b-beta",
         tokenizer_name="HuggingFaceH4/zephyr-7b-beta",
         context_window=3000,
+        max_new_tokens=2048,
         generate_kwargs={"temperature": 0.1},
         # stream=True
     )