whatsthispdf08

Runtime error

mitulagr2 commited on Jun 6, 2024

Commit

833a9a6

1 Parent(s): 446d023

Update rag.py

Files changed (1) hide show

app/rag.py CHANGED Viewed

@@ -19,9 +19,10 @@ class ChatPDF:
             model="qwen:1.8b",
             keep_alive=-1,
             temperature=0,
             num_predict=512,
             repeat_penalty=1.3,
-            metadata={"num_predict":512},
         )
         self.text_splitter = RecursiveCharacterTextSplitter(chunk_size=2048, chunk_overlap=128)

             model="qwen:1.8b",
             keep_alive=-1,
             temperature=0,
+            max_tokens=512,
             num_predict=512,
             repeat_penalty=1.3,
+            metadata={"num_predict":512,"max_tokens":512},
         )
         self.text_splitter = RecursiveCharacterTextSplitter(chunk_size=2048, chunk_overlap=128)