Spaces:

Kuberwastaken
/

TREAT

Running

Kuberwastaken commited on Jan 10

Commit

a7b8952

1 Parent(s): 54f81d8

Adjusted maximum tokens

Files changed (1) hide show

model/analyzer.py CHANGED Viewed

@@ -104,9 +104,9 @@ class ContentAnalyzer:
                     print("Generating response...")
                     outputs = self.model.generate(
                         **inputs,
-                        max_new_tokens=5,
                         do_sample=True,
-                        temperature=0.6,
                         top_p=0.9,
                         pad_token_id=self.tokenizer.eos_token_id
                     )

                     print("Generating response...")
                     outputs = self.model.generate(
                         **inputs,
+                        max_new_tokens=10,
                         do_sample=True,
+                        temperature=0.4,
                         top_p=0.9,
                         pad_token_id=self.tokenizer.eos_token_id
                     )