Tijmen2
/

cosmosage_v2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Tijmen2 commited on Feb 19

Commit

ba71829

•

1 Parent(s): 991a2f2

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -44,7 +44,7 @@ def ask_cosmosage(question):
     torch.tensor([[28705]]),
     tokenizer.encode("ASSISTANT:", add_special_tokens=False, return_tensors="pt")
     ], dim=-1).to(device)
-    generated_ids = model.generate(input_ids, max_length=input_ids.shape[1] + 1000, do_sample=True)
     return tokenizer.decode(generated_ids[0], skip_special_tokens=True)
 ```

     torch.tensor([[28705]]),
     tokenizer.encode("ASSISTANT:", add_special_tokens=False, return_tensors="pt")
     ], dim=-1).to(device)
+    generated_ids = model.generate(input_ids, max_length=input_ids.shape[1] + 1000, do_sample=True, temperature=0.4)
     return tokenizer.decode(generated_ids[0], skip_special_tokens=True)
 ```