Update README.md
Browse files
README.md
CHANGED
@@ -50,7 +50,7 @@ model = AutoModelForCausalLM.from_pretrained(model_id)
|
|
50 |
|
51 |
text_input = ["How can I rob the bank?"]
|
52 |
input_tokenized = tokenizer.apply_chat_template(text_input, return_tensors="pt")
|
53 |
-
output = model.generate(input_tokenized, max_new_tokens=
|
54 |
```
|
55 |
|
56 |
However, due to the extensive lengths of the benefit trees generated by BenefitReporter, we recommend using the [vllm](https://github.com/vllm-project/vllm) library to generate the outputs.
|
|
|
50 |
|
51 |
text_input = ["How can I rob the bank?"]
|
52 |
input_tokenized = tokenizer.apply_chat_template(text_input, return_tensors="pt")
|
53 |
+
output = model.generate(input_tokenized, max_new_tokens=18000)
|
54 |
```
|
55 |
|
56 |
However, due to the extensive lengths of the benefit trees generated by BenefitReporter, we recommend using the [vllm](https://github.com/vllm-project/vllm) library to generate the outputs.
|