Update README.md
Browse files
README.md
CHANGED
@@ -40,7 +40,7 @@ messages = [
|
|
40 |
]
|
41 |
inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
|
42 |
inputs = inputs.to("cuda")
|
43 |
-
generate_ids = model.generate(
|
44 |
```
|
45 |
|
46 |
You could also alternatively launch a CLI demo by using the script in [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory)
|
|
|
40 |
]
|
41 |
inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
|
42 |
inputs = inputs.to("cuda")
|
43 |
+
generate_ids = model.generate(inputs, streamer=streamer)
|
44 |
```
|
45 |
|
46 |
You could also alternatively launch a CLI demo by using the script in [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory)
|