hiyouga commited on
Commit
91b9dbf
1 Parent(s): 0ebedf3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -40,7 +40,7 @@ messages = [
40
  ]
41
  inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
42
  inputs = inputs.to("cuda")
43
- generate_ids = model.generate(**inputs, eos_token_id=[151643, 151645], max_new_tokens=256, streamer=streamer)
44
  ```
45
 
46
  You could also alternatively launch a CLI demo by using the script in [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory)
 
40
  ]
41
  inputs = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
42
  inputs = inputs.to("cuda")
43
+ generate_ids = model.generate(inputs, streamer=streamer)
44
  ```
45
 
46
  You could also alternatively launch a CLI demo by using the script in [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory)