generation_args in the example
#10
by
Ray2333
- opened
Awesome work! Congratulations! I noticed that the definition of generation_args is missing in the example.
with torch.inference_mode():
generate_ids = model.generate(**inputs, **generation_args)
Ray2333
changed discussion status to
closed