The purpose of this PR is to:

  1. Add types for function signatures to make the logic easier to follow
  2. Simply the inference logic from a batch -> single input. This HF space only accepts a single input, and it's likely that folks are using some of this logic as reference when implementing the model in their own projects!
chrismaltais changed pull request status to open

Thanks a lot, Chris. It really improves the codes :)

ZhengPeng7 changed pull request status to merged

Sign up or log in to comment