Create tokenizer.json

tokenizer.json will be required to convert to CT2 format. It also makes it a consistent file type across different whisper models.

Files changed (1) hide show

tokenizer.json ADDED Viewed

The diff for this file is too large to render. See raw diff