atharvanighot
/

hindi-tokenizer

Model Card for Model ID

Llama 2 Tokenizer with Additional 25104 Hindi Tokens which makes it much better on Hindi Data

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model’s pipeline type. Check the docs .