jaswanthrk
/

dravida_tokenizers_individual

Model card Files Files and versions Community

dravida_tokenizers_individual / README.md

jaswanthrk's picture

Update README.md

3ab3278 verified 7 months ago

|

178 Bytes

metadata

license: mit

They are in sp (Sentence Piece) format. Need to convert them into huggingface format.

The terms: "kn" = Kannada "ml" = Malayalam "ta" = Tamil "te" = Telugu