tamang0000
/

assamese-tokenizer-50k

Inference Endpoints

Model card Files Files and versions Community

tamang0000 commited on Jul 7

Commit

3d0e234

•

1 Parent(s): 3250b7d

Update README.md

Files changed (1) hide show

README.md +0 -2

README.md CHANGED Viewed

@@ -13,8 +13,6 @@ tags:
 # Assamese Tokenizer (50K Vocabulary)
-[![Downloads](https://img.shields.io/github/downloads/tamang0000/assamese-tokenizer-50k/total.svg)](https://github.com/tamang0000/assamese-tokenizer-50k/releases)
 ## Model Details
 This repository contains a custom tokenizer for the Assamese language with a vocabulary size of 50,000 tokens. The tokenizer was trained on the Assamese language subset of the CC-100 multilingual dataset. This tokenizer can be used for various Natural Language Processing (NLP) tasks involving the Assamese language.

 # Assamese Tokenizer (50K Vocabulary)
 ## Model Details
 This repository contains a custom tokenizer for the Assamese language with a vocabulary size of 50,000 tokens. The tokenizer was trained on the Assamese language subset of the CC-100 multilingual dataset. This tokenizer can be used for various Natural Language Processing (NLP) tasks involving the Assamese language.