Hugging Face's logo

tamang0000
/
assamese-tokenizer-50k

Transformers
LLM
Multilingual
Transformer
Non-English
Tokenizer
Indian
Assamese
Inference Endpoints
Model card Files Community
tamang0000 commited on
Commit
3250b7d
•
1 Parent(s): c9e8e5c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -1,4 +1,16 @@
1
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  # Assamese Tokenizer (50K Vocabulary)
3
 
4
  [![Downloads](https://img.shields.io/github/downloads/tamang0000/assamese-tokenizer-50k/total.svg)](https://github.com/tamang0000/assamese-tokenizer-50k/releases)
 
1
 
2
+ ---
3
+ library_name: transformers
4
+ tags:
5
+ - LLM
6
+ - Multilingual
7
+ - Dual Transformer
8
+ - Non-English
9
+ - Tokenizer
10
+ - Assamese
11
+ - Indian
12
+ ---
13
+
14
  # Assamese Tokenizer (50K Vocabulary)
15
 
16
  [![Downloads](https://img.shields.io/github/downloads/tamang0000/assamese-tokenizer-50k/total.svg)](https://github.com/tamang0000/assamese-tokenizer-50k/releases)