Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
aloobun
/
IN-Llama-3-Tokenizer
like
0
Transformers
llama
tokenizer
bpe
Indic
Inference Endpoints
License:
llama3
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
cf92bf9
IN-Llama-3-Tokenizer
1 contributor
History:
7 commits
aloobun
Upload 3 files
cf92bf9
verified
2 months ago
model
Upload 2 files
2 months ago
.gitattributes
1.63 kB
Upload 3 files
2 months ago
README.md
4.23 kB
Update README.md
2 months ago
special_tokens_map.json
296 Bytes
Upload 3 files
2 months ago
tokenizer.json
29.4 MB
LFS
Upload 3 files
2 months ago
tokenizer_config.json
11.6 MB
LFS
Upload 3 files
2 months ago