Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

oobabooga
/

llama-tokenizer

Model card Files Files and versions Community

llama-tokenizer

2 contributors

History: 2 commits

oobabooga's picture

Upload 4 files

de79a1e almost 2 years ago

.gitattributes

1.48 kB

initial commit almost 2 years ago
README.md

23 Bytes

initial commit almost 2 years ago
special_tokens_map.json

411 Bytes

Upload 4 files almost 2 years ago
tokenizer.json

1.84 MB

Upload 4 files almost 2 years ago
tokenizer.model

500 kB
LFS

Upload 4 files almost 2 years ago
tokenizer_config.json

727 Bytes

Upload 4 files almost 2 years ago