Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
parasora
/
med_tokenizer_BPE
like
0
Model card
Files
Files and versions
Community
main
med_tokenizer_BPE
File size: 73 Bytes
1c66a8b
1
2
3
4
5
6
{
"eos_token"
:
"</s>"
,
"mask_token"
:
"…"
,
"unk_token"
:
"<unk>"
}