RoBERTa-nl_BPE_39k / README.md
Bauwens's picture
Update README.md
1715b21 verified
---
license: apache-2.0
---
To load the tokeniser for this model, do *not* use `AutoTokenizer`. Instead, install [TkTkT](https://github.com/bauwenst/TkTkT) and run:
```python
from tktkt.models.bpe.base import ClassicBPE
tokenizer = ClassicBPE.from_pretrained("Bauwens/RoBERTa-nl_BPE_39k")
```