amirakhlaghiqqq
commited on
Commit
•
cc427da
1
Parent(s):
7a1e5ad
Update README.md
Browse files
README.md
CHANGED
@@ -46,7 +46,7 @@ To use this tokenizer with the Hugging Face Transformers library:
|
|
46 |
```python
|
47 |
from transformers import AutoTokenizer
|
48 |
|
49 |
-
tokenizer = AutoTokenizer.from_pretrained("
|
50 |
|
51 |
# Example usage
|
52 |
text = "این یک مثال به زبان فارسی است."
|
|
|
46 |
```python
|
47 |
from transformers import AutoTokenizer
|
48 |
|
49 |
+
tokenizer = AutoTokenizer.from_pretrained("amirakhlaghiqqq/llama2-persian-tokenizer")
|
50 |
|
51 |
# Example usage
|
52 |
text = "این یک مثال به زبان فارسی است."
|