Commit
·
b2aabe6
1
Parent(s):
212dca5
Update README.md
Browse files
README.md
CHANGED
|
@@ -78,7 +78,7 @@ classifier(text)
|
|
| 78 |
|
| 79 |
Here is how we can use the model to get the features of a given text in PyTorch:
|
| 80 |
```python
|
| 81 |
-
!pip install transformers
|
| 82 |
|
| 83 |
from transformers import AutoTokenizer
|
| 84 |
from transformers import AutoModelForSequenceClassification
|
|
@@ -102,7 +102,7 @@ def tokenize_function(examples):
|
|
| 102 |
|
| 103 |
|
| 104 |
# predicting with the model
|
| 105 |
-
|
| 106 |
|
| 107 |
# initializing our labels
|
| 108 |
label_list = [
|
|
@@ -117,7 +117,7 @@ label_list = [
|
|
| 117 |
"tourism"
|
| 118 |
]
|
| 119 |
|
| 120 |
-
batch = tokenizer(
|
| 121 |
|
| 122 |
with torch.no_grad():
|
| 123 |
outputs = model(**batch)
|
|
@@ -130,8 +130,6 @@ print(f"The sequence: \n\n {word_i_want_to_predict} \n\n is predicted to be of n
|
|
| 130 |
## Training data
|
| 131 |
This model is trained on 50,945 rows of Nepali language news grouped [dataset](https://www.kaggle.com/competitions/text-it-meet-22/data?select=train.csv) found on Kaggle which was also used in IT Meet 2022 Text challenge.
|
| 132 |
|
| 133 |
-
##
|
| 134 |
-
|
| 135 |
|
| 136 |
## Framework versions
|
| 137 |
- Transformers 4.20.1
|
|
|
|
| 78 |
|
| 79 |
Here is how we can use the model to get the features of a given text in PyTorch:
|
| 80 |
```python
|
| 81 |
+
!pip install transformers torch
|
| 82 |
|
| 83 |
from transformers import AutoTokenizer
|
| 84 |
from transformers import AutoModelForSequenceClassification
|
|
|
|
| 102 |
|
| 103 |
|
| 104 |
# predicting with the model
|
| 105 |
+
sequence_i_want_to_predict = "राजनीतिक स्थिरता नहुँदा विकास निर्माणले गति लिन सकेन"
|
| 106 |
|
| 107 |
# initializing our labels
|
| 108 |
label_list = [
|
|
|
|
| 117 |
"tourism"
|
| 118 |
]
|
| 119 |
|
| 120 |
+
batch = tokenizer(sequence_i_want_to_predict, padding=True, truncation=True, max_length=512, return_tensors='pt')
|
| 121 |
|
| 122 |
with torch.no_grad():
|
| 123 |
outputs = model(**batch)
|
|
|
|
| 130 |
## Training data
|
| 131 |
This model is trained on 50,945 rows of Nepali language news grouped [dataset](https://www.kaggle.com/competitions/text-it-meet-22/data?select=train.csv) found on Kaggle which was also used in IT Meet 2022 Text challenge.
|
| 132 |
|
|
|
|
|
|
|
| 133 |
|
| 134 |
## Framework versions
|
| 135 |
- Transformers 4.20.1
|