Commit
·
97ba9b9
1
Parent(s):
6da9972
Fix typos in code sample (#1)
Browse files- Fix typos in code sample (074edeb01f6de68997bebccc25ff14c341edd6ed)
Co-authored-by: Sriram Krishna <[email protected]>
README.md
CHANGED
@@ -35,17 +35,17 @@ Note that this model is primarily aimed at being fine-tuned on tasks that use th
|
|
35 |
You can use this model directly for masked language modeling:
|
36 |
|
37 |
```python
|
38 |
-
from transformers import AutoTokenizer,
|
39 |
tokenizer = AutoTokenizer.from_pretrained("kiddothe2b/hierarchical-transformer-base-4096", trust_remote_code=True)
|
40 |
-
mlm_model =
|
41 |
```
|
42 |
|
43 |
You can also fine-tune it for SequenceClassification, SequentialSentenceClassification, and MultipleChoice down-stream tasks:
|
44 |
|
45 |
```python
|
46 |
-
from transformers import AutoTokenizer,
|
47 |
tokenizer = AutoTokenizer.from_pretrained("kiddothe2b/hierarchical-transformer-base-4096", trust_remote_code=True)
|
48 |
-
doc_classifier =
|
49 |
```
|
50 |
|
51 |
## Limitations and bias
|
|
|
35 |
You can use this model directly for masked language modeling:
|
36 |
|
37 |
```python
|
38 |
+
from transformers import AutoTokenizer, AutoModelForForMaskedLM
|
39 |
tokenizer = AutoTokenizer.from_pretrained("kiddothe2b/hierarchical-transformer-base-4096", trust_remote_code=True)
|
40 |
+
mlm_model = AutoModelForMaskedLM("kiddothe2b/hierarchical-transformer-base-4096", trust_remote_code=True)
|
41 |
```
|
42 |
|
43 |
You can also fine-tune it for SequenceClassification, SequentialSentenceClassification, and MultipleChoice down-stream tasks:
|
44 |
|
45 |
```python
|
46 |
+
from transformers import AutoTokenizer, AutoModelForSequenceClassification
|
47 |
tokenizer = AutoTokenizer.from_pretrained("kiddothe2b/hierarchical-transformer-base-4096", trust_remote_code=True)
|
48 |
+
doc_classifier = AutoModelForSequenceClassification.from_pretrained("kiddothe2b/hierarchical-transformer-base-4096", trust_remote_code=True)
|
49 |
```
|
50 |
|
51 |
## Limitations and bias
|