shibing624
commited on
Commit
·
122281f
1
Parent(s):
b2d8e3b
Update README.md
Browse files
README.md
CHANGED
@@ -88,7 +88,8 @@ macbert4csc
|
|
88 |
**MacBERT** is an improved BERT with novel **M**LM **a**s **c**orrection pre-training task, which mitigates the discrepancy of pre-training and fine-tuning.
|
89 |
|
90 |
Here is an example of our pre-training task.
|
91 |
-
|
|
|
92 |
| -------------- | ----------------- |
|
93 |
| **Original Sentence** | we use a language model to predict the probability of the next word. |
|
94 |
| **MLM** | we use a language [M] to [M] ##di ##ct the pro [M] ##bility of the next word . |
|
|
|
88 |
**MacBERT** is an improved BERT with novel **M**LM **a**s **c**orrection pre-training task, which mitigates the discrepancy of pre-training and fine-tuning.
|
89 |
|
90 |
Here is an example of our pre-training task.
|
91 |
+
|
92 |
+
| task | Example |
|
93 |
| -------------- | ----------------- |
|
94 |
| **Original Sentence** | we use a language model to predict the probability of the next word. |
|
95 |
| **MLM** | we use a language [M] to [M] ##di ##ct the pro [M] ##bility of the next word . |
|