pourmand1376
commited on
Commit
ยท
bdd837a
1
Parent(s):
3b28145
Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,8 @@ A model which is jointly trained and fine-tuned on Quran, Saheefa and nahj-al-ba
|
|
7 |
Some Examples for filling the mask:
|
8 |
|
9 |
- ```
|
10 |
-
ุฐููููู
|
|
|
11 |
```
|
12 |
|
13 |
This model is fine-tuned on [Bert Base Arabic](https://huggingface.co/asafaya/bert-base-arabic) for 30 epochs. We have used `Masked Language Modeling` to fine-tune the model. Also, after each 5 epochs, we have completely masked the words again for the model to learn the embeddings very well and not overfit the data.
|
|
|
7 |
Some Examples for filling the mask:
|
8 |
|
9 |
- ```
|
10 |
+
ุฐููููู [MASK] ููุง ุฑูููุจู ููููู ููุฏูู ููููู
ูุชููููููู
|
11 |
+
ููู ูููููุจูููู
ู ู
ูุฑูุถู ููุฒูุงุฏูููู
ู ุงูููููู ู
ูุฑูุถูุง ููููููู
ู [MASK] ุฃููููู
ู ุจูู
ูุง ููุงูููุง ููููุฐูุจูููู
|
12 |
```
|
13 |
|
14 |
This model is fine-tuned on [Bert Base Arabic](https://huggingface.co/asafaya/bert-base-arabic) for 30 epochs. We have used `Masked Language Modeling` to fine-tune the model. Also, after each 5 epochs, we have completely masked the words again for the model to learn the embeddings very well and not overfit the data.
|