morit commited on
Commit
01890db
·
1 Parent(s): cfb8d03

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -9,16 +9,16 @@ metrics:
9
  pipeline_tag: zero-shot-classification
10
  ---
11
 
12
- # XLM-ROBERTA-BASE-XNLI-DE
13
 
14
  ## Model description
15
  This model takes the XLM-Roberta-base model which has been continued to pre-traine on a large corpus of Twitter in multiple languages.
16
  It was developed following a similar strategy as introduced as part of the [Tweet Eval](https://github.com/cardiffnlp/tweeteval) framework.
17
- The model is further finetuned on the german part of the XNLI training dataset.
18
 
19
  ## Intended Usage
20
 
21
- This model was developed to do Zero-Shot Text Classification in the realm of Hate Speech Detection. It is focused on the language of german as it was finetuned on data in said language. Since the base model was pre-trained on 100 different languages it has shown some effectiveness in other languages. Please refer to the list of languages in the [XLM Roberta paper](https://arxiv.org/abs/1911.02116)
22
 
23
  ### Usage with Zero-Shot Classification pipeline
24
  ```python
@@ -28,7 +28,7 @@ classifier = pipeline("zero-shot-classification",
28
  ```
29
 
30
  ## Training
31
- This model was pre-trained on a set of 100 languages and follwed further training on 198M multilingual tweets as described in the original [paper](https://arxiv.org/abs/2104.12250). Further it was trained on the training set of XNLI dataset in german which is a machine translated version of the MNLI dataset. It was trained on 5 epochs of the XNLI train set and evaluated on the XNLI eval dataset at the end of every to find the best performing model. The model which had the highest accuracy on the eval set was chosen at the end.
32
 
33
  ![Training Charts from wandb](screen_wandb.png)
34
  - learning rate: 2e-5
 
9
  pipeline_tag: zero-shot-classification
10
  ---
11
 
12
+ # XLM-ROBERTA-BASE-XNLI-AR
13
 
14
  ## Model description
15
  This model takes the XLM-Roberta-base model which has been continued to pre-traine on a large corpus of Twitter in multiple languages.
16
  It was developed following a similar strategy as introduced as part of the [Tweet Eval](https://github.com/cardiffnlp/tweeteval) framework.
17
+ The model is further finetuned on the arabic part of the XNLI training dataset.
18
 
19
  ## Intended Usage
20
 
21
+ This model was developed to do Zero-Shot Text Classification in the realm of Hate Speech Detection. It is focused on the language of arabic as it was finetuned on data in said language. Since the base model was pre-trained on 100 different languages it has shown some effectiveness in other languages. Please refer to the list of languages in the [XLM Roberta paper](https://arxiv.org/abs/1911.02116)
22
 
23
  ### Usage with Zero-Shot Classification pipeline
24
  ```python
 
28
  ```
29
 
30
  ## Training
31
+ This model was pre-trained on a set of 100 languages and follwed further training on 198M multilingual tweets as described in the original [paper](https://arxiv.org/abs/2104.12250). Further it was trained on the training set of XNLI dataset in arabic which is a machine translated version of the MNLI dataset. It was trained on 5 epochs of the XNLI train set and evaluated on the XNLI eval dataset at the end of every to find the best performing model. The model which had the highest accuracy on the eval set was chosen at the end.
32
 
33
  ![Training Charts from wandb](screen_wandb.png)
34
  - learning rate: 2e-5