wissamantoun
commited on
Commit
·
bbbcf03
1
Parent(s):
2c1556a
Update README.md
Browse files
README.md
CHANGED
@@ -32,14 +32,22 @@ model-index:
|
|
32 |
Multilingual ChatGPT detection model from [Towards a Robust Detection of Language Model-Generated Text: Is ChatGPT that easy to detect?](TODO:)
|
33 |
|
34 |
This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the HC3 FULL_MULTI_1.0_0.5_0.5 dataset with noise added.
|
35 |
-
It achieves the following results on the
|
|
|
|
|
36 |
- Loss: 0.1573
|
37 |
- F1: 0.9633
|
38 |
|
|
|
|
|
|
|
|
|
|
|
|
|
39 |
## Model description
|
40 |
|
41 |
This a model trained to detect text created by ChatGPT in French.
|
42 |
-
The training data is the combination of the `hc3_fr_full` and `hc3_en_full` subsets of [almanach/hc3_multi](https://huggingface.co/almanach/
|
43 |
|
44 |
## Intended uses & limitations
|
45 |
|
|
|
32 |
Multilingual ChatGPT detection model from [Towards a Robust Detection of Language Model-Generated Text: Is ChatGPT that easy to detect?](TODO:)
|
33 |
|
34 |
This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the HC3 FULL_MULTI_1.0_0.5_0.5 dataset with noise added.
|
35 |
+
It achieves the following results on the:
|
36 |
+
|
37 |
+
Evaluation set:
|
38 |
- Loss: 0.1573
|
39 |
- F1: 0.9633
|
40 |
|
41 |
+
Test Set:
|
42 |
+
- F1: 0.97
|
43 |
+
|
44 |
+
Adversarial:
|
45 |
+
- F1: 0.45
|
46 |
+
|
47 |
## Model description
|
48 |
|
49 |
This a model trained to detect text created by ChatGPT in French.
|
50 |
+
The training data is the combination of the `hc3_fr_full` and `hc3_en_full` subsets of [almanach/hc3_multi](https://huggingface.co/datasets/almanach/hc3_french_ood), but with added misspelling and homoglyph attacks.
|
51 |
|
52 |
## Intended uses & limitations
|
53 |
|