Update README.md
Browse files
README.md
CHANGED
@@ -35,6 +35,26 @@ We introduce <b>ADELIE</b> (<b>A</b>ligning large language mo<b>DEL</b>s on <b>I
|
|
35 |
- 🐧 Github: [THU/ADELIE](https://github.com/THU-KEG/ADELIE/tree/main)
|
36 |
|
37 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
### Model Description
|
39 |
|
40 |
<!-- Provide a longer summary of what this model is. -->
|
|
|
35 |
- 🐧 Github: [THU/ADELIE](https://github.com/THU-KEG/ADELIE/tree/main)
|
36 |
|
37 |
|
38 |
+
# Model Performance
|
39 |
+
|
40 |
+
The table below presents the average F1 scores (%) of the ADELIE model across closed IE, open IE, and on-demand IE tasks, as well as its overall performance (%) on general benchmarks. For dataset details, please refer to the paper.
|
41 |
+
|
42 |
+
| Model | Closed IE | Open IE | On-demand IE | General Average Score |
|
43 |
+
|-----------------|-----------|---------|--------------|-----------------------|
|
44 |
+
| Llama2 7B | 5.7 | 5.6 | 22.4 | 52.2 |
|
45 |
+
| ADELIE-SFT | 42.6 | 46.9 | 60.4 | 53.5 |
|
46 |
+
| ADELIE-DPO | 42.7 | 47.6 | 60.5 | 53.8 |
|
47 |
+
|-----------------|-----------|---------|--------------|-----------------------|
|
48 |
+
| Llama3.2 3B | 19.1 | 18.5 | 20.8 | 55.5 |
|
49 |
+
| ADELIE-SFT-3B | 41.8 | 47.6 | 60.8 | 55.6 |
|
50 |
+
| ADELIE-DPO-3B | 39.2 | 47.8 | 60.7 | 55.6 |
|
51 |
+
|-----------------|-----------|---------|--------------|-----------------------|
|
52 |
+
| Qwen2.5 1.5B | 16.5 | 14.2 | 20.5 | 54.6 |
|
53 |
+
| ADELIE-SFT-1.5B | 37.7 | 44.6 | 58.9 | 55.0 |
|
54 |
+
| ADELIE-DPO-1.5B | 38.5 | 45.6 | 59.2 | 55.1 |
|
55 |
+
|
56 |
+
|
57 |
+
|
58 |
### Model Description
|
59 |
|
60 |
<!-- Provide a longer summary of what this model is. -->
|