Kikkk commited on
Commit
bcaf94f
·
verified ·
1 Parent(s): bcb1ce4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -35,6 +35,26 @@ We introduce <b>ADELIE</b> (<b>A</b>ligning large language mo<b>DEL</b>s on <b>I
35
  - 🐧 Github: [THU/ADELIE](https://github.com/THU-KEG/ADELIE/tree/main)
36
 
37
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
  ### Model Description
39
 
40
  <!-- Provide a longer summary of what this model is. -->
 
35
  - 🐧 Github: [THU/ADELIE](https://github.com/THU-KEG/ADELIE/tree/main)
36
 
37
 
38
+ # Model Performance
39
+
40
+ The table below presents the average F1 scores (%) of the ADELIE model across closed IE, open IE, and on-demand IE tasks, as well as its overall performance (%) on general benchmarks. For dataset details, please refer to the paper.
41
+
42
+ | Model | Closed IE | Open IE | On-demand IE | General Average Score |
43
+ |-----------------|-----------|---------|--------------|-----------------------|
44
+ | Llama2 7B | 5.7 | 5.6 | 22.4 | 52.2 |
45
+ | ADELIE-SFT | 42.6 | 46.9 | 60.4 | 53.5 |
46
+ | ADELIE-DPO | 42.7 | 47.6 | 60.5 | 53.8 |
47
+ |-----------------|-----------|---------|--------------|-----------------------|
48
+ | Llama3.2 3B | 19.1 | 18.5 | 20.8 | 55.5 |
49
+ | ADELIE-SFT-3B | 41.8 | 47.6 | 60.8 | 55.6 |
50
+ | ADELIE-DPO-3B | 39.2 | 47.8 | 60.7 | 55.6 |
51
+ |-----------------|-----------|---------|--------------|-----------------------|
52
+ | Qwen2.5 1.5B | 16.5 | 14.2 | 20.5 | 54.6 |
53
+ | ADELIE-SFT-1.5B | 37.7 | 44.6 | 58.9 | 55.0 |
54
+ | ADELIE-DPO-1.5B | 38.5 | 45.6 | 59.2 | 55.1 |
55
+
56
+
57
+
58
  ### Model Description
59
 
60
  <!-- Provide a longer summary of what this model is. -->