andorei commited on
Commit
3f6205e
·
verified ·
1 Parent(s): bfcb1a2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -29,4 +29,10 @@ tags:
29
  - entity linking
30
  - embedding
31
  - bert
32
- ---
 
 
 
 
 
 
 
29
  - entity linking
30
  - embedding
31
  - bert
32
+ ---
33
+
34
+ A multilingual BERGAMOT model with pre-trained on UMLS (version 2020AB) using a Graph Attention Network (GAT) encoder.
35
+
36
+ The model is described in paper "Biomedical Entity Representation with Graph-Augmented Multi-Objective Transformer " which is accepted to NAACL 2024!
37
+
38
+ For pretraining code see our github: [https://github.com/Andoree/BERGAMOT](https://github.com/Andoree/BERGAMOT).