File size: 649 Bytes
69c617a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3f6205e
 
 
 
 
 
e3c7fb6
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
---
language:
- en
- es
- fr
- nl
- de
- fi
- ru
- tr
- ko
- zh
- ja
- th
- pt
- it
- sv
- hu
- pl
- et
- hr
- uk
- el
- da
- he
tags:
- biomedical
- bionlp
- entity linking
- embedding
- bert
---

A multilingual BERGAMOT model with pre-trained on UMLS (version 2020AB) using a Graph Attention Network (GAT) encoder.

The model is described in paper "Biomedical Entity Representation with Graph-Augmented Multi-Objective Transformer " which is accepted to NAACL 2024!

For pretraining code see our github: [https://github.com/Andoree/BERGAMOT](https://github.com/Andoree/BERGAMOT).

Please do not forget to cite our paper when bib will be available.