Mitch Naylor
commited on
Commit
•
830f6b2
1
Parent(s):
eeb7d1f
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# BigBird for Mortality Prediction
|
| 2 |
+
|
| 3 |
+
This model is Google's base BigBird model, fine-tuned on binary mortality prediction in MIMIC admission notes. Data prepared for
|
| 4 |
+
this task as described in [this project](https://github.com/bvanaken/clinical-outcome-prediction), using the simulated admission
|
| 5 |
+
notes (taken from discharge summaries). This model will be used in an upcoming submission for IMLH at ICML 2021.
|
| 6 |
+
|
| 7 |
+
### References
|
| 8 |
+
* Van Aken, et al., 2021: [Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration](https://www.aclweb.org/anthology/2021.eacl-main.75/)
|
| 9 |
+
* Zaheer, et al., 2020: [Big Bird: Transformers for Longer Sequences](https://papers.nips.cc/paper/2020/hash/c8512d142a2d849725f31a9a7a361ab9-Abstract.html)
|