|
--- |
|
license: bigscience-openrail-m |
|
--- |
|
# BigBird for Mortality Prediction |
|
|
|
Starting with Google's base BigBird model, we fine-tuned on binary mortality prediction in MIMIC admission notes. This |
|
model seeks to predict whether a certain patient will expire within a given ICU stay, based on the text available upon |
|
admission. Data prepared for this task as described in [this project](https://github.com/bvanaken/clinical-outcome-prediction), |
|
using the simulated admission notes (taken from discharge summaries). This model will be used in an upcoming submission for |
|
IMLH at ICML 2021. |
|
|
|
### References |
|
* Van Aken, et al., 2021: [Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration](https://www.aclweb.org/anthology/2021.eacl-main.75/) |
|
* Zaheer, et al., 2020: [Big Bird: Transformers for Longer Sequences](https://papers.nips.cc/paper/2020/hash/c8512d142a2d849725f31a9a7a361ab9-Abstract.html) |
