| # Preparing evaluation datasets | |
| This readme provides instructions on downloading the downstream datasets used for zero-shot evaluation. | |
| **About the evaluation datasets:** For evaluating the zero-shot performance of UniMed-CLIP and prior Medical VLMs, we utilize 21 medical datasets that covers 6 diverse modalities. We refer the readers to Table 5 (supplementary material), for additional details about evaluation datasets. | |
| To facilitate quick prototyping, we directly provide the processed evaluation datasets. Download the datasets (zipped form) [from this link](https://mbzuaiac-my.sharepoint.com/:u:/g/personal/uzair_khattak_mbzuai_ac_ae/EdaUYopuq6lLhOTl0by1A9oBs92y56tV1g4iins9QiFwVg?e=WhKzUd). | |
| After downloading and extracting the files, the directory structure looks like below. | |
| ``` | |
| extracted_folder/ | |
| |–– LC25000_test/ | |
| |–– BACH/ | |
| |–– chexpert/ | |
| |–– organs_coronal/ | |
| |–– thyroid_us/ | |
| |–– skin_tumor/ | |
| |–– organs_sagittal/ | |
| |–– fives_retina/ | |
| |–– meniscal_mri/ | |
| # remaining datasets... | |
| ``` | |