docs/EVALUATION_DATA.md

Preparing evaluation datasets

This readme provides instructions on downloading the downstream datasets used for zero-shot evaluation.

About the evaluation datasets: For evaluating the zero-shot performance of UniMed-CLIP and prior Medical VLMs, we utilize 21 medical datasets that covers 6 diverse modalities. We refer the readers to Table 5 (supplementary material), for additional details about evaluation datasets.

To facilitate quick prototyping, we directly provide the processed evaluation datasets. Download the datasets (zipped form) from this link.

After downloading and extracting the files, the directory structure looks like below.

extracted_folder/
|–– LC25000_test/
|–– BACH/
|–– chexpert/
|–– organs_coronal/
|–– thyroid_us/
|–– skin_tumor/
|–– organs_sagittal/
|–– fives_retina/
|–– meniscal_mri/
# remaining datasets...