Update readme
Browse files- README.md +11 -1
- assets/val_loss.png +0 -0
README.md
CHANGED
@@ -1,6 +1,16 @@
|
|
1 |
# MedCLIP
|
2 |
## Description
|
3 |
-
A CLIP model
|
4 |
## Dataset
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
## Training
|
|
|
|
|
|
|
|
|
6 |
## Evaluation
|
|
|
1 |
# MedCLIP
|
2 |
## Description
|
3 |
+
A CLIP model is finetuned on the [ROCO dataset](https://github.com/razorx89/roco-dataset).
|
4 |
## Dataset
|
5 |
+
|
6 |
+
Each image is accompanied by a text caption. The caption length varies from a few characters (a single word) to 2,000 characters. During preprocessing we remove all images that has a caption shorter than 10 characters.
|
7 |
+
Training set: 57,780 images with their caption.
|
8 |
+
Validation set: 7.200
|
9 |
+
Test set: 7,650
|
10 |
+
|
11 |
## Training
|
12 |
+
|
13 |
+
Finetune a CLIP model by simply running `sh run_medclip`.
|
14 |
+
This is the validation loss curve we observed when we trained the model using the `run_medclip.sh` script.
|
15 |
+
![Validation loss](./assets/val_loss.png)
|
16 |
## Evaluation
|
assets/val_loss.png
ADDED