kaushalya commited on
Commit
1fe2566
1 Parent(s): b95b1b0

Update readme

Browse files
Files changed (2) hide show
  1. README.md +11 -1
  2. assets/val_loss.png +0 -0
README.md CHANGED
@@ -1,6 +1,16 @@
1
  # MedCLIP
2
  ## Description
3
- A CLIP model trained on the ROCO dataset. [Add link]
4
  ## Dataset
 
 
 
 
 
 
5
  ## Training
 
 
 
 
6
  ## Evaluation
 
1
  # MedCLIP
2
  ## Description
3
+ A CLIP model is finetuned on the [ROCO dataset](https://github.com/razorx89/roco-dataset).
4
  ## Dataset
5
+
6
+ Each image is accompanied by a text caption. The caption length varies from a few characters (a single word) to 2,000 characters. During preprocessing we remove all images that has a caption shorter than 10 characters.
7
+ Training set: 57,780 images with their caption.
8
+ Validation set: 7.200
9
+ Test set: 7,650
10
+
11
  ## Training
12
+
13
+ Finetune a CLIP model by simply running `sh run_medclip`.
14
+ This is the validation loss curve we observed when we trained the model using the `run_medclip.sh` script.
15
+ ![Validation loss](./assets/val_loss.png)
16
  ## Evaluation
assets/val_loss.png ADDED