End of training

README.md

@@ -11,9 +11,12 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/rinogrego/VLM-Fine-tuning/runs/lmrxcnn9)
 # idefics2-8b-vqa_rad-finetuned
 
 This model is a fine-tuned version of [HuggingFaceM4/idefics2-8b](https://huggingface.co/HuggingFaceM4/idefics2-8b) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.1974
 
 ## Model description
 
@@ -38,12 +41,18 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 50
-- training_steps: 2
+- lr_scheduler_warmup_ratio: 0.3
+- num_epochs: 5
 - mixed_precision_training: Native AMP
 
 ### Training results
 
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 1.0095        | 1.1136 | 500  | 1.0882          |
+| 2.1057        | 2.2272 | 1000 | 1.8082          |
+| 1.416         | 3.3408 | 1500 | 1.4141          |
+| 1.0619        | 4.4543 | 2000 | 1.1974          |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:79ce06615dede0a20db1d8e7a05b9c6a857975808e1c25f46c5b597db76b14fc
+oid sha256:45b822543a71dc4495689df45eb7b40c963de57cab58762646e91b5982c4f74e
 size 93378688

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d6b2bc35d47817138860eaef69a43847aca9dacbfa5f23aef7d1ba3ea9ca1b1d
+oid sha256:c30054caf0c56967dca4bb393a569614877cacb1faba4e6a9eed25b62ba98363
 size 5112