rwightman HF staff commited on
Commit
e5f45a7
·
verified ·
1 Parent(s): 8f7d949

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -1
README.md CHANGED
@@ -48,4 +48,22 @@ So far I have results for `adamw` and `laprop` but have some `mars` on the way.
48
  ![Top-1](adamw/eval_top1_comparison.png)
49
 
50
  ## AdamW Train Loss
51
- ![Loss](adamw/train_loss_comparison.png)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
  ![Top-1](adamw/eval_top1_comparison.png)
49
 
50
  ## AdamW Train Loss
51
+ ![Loss](adamw/train_loss_comparison.png)
52
+
53
+ # MARS
54
+
55
+ |optim |best_epoch|train_loss |eval_loss |eval_top1 |eval_top5 |
56
+ |---------------|----------|------------------|------------------|-----------------|-----------------|
57
+ |cmars, lr=1e-03|198.0 |2.054780960083008 |1.0435627010345458|74.91000185546875|92.08000146484376|
58
+ |cmars, lr=2e-03|203.0 |2.0272469520568848|1.0705795244216918|74.31000185546876|91.54000092773435|
59
+ |mars, lr=1e-03 |184.0 |2.219767808914185 |1.07215625667572 |74.06000178222656|91.6200013671875 |
60
+ |mars, lr=2e-03 |197.0 |2.1453990936279297|1.0963781481742858|73.73000098876953|91.1500006225586 |
61
+ |cmars, lr=5e-04|198.0 |2.2018630504608154|1.083557384109497 |73.32000045166015|91.67000092773438|
62
+ |mars, lr=5e-04 |189.0 |2.322845220565796 |1.1199828132629397|72.02999995117187|90.86000173339843|
63
+
64
+
65
+ ## MARS Top-1 Evaluation Accuracy on Mini-ImageNet
66
+ ![Top-1](mars/eval_top1_comparison.png)
67
+
68
+ ## MARS Train Loss
69
+ ![Loss](mars/train_loss_comparison.png)