vsd-benchmark commited on
Commit
ccaa8f9
·
1 Parent(s): 42c141b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -1
README.md CHANGED
@@ -67,4 +67,42 @@ metrics:
67
  - posicube/mean_reciprocal_rank
68
  tags:
69
  - vsd
70
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
67
  - posicube/mean_reciprocal_rank
68
  tags:
69
  - vsd
70
+ ---
71
+
72
+ This is an example model card for reporting metrics for the VSD fashion dataset.
73
+
74
+ To report your model metrics, you need to do 2 things:
75
+
76
+ 1. Tag your model with 'vsd'.
77
+ 2. In your model card README.md add a section with:
78
+
79
+ ```
80
+ ---
81
+ model-index:
82
+ - name: vsd-benchmark/vsd-fashion
83
+ results:
84
+ - task:
85
+ type: in_catalog_retrieval_zero_shot
86
+ dataset:
87
+ type: vsd-benchmark/vsd-fashion
88
+ name: vsd-benchmark/vsd-fashion
89
+ config: in_catalog_retrieval_zero_shot
90
+ metrics:
91
+ - type: roc_auc
92
+ value: 0
93
+ name: ROC_AUC
94
+ - type: posicube/mean_reciprocal_rank
95
+ value: 0
96
+ args:
97
+ k: 5
98
+ name: MRR@5
99
+ metrics:
100
+ - roc_auc
101
+ - posicube/mean_reciprocal_rank
102
+ tags:
103
+ - vsd
104
+ ---
105
+ ```
106
+
107
+ This will report a metric on the vsd-fashion dataset, on the `in_catalog_retrieval_zero_shot` task.
108
+