Commit
·
ccaa8f9
1
Parent(s):
42c141b
Update README.md
Browse files
README.md
CHANGED
@@ -67,4 +67,42 @@ metrics:
|
|
67 |
- posicube/mean_reciprocal_rank
|
68 |
tags:
|
69 |
- vsd
|
70 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
67 |
- posicube/mean_reciprocal_rank
|
68 |
tags:
|
69 |
- vsd
|
70 |
+
---
|
71 |
+
|
72 |
+
This is an example model card for reporting metrics for the VSD fashion dataset.
|
73 |
+
|
74 |
+
To report your model metrics, you need to do 2 things:
|
75 |
+
|
76 |
+
1. Tag your model with 'vsd'.
|
77 |
+
2. In your model card README.md add a section with:
|
78 |
+
|
79 |
+
```
|
80 |
+
---
|
81 |
+
model-index:
|
82 |
+
- name: vsd-benchmark/vsd-fashion
|
83 |
+
results:
|
84 |
+
- task:
|
85 |
+
type: in_catalog_retrieval_zero_shot
|
86 |
+
dataset:
|
87 |
+
type: vsd-benchmark/vsd-fashion
|
88 |
+
name: vsd-benchmark/vsd-fashion
|
89 |
+
config: in_catalog_retrieval_zero_shot
|
90 |
+
metrics:
|
91 |
+
- type: roc_auc
|
92 |
+
value: 0
|
93 |
+
name: ROC_AUC
|
94 |
+
- type: posicube/mean_reciprocal_rank
|
95 |
+
value: 0
|
96 |
+
args:
|
97 |
+
k: 5
|
98 |
+
name: MRR@5
|
99 |
+
metrics:
|
100 |
+
- roc_auc
|
101 |
+
- posicube/mean_reciprocal_rank
|
102 |
+
tags:
|
103 |
+
- vsd
|
104 |
+
---
|
105 |
+
```
|
106 |
+
|
107 |
+
This will report a metric on the vsd-fashion dataset, on the `in_catalog_retrieval_zero_shot` task.
|
108 |
+
|