Oleksandr Shchur commited on
Commit
ec1ab4f
·
1 Parent(s): 218d801

Color zero-shot models

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -79,7 +79,7 @@ with gr.Blocks() as demo:
79
  * **Average relative error**: Geometric mean of the relative errors for each task. The relative error for each task is computed as `model_error / baseline_error`.
80
  * **Average rank**: Arithmetic mean of the ranks achieved by each model on each task.
81
  * **Median inference time (s)**: Median of the times required to make predictions for the entire dataset (in seconds).
82
- * **Training corpus overlap (%)**: Percentage of the datasets used in the benchmark that were included in the model's training corpus. Zero-shot models are highlighted in green.
83
 
84
  Lower values are better for all of the above metrics.
85
 
 
79
  * **Average relative error**: Geometric mean of the relative errors for each task. The relative error for each task is computed as `model_error / baseline_error`.
80
  * **Average rank**: Arithmetic mean of the ranks achieved by each model on each task.
81
  * **Median inference time (s)**: Median of the times required to make predictions for the entire dataset (in seconds).
82
+ * **Training corpus overlap (%)**: Percentage of the datasets used in the benchmark that were included in the model's training corpus. Zero-shot models are highlighted in <span style="color:green; font-weight:bold;">green</span>.
83
 
84
  Lower values are better for all of the above metrics.
85