Spaces:
Running
Running
Oleksandr Shchur
commited on
Commit
·
ec1ab4f
1
Parent(s):
218d801
Color zero-shot models
Browse files
app.py
CHANGED
@@ -79,7 +79,7 @@ with gr.Blocks() as demo:
|
|
79 |
* **Average relative error**: Geometric mean of the relative errors for each task. The relative error for each task is computed as `model_error / baseline_error`.
|
80 |
* **Average rank**: Arithmetic mean of the ranks achieved by each model on each task.
|
81 |
* **Median inference time (s)**: Median of the times required to make predictions for the entire dataset (in seconds).
|
82 |
-
* **Training corpus overlap (%)**: Percentage of the datasets used in the benchmark that were included in the model's training corpus. Zero-shot models are highlighted in green
|
83 |
|
84 |
Lower values are better for all of the above metrics.
|
85 |
|
|
|
79 |
* **Average relative error**: Geometric mean of the relative errors for each task. The relative error for each task is computed as `model_error / baseline_error`.
|
80 |
* **Average rank**: Arithmetic mean of the ranks achieved by each model on each task.
|
81 |
* **Median inference time (s)**: Median of the times required to make predictions for the entire dataset (in seconds).
|
82 |
+
* **Training corpus overlap (%)**: Percentage of the datasets used in the benchmark that were included in the model's training corpus. Zero-shot models are highlighted in <span style="color:green; font-weight:bold;">green</span>.
|
83 |
|
84 |
Lower values are better for all of the above metrics.
|
85 |
|