Spaces:
Running
Running
Ashmi Banerjee
commited on
Commit
·
c2ca81b
1
Parent(s):
934c580
added overall fit
Browse files- static/instructions.html +11 -0
- views/questions_screen.py +3 -3
static/instructions.html
CHANGED
@@ -35,6 +35,17 @@
|
|
35 |
<li><b>Aligned</b> - The user is very likely to ask this query. </li>
|
36 |
<li><b>Unclear</b> - It is unclear whether the user will ask this query.</li> </ol>
|
37 |
</p>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
38 |
<p><strong><mark>Additional Comments (Optional)</mark>:</strong>
|
39 |
If you have any feedback, remarks, or interesting observations about the data, you can leave them here.
|
40 |
This is completely optional.
|
|
|
35 |
<li><b>Aligned</b> - The user is very likely to ask this query. </li>
|
36 |
<li><b>Unclear</b> - It is unclear whether the user will ask this query.</li> </ol>
|
37 |
</p>
|
38 |
+
<p><strong><mark>Overall Fit</mark>:</strong></p>
|
39 |
+
<p>Evaluate how well the query aligns with the given filters and persona.
|
40 |
+
Consider all factors, including relevance, clarity, and persona alignment, to give an overall rating.
|
41 |
+
<br>Your options are:
|
42 |
+
<ol style="padding-left:2rem;">
|
43 |
+
<li><b>Persona-Only Match</b> - The query aligns well with the persona but does not clearly match the filters.</li>
|
44 |
+
<li><b>Filters-Only Match</b> - The query aligns well with the filters but does not clearly match the persona.</li>
|
45 |
+
<li><b>Partial Fit: Incomplete Match</b> - The query aligns with some filters but not all, or it matches the persona but has issues with clarity or alignment.</li>
|
46 |
+
<li><b>Strong Fit</b> - The query is mostly relevant, clear, and well-aligned with the persona and filters.</li>
|
47 |
+
<!-- <li><b>Excellent</b> - The query is highly relevant, clear, and perfectly aligned with the persona and filters.</li>-->
|
48 |
+
</ol></p>
|
49 |
<p><strong><mark>Additional Comments (Optional)</mark>:</strong>
|
50 |
If you have any feedback, remarks, or interesting observations about the data, you can leave them here.
|
51 |
This is completely optional.
|
views/questions_screen.py
CHANGED
@@ -166,9 +166,9 @@ def render_query_ratings(
|
|
166 |
cols[2] if has_persona_alignment else cols[1],
|
167 |
)
|
168 |
overall_rating = render_single_rating(
|
169 |
-
"Overall
|
170 |
-
[0, 1, 2, 3],
|
171 |
-
lambda x: ["N/A", "
|
172 |
f"rating_{model_name}{query_key}_overall_",
|
173 |
stored_overall_rating,
|
174 |
cols[3] if has_persona_alignment else cols[2],
|
|
|
166 |
cols[2] if has_persona_alignment else cols[1],
|
167 |
)
|
168 |
overall_rating = render_single_rating(
|
169 |
+
"Overall Fit:",
|
170 |
+
[0, 1, 2, 3, 4],
|
171 |
+
lambda x: ["N/A", "Persona-Only Match", "Filters-Only Match", "Partial Fit", "Strong Fit"][x],
|
172 |
f"rating_{model_name}{query_key}_overall_",
|
173 |
stored_overall_rating,
|
174 |
cols[3] if has_persona_alignment else cols[2],
|