Ashmi Banerjee commited on
Commit
c2ca81b
·
1 Parent(s): 934c580

added overall fit

Browse files
static/instructions.html CHANGED
@@ -35,6 +35,17 @@
35
  <li><b>Aligned</b> - The user is very likely to ask this query. </li>
36
  <li><b>Unclear</b> - It is unclear whether the user will ask this query.</li> </ol>
37
  </p>
 
 
 
 
 
 
 
 
 
 
 
38
  <p><strong><mark>Additional Comments (Optional)</mark>:</strong>
39
  If you have any feedback, remarks, or interesting observations about the data, you can leave them here.
40
  This is completely optional.
 
35
  <li><b>Aligned</b> - The user is very likely to ask this query. </li>
36
  <li><b>Unclear</b> - It is unclear whether the user will ask this query.</li> </ol>
37
  </p>
38
+ <p><strong><mark>Overall Fit</mark>:</strong></p>
39
+ <p>Evaluate how well the query aligns with the given filters and persona.
40
+ Consider all factors, including relevance, clarity, and persona alignment, to give an overall rating.
41
+ <br>Your options are:
42
+ <ol style="padding-left:2rem;">
43
+ <li><b>Persona-Only Match</b> - The query aligns well with the persona but does not clearly match the filters.</li>
44
+ <li><b>Filters-Only Match</b> - The query aligns well with the filters but does not clearly match the persona.</li>
45
+ <li><b>Partial Fit: Incomplete Match</b> - The query aligns with some filters but not all, or it matches the persona but has issues with clarity or alignment.</li>
46
+ <li><b>Strong Fit</b> - The query is mostly relevant, clear, and well-aligned with the persona and filters.</li>
47
+ <!-- <li><b>Excellent</b> - The query is highly relevant, clear, and perfectly aligned with the persona and filters.</li>-->
48
+ </ol></p>
49
  <p><strong><mark>Additional Comments (Optional)</mark>:</strong>
50
  If you have any feedback, remarks, or interesting observations about the data, you can leave them here.
51
  This is completely optional.
views/questions_screen.py CHANGED
@@ -166,9 +166,9 @@ def render_query_ratings(
166
  cols[2] if has_persona_alignment else cols[1],
167
  )
168
  overall_rating = render_single_rating(
169
- "Overall rating:",
170
- [0, 1, 2, 3],
171
- lambda x: ["N/A", "Not Clear", "Somewhat Clear", "Very Clear"][x],
172
  f"rating_{model_name}{query_key}_overall_",
173
  stored_overall_rating,
174
  cols[3] if has_persona_alignment else cols[2],
 
166
  cols[2] if has_persona_alignment else cols[1],
167
  )
168
  overall_rating = render_single_rating(
169
+ "Overall Fit:",
170
+ [0, 1, 2, 3, 4],
171
+ lambda x: ["N/A", "Persona-Only Match", "Filters-Only Match", "Partial Fit", "Strong Fit"][x],
172
  f"rating_{model_name}{query_key}_overall_",
173
  stored_overall_rating,
174
  cols[3] if has_persona_alignment else cols[2],