Spaces:
Running
Running
| <p style='font-size:large;'> | |
| You will be <mark>given a user profile and a travel-related query</mark>. | |
| Your task is to <mark>evaluate the generated queries (numbered 1-6)</mark> based on the | |
| following criteria:</p> | |
| <p><strong><mark>Groundedness</mark>:</strong> | |
| Evaluate how well the query incorporates the given filters. | |
| <br> Select one of the following options: | |
| <ol style="padding-left:2rem;"> | |
| <li><b>Not Grounded</b> - None of the filters are present in the query.</li> <li><b>Partially Grounded</b> - | |
| Some filters are present, but not all. </li> | |
| <li><b>Fully Grounded</b> - All provided filters are accurately reflected in the query. | |
| </li> | |
| <li><b>Unclear</b> - It is difficult to determine whether the filters are included.</li> | |
| </ol> | |
| </p> | |
| <p><strong><mark>Clarity Assessment</mark>:</strong> | |
| Evaluate how clear and understandable the query is. | |
| Consider whether it is grammatically correct and easy to interpret. | |
| <br>Your options are: | |
| <ol style="padding-left:2rem;"> | |
| <li><b>Not Clear</b> - The query is difficult to understand or contains | |
| significant grammatical errors.</li> | |
| li><b>Somewhat Clear</b> - The query is understandable but may have | |
| minor grammatical issues or slight ambiguity.</li> | |
| <li><b>Very Clear</b> - The query is well-formed, | |
| grammatically correct, and easy to understand.</li> | |
| </ol> | |
| </p> | |
| <p><strong><mark>Persona Alignment</mark>:</strong> | |
| How likely is the query to match the persona and reflect a question they would ask about travel? | |
| <br>Your options are: | |
| <ol style='padding-left:2rem;'> | |
| <li><b>Not Aligned</b> - The user is not likely at all to ask this query.</li> | |
| <li><b>Partially Aligned</b> - The user is quite likely to ask this query.</li> | |
| <li><b>Aligned</b> - The user is very likely to ask this query. </li> | |
| <li><b>Unclear</b> - It is unclear whether the user will ask this query.</li> </ol> | |
| </p> | |
| <p><strong><mark>Overall Fit</mark>:</strong></p> | |
| <p>Evaluate how well the query aligns with the given filters and persona. | |
| Consider all factors, including relevance, clarity, and persona alignment, to give an overall rating. | |
| <br>Your options are: | |
| <ol style="padding-left:2rem;"> | |
| <li><b>Poor</b> - The query does not match the filters or persona and is unclear.</li> | |
| <li><b>Moderate</b> - The query somewhat matches the filters or persona but has issues with clarity or alignment.</li> | |
| <!-- <li><b>Strong Fit</b> - The query is mostly relevant, clear, and well-aligned with the persona.</li> --> | |
| <li><b>Strong Fit</b> - The query is highly relevant, clear, and perfectly aligned with the persona and filters.</li> | |
| </ol> </p> | |
| <p><strong><mark>Additional Comments (Optional)</mark>:</strong> | |
| If you have any feedback, remarks, or interesting observations about the data, you can leave them here. | |
| This is completely optional. | |
| </p> |