New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Add summary of metrics to landing page #4

Open

andrewyates opened this issue May 27, 2021 · 0 comments

Labels

Member

andrewyates commented May 27, 2021

Based on earlier discussions, it would be nice to display the following on the landing page to help assess a single run:

Number of unjudged docs (in top K)
Metrics with upper and lower bounds (based on assumptions about unjudged docs)

And to assess pairs of runs:
3. Wins/losses/draws between the two runs (e.g., number of queries with a > 0.01 difference in a metric)

andrewyates added the enhancement label

# for free to join this conversation on GitHub. Already have an account? # to comment