Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Standard method for rolling up taxa ranks #50

Open
mihow opened this issue Nov 20, 2024 · 0 comments
Open

Standard method for rolling up taxa ranks #50

mihow opened this issue Nov 20, 2024 · 0 comments

Comments

@mihow
Copy link
Collaborator

mihow commented Nov 20, 2024

Background: It would be more helpful if Antenna never shows low-confidence results (eg. "I am 0.01% certain this is a Spotted tussock moth"). Instead it's ideal if we keep rolling up to the next higher taxon rank until the confidence score is above a given threshold, until we can say "I am 60% certain this is in the family of Erebidae moths".

Find the method used in Fagner's evaluation code as a starting point.

If the calibrated softmax scores of a prediction are below a threshold, roll up all predictions for that image to the next taxon level, re-weight the scores and repeat until the top-1 prediction is above the threshold. Or use another method?

The inference API should return more in-depth data about each prediction.

Depends on #43

@mihow mihow changed the title Standard method for rolling up taxa levels Standard method for rolling up taxa ranks Jan 29, 2025
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants