Update MS MARCO V2 regressions #1967
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov Report
@@ Coverage Diff @@
## master #1967 +/- ##
=========================================
Coverage 58.30% 58.30%
Complexity 1067 1067
=========================================
Files 186 186
Lines 10147 10147
Branches 1398 1398
=========================================
Hits 5916 5916
Misses 3758 3758
Partials 473 473 Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. |
yuki617
reviewed
Aug 23, 2022
src/main/resources/regression/msmarco-v2-passage-unicoil-0shot.yaml
Outdated
Show resolved
Hide resolved
|
@yuki617 @MXueguang @ToluClassics Ready for review! |
|
seems some regression documents didn't provide instructions to download corpus? |
Yea... that' unrelated to this specific PR, so let me circle back and do that later? |
MXueguang
approved these changes
Sep 5, 2022
yuki617
approved these changes
Sep 5, 2022
| R@1000: | ||
| - 0.7731 | ||
| - 0.7698 | ||
| - name: rocchio |
There was a problem hiding this comment.
Maybe unicoil-0shot+rocchio is a better name?
# for free
to join this conversation on GitHub.
Already have an account?
# to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add RM3 and Rocchio in cases where it's missing.