Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Lucene 9.9: Benchmark sparse improvements #2293

Closed
lintool opened this issue Dec 5, 2023 · 1 comment
Closed

Lucene 9.9: Benchmark sparse improvements #2293

lintool opened this issue Dec 5, 2023 · 1 comment

Comments

@lintool
Copy link
Member

lintool commented Dec 5, 2023

Follow up to this: #2288 (comment)

It'd be great to re-benchmark the "Wacky Weights" paper: https://arxiv.org/abs/2110.11540

It's actually quite simple, we've gotten it down to a single command:

python src/main/python/run_regression.py --download --index --verify --search --regression msmarco-passage-splade-pp-ed

See: https://github.com/castorini/anserini/blob/master/docs/regressions/regressions-msmarco-passage-splade-pp-ed.md

@jpountz @benwtrent @ChrisHegarty Do either of you have cycles to try it out?

@lintool
Copy link
Member Author

lintool commented Feb 24, 2024

No further follow-up, closing.

@lintool lintool closed this as completed Feb 24, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant