New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Replicated baseline for MS MARCO V2 #1576

Merged

lintool merged 1 commit into castorini:master from crystina-z:replicate-msmarco-v2

Jun 26, 2021

Member

crystina-z commented Jun 26, 2021

$ tools/eval/trec_eval.9.0.4/trec_eval -c -m map -m recall.100 -m recip_rank collections/docv2_dev_qrels.uniq.tsv runs/run.msmarco-doc-v2.dev.txt
map                     all     0.1552
recip_rank              all     0.1572
recall_100              all     0.5956

where the docv2_dev_qrels.uniq.tsv is prepared by

cat docv2_dev_qrels.tsv | sort | uniq > docv2_dev_qrels.uniq.tsv


          Replicated baseline for MS MARCO V2

3f522c5

lintool approved these changes

View reviewed changes

lintool merged commit 6f9352f into castorini:master

# for free to join this conversation on GitHub. Already have an account? # to comment

Labels

None yet