Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

TREC Terabyte 04-06 topic/qrel files merged (GOV2 corpus) #109

Merged
merged 1 commit into from
Jun 20, 2019
Merged

TREC Terabyte 04-06 topic/qrel files merged (GOV2 corpus) #109

merged 1 commit into from
Jun 20, 2019

Conversation

chauff
Copy link
Member

@chauff chauff commented Jun 20, 2019

No description provided.

@lintool lintool merged commit e51fe7a into osirrc:master Jun 20, 2019
ryan-clancy pushed a commit that referenced this pull request Jun 26, 2019
* Add files via upload (#104)

* Evaluate on all topics instead of those with documents retrieved (#108)

* Added TREC7 and TREC8 qrels (primarily to avoid confusion with the WT qrels in `qrels/qrels.401-450.txt`

* Missing TREC7 topics files

* Change default to setting also used in the "official" evaluation

* Add -c flag for trec_eval

* Revert "Change default to setting also used in the "official" evaluation"

This reverts commit 85b13df.

* TREC Terabyte 04-06 topic/qrel files merged (#109)
ryan-clancy pushed a commit that referenced this pull request Jun 28, 2019
* Update Azure script

* and make sure it's uncommented...

* Enable timings for terrier and pisa

* Capture logs and scp back to local.

* Update robust04 runbook

* Remove P@5 from OldDog config

* robust04, core17, and core18 runbooks.

* Update terrier version in runbook

* Update core17 runbook

* Update terrier runbook

* Whoops...

* Update olddog version

* Add anserini-bm25prf to runbook

* Update anserini-bm25prf

* Update anserini-bm25prf

* Update robust05 path for irc-centre2019

* Add ielab and galago to runbook

* Write an additional file with the trec_eval results

* Update runbook for official releases

* Add NDCG@20 by default and fix anserini-bm25prf output directory

* Don't create .trec_eval files for non-trec files

* Merge master into azure-script (#111)

* Add files via upload (#104)

* Evaluate on all topics instead of those with documents retrieved (#108)

* Added TREC7 and TREC8 qrels (primarily to avoid confusion with the WT qrels in `qrels/qrels.401-450.txt`

* Missing TREC7 topics files

* Change default to setting also used in the "official" evaluation

* Add -c flag for trec_eval

* Revert "Change default to setting also used in the "official" evaluation"

This reverts commit 85b13df.

* TREC Terabyte 04-06 topic/qrel files merged (#109)
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants