Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Replication for MS MARCO Passage and Doc #1369

Merged
merged 1 commit into from
Sep 8, 2020
Merged

Replication for MS MARCO Passage and Doc #1369

merged 1 commit into from
Sep 8, 2020

Conversation

qguo96
Copy link
Contributor

@qguo96 qguo96 commented Sep 8, 2020

Replication is successful.

Environment:
OS: Ubuntu-18.04.4 LTS
Java: 11.0.8
Maven: 3.6.3

results are shown below:

  • MS MARCO Passage
    Screenshot (1154)

  • MS MARCO Doc
    Screenshot (1151)
    Screenshot (1153)

@qguo96
Copy link
Contributor Author

qguo96 commented Sep 8, 2020

When I followed the Anserini Notebooks, I found the path to trec_eval is outdated. Instead, it should be tools/eval/trec_eval.9.0.4/trec_eval.

@codecov
Copy link

codecov bot commented Sep 8, 2020

Codecov Report

Merging #1369 into master will decrease coverage by 0.18%.
The diff coverage is n/a.

Impacted file tree graph

@@             Coverage Diff              @@
##             master    #1369      +/-   ##
============================================
- Coverage     53.64%   53.46%   -0.19%     
+ Complexity      828      820       -8     
============================================
  Files           154      154              
  Lines          8627     8627              
  Branches       1224     1224              
============================================
- Hits           4628     4612      -16     
- Misses         3622     3637      +15     
- Partials        377      378       +1     
Impacted Files Coverage Δ Complexity Δ
...java/io/anserini/ltr/feature/CountBigramPairs.java 70.12% <0.00%> (-19.49%) 26.00% <0.00%> (-7.00%)
...anserini/ltr/feature/base/PMIFeatureExtractor.java 84.61% <0.00%> (-1.93%) 12.00% <0.00%> (-1.00%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update e16b3c1...577855c. Read the comment docs.

@lintool lintool merged commit 0f9a8ec into castorini:master Sep 8, 2020
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants