Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

docCOMET available ? #230

Open
nicolasdahan opened this issue Sep 9, 2024 · 1 comment
Open

docCOMET available ? #230

nicolasdahan opened this issue Sep 9, 2024 · 1 comment

Comments

@nicolasdahan
Copy link

2) We now support [DocCOMET](https://statmt.org/wmt22/pdf/2022.wmt-1.6.pdf), a document-level extension of COMET which can utilize contextual information. Using context improves accuracy on discourse phenomena tasks as well as referenceless evaluation of [chat translation quality](https://arxiv.org/pdf/2403.08314).

Is docCOMET really available?

the original repo hasn't been updated for a while (https://github.com/amazon-science/doc-mt-metrics/tree/main)

regards

@YutongWang1216
Copy link

I have the same confusion. From https://github.com/Unbabel/COMET/blob/master/comet/cli/score.py we can see a parameter "--enable-context" has been added to the script, but it seems the package installed from pip has not been updated, since running comet-score --enable-context will raise the following error:

comet-score: error: Unrecognized arguments: --enable-context

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants