Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

用什么指标可以评估你这个方法整体的效果呢 #36

Open
youxingtian opened this issue Oct 11, 2022 · 1 comment
Open

用什么指标可以评估你这个方法整体的效果呢 #36

youxingtian opened this issue Oct 11, 2022 · 1 comment

Comments

@youxingtian
Copy link

No description provided.

@xiaoyichao
Copy link
Collaborator

No description provided.

如果你有自己的数据集N个QA对, 且有M个问题,你知道这M个问题对应的Question, 那么你可以测评Top1和Top3的结果(Top1和Top3的结果包含的正确的Question,则加1分),看看当前这个算法框架和其他算法框架返回的结果,记录哪个得分高。

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants