Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Inter Rater Agreement Metric #26

Open
jaydebsarker opened this issue Apr 9, 2023 · 0 comments
Open

Inter Rater Agreement Metric #26

jaydebsarker opened this issue Apr 9, 2023 · 0 comments

Comments

@jaydebsarker
Copy link

During calculating Krippendorff’s α, did you take the mean (average) value for all posts?

For each post, you have 3 labelers. So, did you calculate the Krippendorff’s α for each post and take the average finally (paper says: annotator agreement is 0.46)?
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jaydebsarker