Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Fix AUROC to work with torchmetrics >=0.11 (bump required version to 0.11) #1181

Merged
merged 4 commits into from
Dec 8, 2022

Conversation

FrenchKrab
Copy link
Contributor

With torchmetrics 0.11, AUROC implemention has made a breaking change and now requires to specify the problem type (multiclass/multilabel/binary classification).
(see v0.10 API vs v0.11 API)

This pull request fixes obsolete ("deprecated" in v0.10.x but still worked) AUROC uses and (should) allow unit tests to pass again.
It also bumps the required torchmetrics version to 0.10 because these new specialized AUROC didn't seem to exist before.

(It's possible I didn't use the right types of AUROC metrics)

@codecov
Copy link

codecov bot commented Dec 7, 2022

Codecov Report

Base: 29.98% // Head: 30.09% // Increases project coverage by +0.10% 🎉

Coverage data is based on head (99af710) compared to base (789b8d4).
Patch coverage: 71.42% of modified lines in pull request are covered.

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #1181      +/-   ##
===========================================
+ Coverage    29.98%   30.09%   +0.10%     
===========================================
  Files           61       61              
  Lines         3788     3798      +10     
===========================================
+ Hits          1136     1143       +7     
- Misses        2652     2655       +3     
Impacted Files Coverage Δ
pyannote/audio/tasks/embedding/mixins.py 26.01% <66.66%> (+0.60%) ⬆️
pyannote/audio/tasks/segmentation/mixins.py 48.55% <66.66%> (+0.36%) ⬆️
pyannote/audio/core/io.py 69.01% <100.00%> (+0.44%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

pyannote/audio/tasks/segmentation/mixins.py Outdated Show resolved Hide resolved
requirements.txt Outdated Show resolved Hide resolved
@FrenchKrab FrenchKrab changed the title Fix AUROC to work with torchmetrics >=0.11 (bump required version to 0.10) Fix AUROC to work with torchmetrics >=0.11 (bump required version to 0.11) Dec 8, 2022
@hbredin hbredin merged commit 8217ae2 into pyannote:develop Dec 8, 2022
@FrenchKrab FrenchKrab deleted the update_torchmetrics branch December 8, 2022 12:06
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants