Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

System.Security.Cryptography.X509Certificates.Tests.CollectionTests "Assert.Equal() Failure: Values differ" #112738

Closed
EgorBo opened this issue Feb 20, 2025 · 5 comments
Assignees
Labels
area-System.Security blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' in-pr There is an active PR which will close this issue when it is merged Known Build Error Use this to report build issues in the .NET Helix tab

Comments

@EgorBo
Copy link
Member

EgorBo commented Feb 20, 2025

Widespread failures in System.Security.Cryptography.X509Certificates.Tests.CollectionTests.* tests

Assert.Equal() Failure: Values differ
Expected: 2
Actual:   0

   at System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts(PbeEncryptionAlgorithm encryptionAlgorithm, String hashAlgorithm, Int32 iterations) in /_/src/libraries/System.Security.Cryptography/tests/X509Certificates/CollectionTests.cs:line 1694
   at InvokeStub_CollectionTests.ExportPkcs12_PbeParameters_TwoCerts(Object, Span`1)
   at System.Reflection.MethodBaseInvoker.InvokeWithFewArgs(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs:line 136

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=957657
Build error leg or test failing: System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_CertOnly
Pull request: #112717

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorPattern": "System\\.Security\\.Cryptography\\.X509Certificates\\.Tests\\.(ExportTests|CollectionTests)\\.ExportPkcs12_",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=957657
Error message validated: [System.Security.Cryptography.X509Certificates.Tests.CollectionTests]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/20/2025 1:41:41 PM UTC

Report

Build Definition Test Pull Request
957657 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters #112717

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 1 1

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=957657
Error message validated: [System\.Security\.Cryptography\.X509Certificates\.Tests\.(ExportTests|CollectionTests)\.ExportPkcs12_]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/20/2025 2:48:52 PM UTC

Report

Build Definition Test Pull Request
957657 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters #112717

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 1 1

Report

Build Definition Test Pull Request
958219 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters #112369
958314 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_TwoCerts #112535
958251 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters #112213
958242 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_TwoCerts #112758
958209 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts #112372
958200 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts #112352
958192 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters
958116 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters_CertOnly #112728
958047 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_TwoCerts #112721
958022 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_TwoCerts #112705
957980 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters #112750
957919 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_TwoCerts #112740
957891 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts #112736
957896 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts #112736
957804 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12 #112666
957781 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts #112736
957769 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters #112353
957728 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters #112733
957330 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts #112594
957688 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts #112697
957676 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.CollectionTests.ExportPkcs12_PbeParameters_TwoCerts #112660
957657 dotnet/runtime System.Security.Cryptography.X509Certificates.Tests.ExportTests.ExportPkcs12_PbeParameters #112717

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 22 22
@EgorBo EgorBo added blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab labels Feb 20, 2025
@dotnet-policy-service dotnet-policy-service bot added the untriaged New issue has not been triaged by the area owner label Feb 20, 2025
Copy link
Contributor

Tagging subscribers to this area: @dotnet/area-system-security, @bartonjs, @vcsjones
See info in area-owners.md if you want to be subscribed.

@EgorBo
Copy link
Member Author

EgorBo commented Feb 20, 2025

Seems to be #112569 cc @vcsjones

@vcsjones vcsjones self-assigned this Feb 20, 2025
@vcsjones
Copy link
Member

executed on machine a0098ZJ running Windows-10-10.0.14393-SP0

This is yet another example of a failing test being merged because System.Security.Cryptography, by default, does not run against Windows 10, but CLR tests do, and crypto tends to be sensitive to OS differences.

@dotnet-policy-service dotnet-policy-service bot added the in-pr There is an active PR which will close this issue when it is merged label Feb 20, 2025
@vcsjones
Copy link
Member

The PR to address this has been merged; I am going to leave this issue open for a bit to see the hit count settle down.

@vcsjones
Copy link
Member

Hits are zero, and I've seen a couple of PRs pass that would have hit this, so I am going to close this out.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
area-System.Security blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' in-pr There is an active PR which will close this issue when it is merged Known Build Error Use this to report build issues in the .NET Helix tab
Projects
None yet
Development

No branches or pull requests

2 participants