[Perf] Changes at 5/24/2022 10:45:34 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 18.04
Baseline	e86511ec00d9fad4667c71e73017931b74a049d6
Compare	0dba0ee1b234100ade81d2b4f799cc118150785c
Diff	Diff

Regressions in System.Tests.Perf_String

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Trim_CharArr - Duration of single invocation	38.42 ns	44.92 ns	1.17	0.40	False
Remove_IntInt - Duration of single invocation	33.26 ns	41.69 ns	1.25	0.35	False
TrimEnd_CharArr - Duration of single invocation	37.25 ns	39.44 ns	1.06	0.42	False
Trim_CharArr - Duration of single invocation	41.89 ns	48.49 ns	1.16	0.35	False
Insert - Duration of single invocation	38.42 ns	41.98 ns	1.09	0.47	False
Remove_IntInt - Duration of single invocation	32.79 ns	40.62 ns	1.24	0.40	False
Remove_IntInt - Duration of single invocation	34.68 ns	41.77 ns	1.20	0.45	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_String*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_String.Trim_CharArr(s: " Test", c: [' ', ' '])

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 44.922496078963086 > 40.92527021670474.
IsChangePoint: Marked as a change because one of 4/16/2022 8:46:33 PM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -6.521197398764785 (T) = (0 -42.78415792341795) / Math.Sqrt((1.0391636913302087 / (11)) + (4.967391616873012 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.08160015634226049 = (39.556353309068285 - 42.78415792341795) / 39.556353309068285 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 0, i2: 8)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.69021766495038 > 35.41297852089495.
IsChangePoint: Marked as a change because one of 4/17/2022 3:50:42 AM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -5.0881272904134205 (T) = (0 -38.26462413469153) / Math.Sqrt((4.603817943498782 / (11)) + (1.5790106974345046 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.0998790340772031 = (34.78984774611646 - 38.26462413469153) / 34.78984774611646 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_String.TrimEnd_CharArr(s: "Test ", c: [' ', ' '])

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.438208219016694 > 38.945119164213146.
IsChangePoint: Marked as a change because one of 4/16/2022 2:55:52 PM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -6.145584032447087 (T) = (0 -39.500169815374726) / Math.Sqrt((1.099747549001949 / (11)) + (3.1711193276279186 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.0739897672112923 = (36.77890704484117 - 39.500169815374726) / 36.77890704484117 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_String.Trim_CharArr(s: " Te st  ", c: [' ', ' '])

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.491341929305705 > 43.78870434860997.
IsChangePoint: Marked as a change because one of 4/27/2022 2:36:29 AM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -8.412628599912177 (T) = (0 -45.03663434212923) / Math.Sqrt((0.5553506345788869 / (11)) + (3.53746324906374 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.08011766816340211 = (41.69604448625315 - 45.03663434212923) / 41.69604448625315 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_String.Insert(s1: "dzsdzsDDZSDZSDZSddsz", i: 7, s2: "Test")

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.98462202599651 > 40.16847690540785.
IsChangePoint: Marked as a change because one of 4/18/2022 10:15:32 PM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -5.191253331000383 (T) = (0 -43.40042737916681) / Math.Sqrt((5.371566042206823 / (11)) + (3.977716584556377 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.10294131680446185 = (39.349715817075676 - 43.40042737916681) / 39.349715817075676 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 10, i2: 1)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.61777118061085 > 34.65873159777267.
IsChangePoint: Marked as a change because one of 4/20/2022 12:55:12 PM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -4.326016474066208 (T) = (0 -38.61628206358491) / Math.Sqrt((9.159170765140267 / (11)) + (3.7511774379623124 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.12230636166588532 = (34.40796861051842 - 38.61628206358491) / 34.40796861051842 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 7, i2: 4)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.77347768669223 > 35.681369833864714.
IsChangePoint: Marked as a change because one of 4/17/2022 8:26:34 PM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -3.9444567930486736 (T) = (0 -39.591692356936186) / Math.Sqrt((9.218365274940924 / (11)) + (5.710542595294702 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.11133191323608015 = (35.62544356496467 - 39.591692356936186) / 35.62544356496467 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 18.04
Baseline	e86511ec00d9fad4667c71e73017931b74a049d6
Compare	0dba0ee1b234100ade81d2b4f799cc118150785c
Diff	Diff

Regressions in System.Collections.Tests.Perf_BitArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
BitArrayAnd - Duration of single invocation	41.20 ns	55.29 ns	1.34	0.38	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_BitArray*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_BitArray.BitArrayAnd(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.28701404111184 > 44.807852833693126.
IsChangePoint: Marked as a change because one of 3/11/2022 4:59:21 AM, 3/31/2022 1:45:25 PM, 5/20/2022 7:31:10 PM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -4.121384798458966 (T) = (0 -50.661345526061034) / Math.Sqrt((14.647059587791983 / (11)) + (9.264945252316462 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.11519720981046594 = (45.42814946126992 - 50.661345526061034) / 45.42814946126992 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 18.04
Baseline	e86511ec00d9fad4667c71e73017931b74a049d6
Compare	0dba0ee1b234100ade81d2b4f799cc118150785c
Diff	Diff

Regressions in System.Tests.Perf_Environment

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetLogicalDrives - Duration of single invocation	82.30 μs	112.85 μs	1.37	0.55	True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Environment*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Environment.GetLogicalDrives

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 112.85034138074155 > 84.89776295809277.
IsChangePoint: Marked as a change because one of 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -15.986663785360351 (T) = (0 -118105.96623550322) / Math.Sqrt((30299878.898936816 / (11)) + (74166715.40553546 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.43416875762848944 = (82351.51240555588 - 118105.96623550322) / 82351.51240555588 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	ubuntu 18.04
Baseline	e86511ec00d9fad4667c71e73017931b74a049d6
Compare	0dba0ee1b234100ade81d2b4f799cc118150785c
Diff	Diff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
CtorInvoke - Duration of single invocation	704.06 μs	895.12 μs	1.27	0.46	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.CtorInvoke(Options: Compiled)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 895.1233597274436 > 778.688947219187.
IsChangePoint: Marked as a change because one of 2/26/2022 10:27:55 AM, 3/14/2022 7:02:48 PM, 5/24/2022 3:42:52 PM, 6/2/2022 5:13:37 AM falls between 5/24/2022 3:42:52 PM and 6/2/2022 5:13:37 AM.
IsRegressionStdDev: Marked as regression because -9.542877667317054 (T) = (0 -826738.4944390864) / Math.Sqrt((574525345.8835036 / (11)) + (1239858090.8187902 / (33))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (11) + (33) - 2, .025) and -0.12281774956775889 = (736306.9338344077 - 826738.4944390864) / 736306.9338344077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository