Run Information
Regressions in System.Tests.Perf_Version
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Version*'
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Version.Ctor3
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -102.11659169159766 (T) = (0 -86.74571476872939) / Math.Sqrt((0.12230139019819382 / (7)) + (0.34097203649353724 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -0.7430184405411777 = (49.76752554711717 - 86.74571476872939) / 49.76752554711717 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Version.Ctor2
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -130.89007952591638 (T) = (0 -71.46053405222891) / Math.Sqrt((0.12904052784230644 / (7)) + (0.047092010962607275 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -0.5114678426116724 = (47.278898060280206 - 71.46053405222891) / 47.278898060280206 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Version.Ctor4
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -69.91395572248736 (T) = (0 -101.93066727444004) / Math.Sqrt((1.471178010925077 / (7)) + (0.8878575041028844 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -0.9529804518972763 = (52.19236432982046 - 101.93066727444004) / 52.19236432982046 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
### Run Information
Regressions in System.Tests.Perf_Int16
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int16*'
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Int16.ToString(value: 32767)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -56.388800046236824 (T) = (0 -369.86237428362614) / Math.Sqrt((0.4866799662928942 / (7)) + (96.02840362269899 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -6.326084703684954 = (50.485680857278204 - 369.86237428362614) / 50.485680857278204 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Int16.ToString(value: 0)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -80.48997064927724 (T) = (0 -50.725437409996665) / Math.Sqrt((0.3549137971977588 / (7)) + (0.15089070297483032 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -1.0172795589575365 = (25.145467411670943 - 50.725437409996665) / 25.145467411670943 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Numerics.Tests.Perf_Matrix4x4
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Matrix4x4.CreatePerspectiveFieldOfViewBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -47.407465925003 (T) = (0 -244.7283279584433) / Math.Sqrt((16.955750812608382 / (6)) + (19.593654446125736 / (3))) is less than -2.3646242515927898 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (3) - 2, .025) and -1.4543703149147356 = (99.71124832763678 - 244.7283279584433) / 99.71124832763678 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreatePerspectiveBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -28.27856125928147 (T) = (0 -171.1409131619612) / Math.Sqrt((7.888483020637348 / (6)) + (21.182069958258506 / (3))) is less than -2.3646242515927898 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (3) - 2, .025) and -0.9164335188808791 = (89.30177409018638 - 171.1409131619612) / 89.30177409018638 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreatePerspectiveOffCenterBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -31.55669924340902 (T) = (0 -183.25801278540254) / Math.Sqrt((7.261748400179219 / (7)) + (17.08249335847475 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -0.807574409516796 = (101.38338528171097 - 183.25801278540254) / 101.38338528171097 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in LinqBenchmarks
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'LinqBenchmarks*'
Details
Payloads
Baseline
Compare
Histogram
LinqBenchmarks.Where01ForX
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -14.936972236005152 (T) = (0 -5631493356.288889) / Math.Sqrt((3694169213402831.5 / (7)) + (43721919026826.195 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -0.06583450163764645 = (5283647083.70403 - 5631493356.288889) / 5283647083.70403 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### LinqBenchmarks.Where01LinqQueryX
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -13.734392138221246 (T) = (0 -5893148331.555554) / Math.Sqrt((3774102618403431.5 / (7)) + (610818891582227.5 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -0.06782461999228462 = (5518835416.623129 - 5893148331.555554) / 5518835416.623129 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### LinqBenchmarks.Where01LinqMethodX
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -9.86345996511963 (T) = (0 -5980419743.822223) / Math.Sqrt((2693421689581077.5 / (7)) + (5661386090254048 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -0.08531989186277468 = (5510282994.590477 - 5980419743.822223) / 5510282994.590477 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Perf_Convert
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Perf_Convert*'
Details
Payloads
Baseline
Compare
Histogram
System.Perf_Convert.ChangeType
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -278.32962679684823 (T) = (0 -549.827499101074) / Math.Sqrt((3.4844707188457495 / (7)) + (2.212745495100914 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -1.286444151406167 = (240.4727440042343 - 549.827499101074) / 240.4727440042343 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_Byte
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Byte*'
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Byte.ToString(value: 255)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -195.61171260977292 (T) = (0 -320.29023052152485) / Math.Sqrt((1.5811890951979486 / (7)) + (5.9246995311702335 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -9.641055212020607 = (30.09948018686256 - 320.29023052152485) / 30.09948018686256 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Byte.ToString(value: 0)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -214.07001758349224 (T) = (0 -38.46763301637973) / Math.Sqrt((0.16976291339258173 / (7)) + (0.00026408657920728166 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -6.58722563160005 = (5.07005259684987 - 38.46763301637973) / 5.07005259684987 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_SByte
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_SByte*'
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_SByte.ToString(value: 127)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -131.10599664117586 (T) = (0 -331.373923544455) / Math.Sqrt((2.5541456821294104 / (7)) + (12.777817799214688 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -5.701772953166281 = (49.445710241182674 - 331.373923544455) / 49.445710241182674 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_Int32
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Int32.ToString(value: 4)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -397.7799585017025 (T) = (0 -50.363405275838055) / Math.Sqrt((0.005876323844439421 / (7)) + (0.0086335361594911 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -0.928832130475525 = (26.110828661601413 - 50.363405275838055) / 26.110828661601413 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Int32.ToString(value: 2147483647)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -98.0488081341939 (T) = (0 -459.62939409938963) / Math.Sqrt((0.8294610613239252 / (7)) + (50.04965875014641 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -6.961932675112278 = (57.72836983865956 - 459.62939409938963) / 57.72836983865956 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Int32.ToString(value: 12345)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -186.46041601920334 (T) = (0 -359.6577200179263) / Math.Sqrt((0.225274352613395 / (7)) + (8.157075364986618 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -6.13886458571935 = (50.38024124135775 - 359.6577200179263) / 50.38024124135775 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_UInt32
Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt32*'
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_UInt32.ToString(value: 0)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -121.83438545236052 (T) = (0 -38.26640494603868) / Math.Sqrt((0.5208478356031971 / (7)) + (0.01079345134623293 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -8.027440808630944 = (4.2388984605086515 - 38.26640494603868) / 4.2388984605086515 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_UInt32.ToString(value: 12345)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -173.78822541441707 (T) = (0 -352.30509252906205) / Math.Sqrt((1.0149976066430988 / (7)) + (9.942195956545815 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -11.11336904509903 = (29.08398903867308 - 352.30509252906205) / 29.08398903867308 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_UInt32.ToString(value: 4294967295)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 12/1/2022 1:41:45 AM, 12/6/2022 2:12:43 AM falls between 11/26/2022 10:41:09 PM and 12/6/2022 2:12:43 AM.
IsRegressionStdDev: Marked as regression because -140.96911563937482 (T) = (0 -447.88611016078016) / Math.Sqrt((0.1495139313555134 / (7)) + (25.547906105451304 / (3))) is less than -2.3060041352041716 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (7) + (3) - 2, .025) and -11.443840500940496 = (35.992594900820954 - 447.88611016078016) / 35.992594900820954 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_Version
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Version.Ctor3
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Regressions in System.Tests.Perf_Int16
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Int16.ToString(value: 32767)
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Numerics.Tests.Perf_Matrix4x4
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Numerics.Tests.Perf_Matrix4x4.CreatePerspectiveFieldOfViewBenchmark
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in LinqBenchmarks
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
LinqBenchmarks.Where01ForX
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Perf_Convert
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Perf_Convert.ChangeType
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_Byte
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Byte.ToString(value: 255)
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_SByte
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_SByte.ToString(value: 127)
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_Int32
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_Int32.ToString(value: 4)
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Tests.Perf_UInt32
Test Report
Repro
Details
Payloads
Baseline
Compare
Histogram
System.Tests.Perf_UInt32.ToString(value: 0)
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository