Details
Payloads
Baseline
Compare
Histogram
System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: Json400B)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.6838084200204637 > 2.1153226431495207.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -108.56660716364681 (T) = (0 -2684.765873500021) / Math.Sqrt((337.1416846525056 / (24)) + (426.5939118113299 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.33867463275362175 = (2005.5402618465412 - 2684.765873500021) / 2005.5402618465412 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: Json4KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.40151309912854 > 20.190491037986313.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -191.98165887410957 (T) = (0 -25440.19928828594) / Math.Sqrt((14091.418408215415 / (24)) + (8359.013826778048 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.3295529732272377 = (19134.400659895997 - 25440.19928828594) / 19134.400659895997 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json40KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 295.38663334986774 > 251.95812806341073.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -123.73782802173852 (T) = (0 -294434.21953651967) / Math.Sqrt((1313700.4083771424 / (24)) + (2372003.7257135413 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.22734187643111828 = (239895.84743305555 - 294434.21953651967) / 239895.84743305555 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: DeepTree)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.522743877073301 > 10.389937602069978.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -148.25506039151642 (T) = (0 -12556.842216728433) / Math.Sqrt((4043.9617064750296 / (24)) + (2654.038668397264 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.27020187264163914 = (9885.70595523841 - 12556.842216728433) / 9885.70595523841 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json4KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.34139051696021 > 25.877779141077443.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -101.20566070860013 (T) = (0 -30602.73873362227) / Math.Sqrt((18722.617188346212 / (24)) + (44288.68343335547 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.2382637002768376 = (24714.233912195312 - 30602.73873362227) / 24714.233912195312 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json4KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.34130228863758 > 19.838941795965866.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -145.7298859012032 (T) = (0 -25327.151132840732) / Math.Sqrt((21839.70617728167 / (24)) + (16030.481285162748 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.32922568192061913 = (19054.063939123665 - 25327.151132840732) / 19054.063939123665 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: Json400B)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.096559280153074 > 2.5721337715755843.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -117.59654869635716 (T) = (0 -3078.93623974452) / Math.Sqrt((246.5911437787916 / (24)) + (315.96204665204266 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.2581553134397967 = (2447.1829565514518 - 3078.93623974452) / 2447.1829565514518 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: Json40KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 211.3333977477477 > 161.04719223098394.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -222.16190012238832 (T) = (0 -211197.947015015) / Math.Sqrt((711393.5314084485 / (24)) + (669527.5995075683 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.3819136472472439 = (152830.06100686456 - 211197.947015015) / 152830.06100686456 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json40KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 261.3475329613096 > 217.2018846985991.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -146.25718567921723 (T) = (0 -262363.22204890294) / Math.Sqrt((1750242.2221834254 / (24)) + (1293999.4885403286 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.2742339550729401 = (205898.784131745 - 262363.22204890294) / 205898.784131745 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadMultiSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json40KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 240.3742119505494 > 192.0131885831184.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -147.73040176042488 (T) = (0 -240120.03409105254) / Math.Sqrt((2555784.1858166526 / (24)) + (802414.757364277 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.31786032361038385 = (182204.4641523348 - 240120.03409105254) / 182204.4641523348 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: Json4KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 30.59907145996094 > 25.58570496630201.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -92.11874539563945 (T) = (0 -30611.020724492053) / Math.Sqrt((16895.41375726315 / (24)) + (61054.46985304174 / (16))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (16) - 2, .025) and -0.25363176245536384 = (24417.87264909218 - 30611.020724492053) / 24417.87264909218 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: Json40KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 260.58959805555554 > 216.420940917769.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -171.22468779454692 (T) = (0 -261670.7544940476) / Math.Sqrt((810749.5260212723 / (24)) + (1227222.4742456437 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.27066756951559257 = (205931.7171318085 - 261670.7544940476) / 205931.7171318085 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: False, TestCase: Json4KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.719229782359676 > 22.009709317090806.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -181.948479191601 (T) = (0 -26887.28673816495) / Math.Sqrt((5273.862659114044 / (24)) + (14699.1168123582 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.2867386131796913 = (20895.68655418144 - 26887.28673816495) / 20895.68655418144 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: DeepTree)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 14.30588285932722 > 12.274960229374305.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -121.53617019502117 (T) = (0 -14379.19323559201) / Math.Sqrt((4571.418228489151 / (24)) + (5311.737863488409 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.2338833478535923 = (11653.608309574325 - 14379.19323559201) / 11653.608309574325 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: DeepTree)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.485226186687882 > 10.210761103842128.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -138.76027364206553 (T) = (0 -12423.499821410936) / Math.Sqrt((3711.7134349744756 / (24)) + (3796.7365174849906 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.2773861670032583 = (9725.719709769839 - 12423.499821410936) / 9725.719709769839 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json40KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 212.92408254504502 > 161.8923393930744.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -179.02006125092328 (T) = (0 -211126.45231070355) / Math.Sqrt((1120139.8333001586 / (24)) + (978952.2063514418 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.37700736719421823 = (153322.6744755139 - 211126.45231070355) / 153322.6744755139 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: True, TestCase: Json40KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 248.3846219951923 > 196.9565219666435.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -211.9621114817363 (T) = (0 -246982.08797773445) / Math.Sqrt((748828.4423288408 / (24)) + (810431.001949554 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.31756309361459983 = (187453.70842178367 - 246982.08797773445) / 187453.70842178367 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: False, TestCase: Json4KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.078647735821768 > 22.217003933789478.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -153.28931348585203 (T) = (0 -27062.51364669351) / Math.Sqrt((21665.002663252308 / (24)) + (11252.410413300808 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.28874500308227646 = (20999.122077655713 - 27062.51364669351) / 20999.122077655713 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json4KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.869462165021154 > 16.58171511120468.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -197.5180193852366 (T) = (0 -21951.207741835668) / Math.Sqrt((14002.876324772784 / (24)) + (7153.09329703438 / (18))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (18) - 2, .025) and -0.3923798814271894 = (15765.243404217877 - 21951.207741835668) / 15765.243404217877 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: Json4KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.01891381118881 > 16.44459091573278.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -218.16521060518744 (T) = (0 -21841.272529680195) / Math.Sqrt((7361.393225924889 / (24)) + (8673.147095489783 / (17))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (17) - 2, .025) and -0.3995653319621935 = (15605.754180162983 - 21841.272529680195) / 15605.754180162983 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadSingleSpanSequenceEmptyLoop(IsDataCompact: True, TestCase: Json400B)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.753506584279967 > 2.199006918400631.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -163.21756059064887 (T) = (0 -2771.3130569841323) / Math.Sqrt((115.26575772453633 / (24)) + (216.57927224993173 / (18))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (18) - 2, .025) and -0.318652381485294 = (2101.6251863607913 - 2771.3130569841323) / 2101.6251863607913 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.Json.Tests.Perf_Reader.ReadReturnBytes(IsDataCompact: False, TestCase: Json40KB)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 299.46097355121293 > 253.28215442567566.
IsChangePoint: Marked as a change because one of 1/5/2023 4:05:11 PM, 3/8/2023 10:34:21 AM, 3/14/2023 1:07:29 AM falls between 3/5/2023 5:11:19 AM and 3/14/2023 1:07:29 AM.
IsRegressionStdDev: Marked as regression because -148.98461040683847 (T) = (0 -299525.7257645236) / Math.Sqrt((1035461.4609866597 / (23)) + (1845738.229716035 / (17))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (17) - 2, .025) and -0.24213782592517896 = (241137.27117313127 - 299525.7257645236) / 241137.27117313127 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Text.Json.Tests.Perf_Reader
Test Report
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
Baseline
Compare
Repro Steps
Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
runtime/artifactsor build instructions: Libraries README args:-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release, build instructions: CoreCLR README args:-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0runtime/artifacts/bin/mono/$RunOS.$RunArch.Release, build instructions: MONO README args:-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=falseLinux
Windows
Details
Payloads
Baseline
Compare
Histogram
System.Text.Json.Tests.Perf_Reader.ReadSpanEmptyLoop(IsDataCompact: True, TestCase: Json400B)
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository