Skip to content

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests #81228

Description

@performanceautofiler

Run Information

Architecture arm64
OS ubuntu 20.04
Baseline 7568ca398689b60841a9753f2777e5b3407a6d45
Compare 64f7fab10afa8dc7fca817a554070607648eae38
Diff Diff

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
FormatterInt32 - Duration of single invocation 1.83 ns 4.71 ns 2.58 0.54 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'
Details

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)


Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.705460713835775 > 1.9172362760235513.
IsChangePoint: Marked as a change because one of 1/21/2023 1:51:00 AM, 1/25/2023 11:59:01 PM falls between 1/17/2023 11:08:46 AM and 1/25/2023 11:59:01 PM.
IsRegressionStdDev: Marked as regression because -17.948001637125667 (T) = (0 -5.15830760168831) / Math.Sqrt((0.4702231425596768 / (26)) + (0.08762632214038191 / (17))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (17) - 2, .025) and -1.1296012944001799 = (2.422194058226843 - 5.15830760168831) / 2.422194058226843 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions