[Perf] Linux/arm64: 5 Regressions on 11/19/2022 1:29:52 AM

### Run Information

Architecture | arm64
-- | --
OS | ubuntu 20.04
Baseline | [48e43bf4150a20e55562d004b30c8209f7a9ec33](https://github.com/dotnet/runtime/commit/48e43bf4150a20e55562d004b30c8209f7a9ec33)
Compare | [37cb86cb8238ae2092c63849f21be97de0e62ec5](https://github.com/dotnet/runtime/commit/37cb86cb8238ae2092c63849f21be97de0e62ec5)
Diff | [Diff](https://github.com/dotnet/runtime/compare/48e43bf4150a20e55562d004b30c8209f7a9ec33...37cb86cb8238ae2092c63849f21be97de0e62ec5)


### Regressions in System.Reflection.Invoke

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Field_Set_class - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Reflection.Invoke.Field_Set_class.html>) | 4.80 μs | 5.33 μs | 1.11 | 0.08 | False | | |
[StaticMethod5_ByRefParams_int_string_struct_class_bool - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Reflection.Invoke.StaticMethod5_ByRefParams_int_string_struct_class_bool.html>) | 6.05 μs | 14.94 μs | 2.47 | 0.17 | False | | |
[StaticMethod4_ByRefParams_int_string_struct_class - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.Reflection.Invoke.StaticMethod4_ByRefParams_int_string_struct_class.html>) | 4.95 μs | 11.29 μs | 2.28 | 0.19 | False | | |

[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/11_22_2022/refs/heads/main_arm64_ubuntu%2020.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_Regression/System.Reflection.Invoke.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Reflection.Invoke*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-90efd258-5969-4848-ba85-a046a8f9a57e2797e799d8344d680/c65459d8-1962-44ae-a159-61daec92b6c9.zip?sv=2021-08-06&se=2022-12-17T03%3A22%3A06Z&sr=c&sp=rl&sig=zjl7xR4QD%2Fbj2jQm8rjuvsUv3mX07lHsVjNRe5rjKOw%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b9508483-5dd5-4293-9a22-c66e03b3981701012a93cfb49cbb8/34cd4f9e-c115-47fb-900b-231f7bcf3021.zip?sv=2021-08-06&se=2022-12-20T03%3A13%3A45Z&sr=c&sp=rl&sig=sNyG%2BfUY%2FSTk0KbKfxurX5Jh0PQLEmbH8dOBdYB2GFs%3D>)
### Histogram

#### System.Reflection.Invoke.Field_Set_class

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 11/18/2022 1:00:00 AM, 11/22/2022 2:20:42 AM falls between 11/9/2022 1:30:37 AM and 11/22/2022 2:20:42 AM.
IsRegressionStdDev: Marked as regression because -10.181530730409367 (T) = (0 -5279.481265798611) / Math.Sqrt((7233.163601019925 / (5)) + (4410.937777990209 / (2))) is less than -2.5705818356363865 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (2) - 2, .025) and -0.1319194293265296 = (4664.184684010417 - 5279.481265798611) / 4664.184684010417 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Invoke.StaticMethod5_ByRefParams_int_string_struct_class_bool

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 11/18/2022 1:00:00 AM, 11/22/2022 2:20:42 AM falls between 11/9/2022 1:30:37 AM and 11/22/2022 2:20:42 AM.
IsRegressionStdDev: Marked as regression because -34.38717407586459 (T) = (0 -14695.254322395835) / Math.Sqrt((19536.08157285345 / (5)) + (121398.77080438496 / (2))) is less than -2.5705818356363865 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (2) - 2, .025) and -1.4678075570923108 = (5954.781311923077 - 14695.254322395835) / 5954.781311923077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Invoke.StaticMethod4_ByRefParams_int_string_struct_class

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 11/18/2022 1:00:00 AM, 11/22/2022 2:20:42 AM falls between 11/9/2022 1:30:37 AM and 11/22/2022 2:20:42 AM.
IsRegressionStdDev: Marked as regression because -30.091556598251106 (T) = (0 -11502.210704166668) / Math.Sqrt((14395.819832769 / (5)) + (91706.34911786647 / (2))) is less than -2.5705818356363865 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (2) - 2, .025) and -1.3670126987177893 = (4859.378536666666 - 11502.210704166668) / 4859.378536666666 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>
### Run Information

Architecture | arm64
-- | --
OS | ubuntu 20.04
Baseline | [48e43bf4150a20e55562d004b30c8209f7a9ec33](https://github.com/dotnet/runtime/commit/48e43bf4150a20e55562d004b30c8209f7a9ec33)
Compare | [37cb86cb8238ae2092c63849f21be97de0e62ec5](https://github.com/dotnet/runtime/commit/37cb86cb8238ae2092c63849f21be97de0e62ec5)
Diff | [Diff](https://github.com/dotnet/runtime/compare/48e43bf4150a20e55562d004b30c8209f7a9ec33...37cb86cb8238ae2092c63849f21be97de0e62ec5)


### Regressions in System.MathBenchmarks.Single

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[ScaleB - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/System.MathBenchmarks.Single.ScaleB.html>) | 76.91 μs | 85.25 μs | 1.11 | 0.14 | False | | |

[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/11_22_2022/refs/heads/main_arm64_ubuntu%2020.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_Regression/System.MathBenchmarks.Single.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.MathBenchmarks.Single*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-90efd258-5969-4848-ba85-a046a8f9a57e2797e799d8344d680/c65459d8-1962-44ae-a159-61daec92b6c9.zip?sv=2021-08-06&se=2022-12-17T03%3A22%3A06Z&sr=c&sp=rl&sig=zjl7xR4QD%2Fbj2jQm8rjuvsUv3mX07lHsVjNRe5rjKOw%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b9508483-5dd5-4293-9a22-c66e03b3981701012a93cfb49cbb8/34cd4f9e-c115-47fb-900b-231f7bcf3021.zip?sv=2021-08-06&se=2022-12-20T03%3A13%3A45Z&sr=c&sp=rl&sig=sNyG%2BfUY%2FSTk0KbKfxurX5Jh0PQLEmbH8dOBdYB2GFs%3D>)
### Histogram

#### System.MathBenchmarks.Single.ScaleB

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 11/18/2022 1:00:00 AM, 11/22/2022 2:20:42 AM falls between 11/9/2022 1:30:37 AM and 11/22/2022 2:20:42 AM.
IsRegressionStdDev: Marked as regression because -5.433745179419562 (T) = (0 -85249.2920339971) / Math.Sqrt((6241273.25867771 / (5)) + (9.703684135494967 / (2))) is less than -2.5705818356363865 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (2) - 2, .025) and -0.07667343594995035 = (79178.41119464561 - 85249.2920339971) / 79178.41119464561 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


### Run Information

Architecture | arm64
-- | --
OS | ubuntu 20.04
Baseline | [48e43bf4150a20e55562d004b30c8209f7a9ec33](https://github.com/dotnet/runtime/commit/48e43bf4150a20e55562d004b30c8209f7a9ec33)
Compare | [37cb86cb8238ae2092c63849f21be97de0e62ec5](https://github.com/dotnet/runtime/commit/37cb86cb8238ae2092c63849f21be97de0e62ec5)
Diff | [Diff](https://github.com/dotnet/runtime/compare/48e43bf4150a20e55562d004b30c8209f7a9ec33...37cb86cb8238ae2092c63849f21be97de0e62ec5)


### Regressions in MicroBenchmarks.Serializers.Xml_ToStream&lt;XmlElement&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[XmlSerializer_ - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 20.04_LLVM=false_MonoAOT=false_MonoInterpreter=true/MicroBenchmarks.Serializers.Xml_ToStream(XmlElement).XmlSerializer_.html>) | 13.96 μs | 15.61 μs | 1.12 | 0.12 | False | | |

[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/11_22_2022/refs/heads/main_arm64_ubuntu%2020.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_Regression/MicroBenchmarks.Serializers.Xml_ToStream(XmlElement).html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;XmlElement&gt;*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-90efd258-5969-4848-ba85-a046a8f9a57e2797e799d8344d680/c65459d8-1962-44ae-a159-61daec92b6c9.zip?sv=2021-08-06&se=2022-12-17T03%3A22%3A06Z&sr=c&sp=rl&sig=zjl7xR4QD%2Fbj2jQm8rjuvsUv3mX07lHsVjNRe5rjKOw%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b9508483-5dd5-4293-9a22-c66e03b3981701012a93cfb49cbb8/34cd4f9e-c115-47fb-900b-231f7bcf3021.zip?sv=2021-08-06&se=2022-12-20T03%3A13%3A45Z&sr=c&sp=rl&sig=sNyG%2BfUY%2FSTk0KbKfxurX5Jh0PQLEmbH8dOBdYB2GFs%3D>)
### Histogram

#### MicroBenchmarks.Serializers.Xml_ToStream&lt;XmlElement&gt;.XmlSerializer_

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 11/18/2022 1:00:00 AM, 11/22/2022 2:20:42 AM falls between 11/9/2022 1:30:37 AM and 11/22/2022 2:20:42 AM.
IsRegressionStdDev: Marked as regression because -4.099984139998777 (T) = (0 -15231.129680409955) / Math.Sqrt((59033.6126875075 / (5)) + (281946.83681851707 / (2))) is less than -2.5705818356363865 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (2) - 2, .025) and -0.11758867791393213 = (13628.564767531527 - 15231.129680409955) / 13628.564767531527 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>




Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Perf] Linux/arm64: 5 Regressions on 11/19/2022 1:29:52 AM #78822

Run Information

Regressions in System.Reflection.Invoke

Repro

Payloads

Histogram

System.Reflection.Invoke.Field_Set_class

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Regressions in System.MathBenchmarks.Single

Repro

Payloads

Histogram

System.MathBenchmarks.Single.ScaleB

Description of detection logic

Docs

Run Information

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>

Repro

Payloads

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>.XmlSerializer_

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Fields

Projects

Milestone

Relationships

Development

Architecture	arm64
OS	ubuntu 20.04
Baseline	48e43bf4150a20e55562d004b30c8209f7a9ec33
Compare	37cb86cb8238ae2092c63849f21be97de0e62ec5
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Field_Set_class - Duration of single invocation	4.80 μs	5.33 μs	1.11	0.08	False
StaticMethod5_ByRefParams_int_string_struct_class_bool - Duration of single invocation	6.05 μs	14.94 μs	2.47	0.17	False
StaticMethod4_ByRefParams_int_string_struct_class - Duration of single invocation	4.95 μs	11.29 μs	2.28	0.19	False

Uh oh!

[Perf] Linux/arm64: 5 Regressions on 11/19/2022 1:29:52 AM #78822

Description

Run Information

Regressions in System.Reflection.Invoke

Repro

Payloads

Histogram

System.Reflection.Invoke.Field_Set_class

Description of detection logic

Description of detection logic

Description of detection logic

Docs

Regressions in System.MathBenchmarks.Single

Repro

Payloads

Histogram

System.MathBenchmarks.Single.ScaleB

Description of detection logic

Docs

Run Information

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>

Repro

Payloads

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>.XmlSerializer_

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Fields

Projects

Milestone

Relationships

Development

Issue actions