Regressions in ConcurrentDictionary

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SelectToArray - Duration of single invocation	275.27 ns	305.58 ns	1.11	0.03	False				Trace	Trace
SelectToArray - Duration of single invocation	473.53 ns	535.12 ns	1.13	0.08	False				Trace	Trace

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Details

Payloads

Baseline
Compare

Histogram

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Array)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 305.5794906795206 > 289.23635689963385.
IsChangePoint: Marked as a change because one of 12/10/2022 11:25:25 PM, 12/17/2022 10:44:50 PM, 12/21/2022 9:23:17 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -86.58711038721272 (T) = (0 -307.2820055929849) / Math.Sqrt((2.143934505340105 / (39)) + (1.525019768723927 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.11191851528207822 = (276.35298933306433 - 307.2820055929849) / 276.35298933306433 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```### Baseline Jit Disasm

```assembly
; System.Linq.Tests.Perf_Enumerable.SelectToArray(System.Linq.Tests.LinqTestData)
       push      rdi
       push      rsi
       sub       rsp,28
       mov       rsi,[rdx+8]
       mov       rcx,23B9A407250
       mov       rdx,[rcx]
       test      rdx,rdx
       jne       short M00_L00
       mov       rcx,offset MT_System.Func`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rdi,rax
       mov       rdx,23B9A4071B0
       mov       rdx,[rdx]
       lea       rcx,[rdi+8]
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,7FF8AFFCAF30
       mov       [rdi+18],rdx
       mov       rcx,23B9A407250
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,rdi
M00_L00:
       mov       rcx,rsi
       call      qword ptr [7FF8AFFCD000]; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       mov       rcx,rax
       add       rsp,28
       pop       rsi
       pop       rdi
       jmp       qword ptr [7FF8AFE63510]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
; Total bytes of code 127

; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       xor       eax,eax
       mov       [rsp+20],rax
       mov       rsi,rcx
       mov       rdi,rdx
       test      rsi,rsi
       je        near ptr M01_L07
       test      rdi,rdi
       je        near ptr M01_L08
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        short M01_L00
       mov       rcx,rbx
       mov       rdx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       mov       r8,offset MD_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]].Select[[System.Int32, System.Private.CoreLib]](System.Func`2<Int32,Int32>)
       call      CORINFO_HELP_VIRTUAL_FUNC_PTR
       mov       rcx,rbx
       mov       rdx,rdi
       call      rax
       jmp       near ptr M01_L06
M01_L00:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        near ptr M01_L04
       mov       rdx,rsi
       mov       rcx,offset MT_System.Int32[]
       call      qword ptr [7FF8AFA5D7F8]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfAny(Void*, System.Object)
       mov       rbp,rax
       test      rbp,rbp
       je        short M01_L02
       cmp       dword ptr [rbp+8],0
       je        short M01_L01
       mov       rcx,offset MT_System.Linq.Enumerable+SelectArrayIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbp
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       near ptr M01_L06
M01_L01:
       mov       rcx,7FF8AFCA7C08
       mov       edx,4
       call      CORINFO_HELP_CLASSINIT_SHARED_DYNAMICCLASS
       mov       rdx,23B9A401F48
       mov       rax,[rdx]
       jmp       near ptr M01_L06
M01_L02:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.List`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rsi,rax
       test      rsi,rsi
       je        short M01_L03
       mov       rcx,offset MT_System.Linq.Enumerable+SelectListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
       jmp       near ptr M01_L06
M01_L03:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectIListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbx
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       short M01_L06
M01_L04:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       je        short M01_L05
       xor       r8d,r8d
       mov       [rsp+20],r8
       lea       r8,[rsp+20]
       mov       rcx,rdi
       mov       rdx,rax
       call      qword ptr [7FF8AFFCD0D8]
       cmp       qword ptr [rsp+20],0
       je        short M01_L05
       mov       rax,[rsp+20]
       jmp       short M01_L06
M01_L05:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectEnumerableIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
M01_L06:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
M01_L07:
       mov       ecx,10
       call      qword ptr [7FF8AFDD1798]
       int       3
M01_L08:
       mov       ecx,0F
       call      qword ptr [7FF8AFDD1798]
       int       3
; Total bytes of code 557

; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
       push      rsi
       sub       rsp,20
       mov       rsi,rcx
       test      rsi,rsi
       je        short M02_L01
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       jne       short M02_L00
       mov       rcx,rsi
       add       rsp,20
       pop       rsi
       jmp       qword ptr [7FF8AFE63E28]
M02_L00:
       mov       rcx,rax
       mov       r11,7FF8AF8B0598
       add       rsp,20
       pop       rsi
       jmp       qword ptr [r11]
M02_L01:
       mov       ecx,10
       call      qword ptr [7FF8AFDD1798]
       int       3
; Total bytes of code 84

Compare Jit Disasm

; System.Linq.Tests.Perf_Enumerable.SelectToArray(System.Linq.Tests.LinqTestData)
       push      rdi
       push      rsi
       sub       rsp,28
       mov       rsi,[rdx+8]
       mov       rcx,15241807250
       mov       rdx,[rcx]
       test      rdx,rdx
       jne       short M00_L00
       mov       rcx,offset MT_System.Func`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rdi,rax
       mov       rdx,152418071B0
       mov       rdx,[rdx]
       lea       rcx,[rdi+8]
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,7FFA0D18AF30
       mov       [rdi+18],rdx
       mov       rcx,15241807250
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,rdi
M00_L00:
       mov       rcx,rsi
       call      qword ptr [7FFA0D18D000]; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       mov       rcx,rax
       add       rsp,28
       pop       rsi
       pop       rdi
       jmp       qword ptr [7FFA0D023510]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
; Total bytes of code 127

; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       xor       eax,eax
       mov       [rsp+20],rax
       mov       rsi,rcx
       mov       rdi,rdx
       test      rsi,rsi
       je        near ptr M01_L07
       test      rdi,rdi
       je        near ptr M01_L08
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        short M01_L00
       mov       rcx,rbx
       mov       rdx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       mov       r8,offset MD_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]].Select[[System.Int32, System.Private.CoreLib]](System.Func`2<Int32,Int32>)
       call      CORINFO_HELP_VIRTUAL_FUNC_PTR
       mov       rcx,rbx
       mov       rdx,rdi
       call      rax
       jmp       near ptr M01_L06
M01_L00:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        near ptr M01_L04
       mov       rdx,rsi
       mov       rcx,offset MT_System.Int32[]
       call      qword ptr [7FFA0CC1D7F8]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfAny(Void*, System.Object)
       mov       rbp,rax
       test      rbp,rbp
       je        short M01_L02
       cmp       dword ptr [rbp+8],0
       je        short M01_L01
       mov       rcx,offset MT_System.Linq.Enumerable+SelectArrayIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbp
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       near ptr M01_L06
M01_L01:
       mov       rcx,7FFA0CE68118
       mov       edx,4
       call      CORINFO_HELP_CLASSINIT_SHARED_DYNAMICCLASS
       mov       rdx,15241801F58
       mov       rax,[rdx]
       jmp       near ptr M01_L06
M01_L02:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.List`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rsi,rax
       test      rsi,rsi
       je        short M01_L03
       mov       rcx,offset MT_System.Linq.Enumerable+SelectListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
       jmp       near ptr M01_L06
M01_L03:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectIListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbx
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       short M01_L06
M01_L04:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       je        short M01_L05
       xor       r8d,r8d
       mov       [rsp+20],r8
       lea       r8,[rsp+20]
       mov       rcx,rdi
       mov       rdx,rax
       call      qword ptr [7FFA0D18D0D8]
       cmp       qword ptr [rsp+20],0
       je        short M01_L05
       mov       rax,[rsp+20]
       jmp       short M01_L06
M01_L05:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectEnumerableIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
M01_L06:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
M01_L07:
       mov       ecx,10
       call      qword ptr [7FFA0CF91798]
       int       3
M01_L08:
       mov       ecx,0F
       call      qword ptr [7FFA0CF91798]
       int       3
; Total bytes of code 557

; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
       push      rsi
       sub       rsp,20
       mov       rsi,rcx
       test      rsi,rsi
       je        short M02_L01
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       jne       short M02_L00
       mov       rcx,rsi
       add       rsp,20
       pop       rsi
       jmp       qword ptr [7FFA0D023E28]
M02_L00:
       mov       rcx,rax
       mov       r11,7FFA0CA705A0
       add       rsp,20
       pop       rsi
       jmp       qword ptr [r11]
M02_L01:
       mov       ecx,10
       call      qword ptr [7FFA0CF91798]
       int       3
; Total bytes of code 84

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: IList)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 535.1167007579127 > 497.9497986035288.
IsChangePoint: Marked as a change because one of 12/10/2022 11:25:25 PM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -51.90095249357905 (T) = (0 -532.1641996998612) / Math.Sqrt((36.43729423330508 / (39)) + (7.140647846614348 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.12371590189233013 = (473.57539285837305 - 532.1641996998612) / 473.57539285837305 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```### Baseline Jit Disasm

```assembly
; System.Linq.Tests.Perf_Enumerable.SelectToArray(System.Linq.Tests.LinqTestData)
       push      rdi
       push      rsi
       sub       rsp,28
       mov       rsi,[rdx+8]
       mov       rcx,29762407250
       mov       rdx,[rcx]
       test      rdx,rdx
       jne       short M00_L00
       mov       rcx,offset MT_System.Func`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rdi,rax
       mov       rdx,297624071B0
       mov       rdx,[rdx]
       lea       rcx,[rdi+8]
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,7FF8AFFBC1F8
       mov       [rdi+18],rdx
       mov       rcx,29762407250
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,rdi
M00_L00:
       mov       rcx,rsi
       call      qword ptr [7FF8AFFBD2B8]; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       mov       rcx,rax
       add       rsp,28
       pop       rsi
       pop       rdi
       jmp       qword ptr [7FF8AFE53510]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
; Total bytes of code 127

; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       xor       eax,eax
       mov       [rsp+20],rax
       mov       rsi,rcx
       mov       rdi,rdx
       test      rsi,rsi
       je        near ptr M01_L07
       test      rdi,rdi
       je        near ptr M01_L08
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        short M01_L00
       mov       rcx,rbx
       mov       rdx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       mov       r8,offset MD_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]].Select[[System.Int32, System.Private.CoreLib]](System.Func`2<Int32,Int32>)
       call      CORINFO_HELP_VIRTUAL_FUNC_PTR
       mov       rcx,rbx
       mov       rdx,rdi
       call      rax
       jmp       near ptr M01_L06
M01_L00:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        near ptr M01_L04
       mov       rdx,rsi
       mov       rcx,offset MT_System.Int32[]
       call      qword ptr [7FF8AFA4D7F8]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfAny(Void*, System.Object)
       mov       rbp,rax
       test      rbp,rbp
       je        short M01_L02
       cmp       dword ptr [rbp+8],0
       je        short M01_L01
       mov       rcx,offset MT_System.Linq.Enumerable+SelectArrayIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbp
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       near ptr M01_L06
M01_L01:
       mov       rcx,7FF8AFC97C08
       mov       edx,4
       call      CORINFO_HELP_CLASSINIT_SHARED_DYNAMICCLASS
       mov       rdx,29762401F50
       mov       rax,[rdx]
       jmp       near ptr M01_L06
M01_L02:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.List`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rsi,rax
       test      rsi,rsi
       je        short M01_L03
       mov       rcx,offset MT_System.Linq.Enumerable+SelectListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
       jmp       near ptr M01_L06
M01_L03:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectIListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbx
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       short M01_L06
M01_L04:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       je        short M01_L05
       xor       r8d,r8d
       mov       [rsp+20],r8
       lea       r8,[rsp+20]
       mov       rcx,rdi
       mov       rdx,rax
       call      qword ptr [7FF8AFFBD390]
       cmp       qword ptr [rsp+20],0
       je        short M01_L05
       mov       rax,[rsp+20]
       jmp       short M01_L06
M01_L05:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectEnumerableIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
M01_L06:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
M01_L07:
       mov       ecx,10
       call      qword ptr [7FF8AFDC1798]
       int       3
M01_L08:
       mov       ecx,0F
       call      qword ptr [7FF8AFDC1798]
       int       3
; Total bytes of code 557

; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
       push      rsi
       sub       rsp,20
       mov       rsi,rcx
       test      rsi,rsi
       je        short M02_L01
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       jne       short M02_L00
       mov       rcx,rsi
       add       rsp,20
       pop       rsi
       jmp       qword ptr [7FF8AFE53E28]
M02_L00:
       mov       rcx,rax
       mov       r11,7FF8AF8A05A8
       add       rsp,20
       pop       rsi
       jmp       qword ptr [r11]
M02_L01:
       mov       ecx,10
       call      qword ptr [7FF8AFDC1798]
       int       3
; Total bytes of code 84

Compare Jit Disasm

; System.Linq.Tests.Perf_Enumerable.SelectToArray(System.Linq.Tests.LinqTestData)
       push      rdi
       push      rsi
       sub       rsp,28
       mov       rsi,[rdx+8]
       mov       rcx,21DC6007250
       mov       rdx,[rcx]
       test      rdx,rdx
       jne       short M00_L00
       mov       rcx,offset MT_System.Func`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rdi,rax
       mov       rdx,21DC60071B0
       mov       rdx,[rdx]
       lea       rcx,[rdi+8]
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,7FFA0D18C1F8
       mov       [rdi+18],rdx
       mov       rcx,21DC6007250
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,rdi
M00_L00:
       mov       rcx,rsi
       call      qword ptr [7FFA0D18D2B8]; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       mov       rcx,rax
       add       rsp,28
       pop       rsi
       pop       rdi
       jmp       qword ptr [7FFA0D023510]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
; Total bytes of code 127

; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       xor       eax,eax
       mov       [rsp+20],rax
       mov       rsi,rcx
       mov       rdi,rdx
       test      rsi,rsi
       je        near ptr M01_L07
       test      rdi,rdi
       je        near ptr M01_L08
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        short M01_L00
       mov       rcx,rbx
       mov       rdx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       mov       r8,offset MD_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]].Select[[System.Int32, System.Private.CoreLib]](System.Func`2<Int32,Int32>)
       call      CORINFO_HELP_VIRTUAL_FUNC_PTR
       mov       rcx,rbx
       mov       rdx,rdi
       call      rax
       jmp       near ptr M01_L06
M01_L00:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        near ptr M01_L04
       mov       rdx,rsi
       mov       rcx,offset MT_System.Int32[]
       call      qword ptr [7FFA0CC1D7F8]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfAny(Void*, System.Object)
       mov       rbp,rax
       test      rbp,rbp
       je        short M01_L02
       cmp       dword ptr [rbp+8],0
       je        short M01_L01
       mov       rcx,offset MT_System.Linq.Enumerable+SelectArrayIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbp
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       near ptr M01_L06
M01_L01:
       mov       rcx,7FFA0CE68118
       mov       edx,4
       call      CORINFO_HELP_CLASSINIT_SHARED_DYNAMICCLASS
       mov       rdx,21DC6001F60
       mov       rax,[rdx]
       jmp       near ptr M01_L06
M01_L02:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.List`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rsi,rax
       test      rsi,rsi
       je        short M01_L03
       mov       rcx,offset MT_System.Linq.Enumerable+SelectListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
       jmp       near ptr M01_L06
M01_L03:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectIListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbx
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       short M01_L06
M01_L04:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       je        short M01_L05
       xor       r8d,r8d
       mov       [rsp+20],r8
       lea       r8,[rsp+20]
       mov       rcx,rdi
       mov       rdx,rax
       call      qword ptr [7FFA0D18D390]
       cmp       qword ptr [rsp+20],0
       je        short M01_L05
       mov       rax,[rsp+20]
       jmp       short M01_L06
M01_L05:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectEnumerableIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
M01_L06:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
M01_L07:
       mov       ecx,10
       call      qword ptr [7FFA0CF91798]
       int       3
M01_L08:
       mov       ecx,0F
       call      qword ptr [7FFA0CF91798]
       int       3
; Total bytes of code 557

; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
       push      rsi
       sub       rsp,20
       mov       rsi,rcx
       test      rsi,rsi
       je        short M02_L01
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       jne       short M02_L00
       mov       rcx,rsi
       add       rsp,20
       pop       rsi
       jmp       qword ptr [7FFA0D023E28]
M02_L00:
       mov       rcx,rax
       mov       r11,7FFA0CA705B0
       add       rsp,20
       pop       rsi
       jmp       qword ptr [r11]
M02_L01:
       mov       ecx,10
       call      qword ptr [7FFA0CF91798]
       int       3
; Total bytes of code 84

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.CtorGivenSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConcurrentDictionary - Duration of single invocation	226.35 ns	245.03 ns	1.08	0.05	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorGivenSize<String>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.CtorGivenSize<String>.ConcurrentDictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 245.03246665337477 > 232.6650881757695.
IsChangePoint: Marked as a change because one of 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -24.56781586341177 (T) = (0 -242.50366940405826) / Math.Sqrt((10.431615517322415 / (40)) + (7.943101980711896 / (21))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (21) - 2, .025) and -0.08812271493748952 = (222.86426528462795 - 242.50366940405826) / 222.86426528462795 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.IterateFor<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableList - Duration of single invocation	14.91 μs	15.90 μs	1.07	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateFor<String>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.IterateFor<String>.ImmutableList(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.902512533291555 > 15.664715177480232.
IsChangePoint: Marked as a change because one of 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -34.02879577224974 (T) = (0 -16415.825859214612) / Math.Sqrt((1699.8626873477351 / (40)) + (38761.785851854846 / (21))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (21) - 2, .025) and -0.0989953318849595 = (14937.120643687125 - 16415.825859214612) / 14937.120643687125 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.TryAddDefaultSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConcurrentDictionary - Duration of single invocation	63.79 μs	79.10 μs	1.24	0.01	False
Dictionary - Duration of single invocation	8.62 μs	9.06 μs	1.05	0.10	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddDefaultSize<Int32>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 79.09749365482233 > 66.92382576196857.
IsChangePoint: Marked as a change because one of 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -120.91489896950517 (T) = (0 -79108.7515492921) / Math.Sqrt((164766.28390214598 / (40)) + (254571.07271373607 / (21))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (21) - 2, .025) and -0.2419140462473129 = (63699.05533183614 - 79108.7515492921) / 63699.05533183614 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.TryAddDefaultSize<Int32>.Dictionary(Count: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.058340383119408 > 8.915567841493628.
IsChangePoint: Marked as a change because one of 12/28/2022 7:19:51 AM, 1/5/2023 12:24:13 PM, 2/9/2023 4:10:34 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -13.718523841981185 (T) = (0 -9630.15318343178) / Math.Sqrt((10342.398999909683 / (40)) + (132238.30280433354 / (20))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (20) - 2, .025) and -0.13388662883343178 = (8493.047663274325 - 9630.15318343178) / 8493.047663274325 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Memory.Span<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IndexOfAnyFourValues - Duration of single invocation	817.05 ns	893.98 ns	1.09	0.04	False
LastIndexOfValue - Duration of single invocation	21.97 ns	25.03 ns	1.14	0.13	False
IndexOfAnyFiveValues - Duration of single invocation	853.16 ns	927.98 ns	1.09	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Int32>*'

Details

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 893.975439251263 > 853.3832882470755.
IsChangePoint: Marked as a change because one of 12/12/2022 5:25:39 PM, 1/3/2023 6:29:42 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -259.64989919224575 (T) = (0 -894.8305196934527) / Math.Sqrt((2.9215307368132755 / (39)) + (0.47957722164571015 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.09977084111635842 = (813.6517956642001 - 894.8305196934527) / 813.6517956642001 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span<Int32>.LastIndexOfValue(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.025132586078545 > 23.029765598699544.
IsChangePoint: Marked as a change because one of 1/21/2023 8:50:04 PM, 2/7/2023 8:22:47 AM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -12.949049282965648 (T) = (0 -24.505882652508827) / Math.Sqrt((0.734070886935428 / (30)) + (0.2481902151182483 / (31))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (31) - 2, .025) and -0.10524508233237594 = (22.172351674973815 - 24.505882652508827) / 22.172351674973815 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span<Int32>.IndexOfAnyFiveValues(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 927.9838972023423 > 902.4506253596588.
IsChangePoint: Marked as a change because one of 12/12/2022 5:25:39 PM, 1/3/2023 6:29:42 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -22.054939484533296 (T) = (0 -930.7510896550991) / Math.Sqrt((256.25566032590433 / (39)) + (101.99384285282363 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.08707807365210259 = (856.1952560851367 - 930.7510896550991) / 856.1952560851367 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.ContainsFalse<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableArray - Duration of single invocation	845.20 μs	1.00 ms	1.19	0.09	False
List - Duration of single invocation	850.75 μs	921.24 μs	1.08	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse<String>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsFalse<String>.ImmutableArray(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.0038663020833334 > 886.640908717105.
IsChangePoint: Marked as a change because one of 1/3/2023 6:29:42 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -11.34207234494535 (T) = (0 -934802.4530926154) / Math.Sqrt((675243559.6818234 / (39)) + (853829052.4572437 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.10178410215579729 = (848444.3106989304 - 934802.4530926154) / 848444.3106989304 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.ContainsFalse<String>.List(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 921.2402450980393 > 892.1825131578946.
IsChangePoint: Marked as a change because one of 12/14/2022 9:46:59 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -58.871587236443006 (T) = (0 -918981.4916614792) / Math.Sqrt((40795262.05757142 / (39)) + (7158989.257863471 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.08160077351749383 = (849649.4401283041 - 918981.4916614792) / 849649.4401283041 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.ContainsTrue<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Span - Duration of single invocation	13.52 μs	15.97 μs	1.18	0.33	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue<Int32>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsTrue<Int32>.Span(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.971618950238584 > 14.16530332274639.
IsChangePoint: Marked as a change because one of 1/16/2023 4:36:34 AM, 1/29/2023 12:56:15 AM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -13.411199749180424 (T) = (0 -16566.369950513606) / Math.Sqrt((1233353.612775536 / (40)) + (49293.35009834437 / (21))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (21) - 2, .025) and -0.17297096421239003 = (14123.427140106029 - 16566.369950513606) / 14123.427140106029 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in PerfLabTests.LowLevelPerf

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
InterfaceInterfaceMethod - Duration of single invocation	3.27 ms	3.59 ms	1.10	0.03	False				Trace	Trace

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.LowLevelPerf*'

Details

Payloads

Baseline
Compare

Histogram

PerfLabTests.LowLevelPerf.InterfaceInterfaceMethod

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.5860481666666666 > 3.4378647.
IsChangePoint: Marked as a change because one of 12/14/2022 5:20:21 PM, 12/17/2022 10:44:50 PM, 12/21/2022 9:23:17 AM, 12/28/2022 5:13:50 PM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -285.1114215004119 (T) = (0 -3586591.3926336565) / Math.Sqrt((25946983.671931036 / (39)) + (10896950.186801732 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.09469812689230038 = (3276329.158263478 - 3586591.3926336565) / 3276329.158263478 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```### Baseline Jit Disasm

```assembly
; PerfLabTests.LowLevelPerf.InterfaceInterfaceMethod()
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       mov       rsi,rcx
       mov       rcx,21A440062F8
       mov       rdi,[rcx]
       xor       ebx,ebx
       mov       rbp,7FF90CB02958
       cmp       dword ptr [rbp],0
       jle       near ptr M00_L01
M00_L00:
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FF90CABBB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       inc       ebx
       cmp       ebx,[rbp]
       jl        short M00_L00
M00_L01:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
; Total bytes of code 182

; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       sub       rsp,28
       mov       rcx,rdx
       mov       r11,7FF90C590570
       call      qword ptr [r11]
       nop
       add       rsp,28
       ret
; Total bytes of code 26

Compare Jit Disasm

; PerfLabTests.LowLevelPerf.InterfaceInterfaceMethod()
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       mov       rsi,rcx
       mov       rcx,2EA7C0062F8
       mov       rdi,[rcx]
       xor       ebx,ebx
       mov       rbp,7FFCEA2A2958
       cmp       dword ptr [rbp],0
       jle       near ptr M00_L01
M00_L00:
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       mov       rcx,rsi
       mov       rdx,rdi
       call      qword ptr [7FFCEA25BB58]; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       inc       ebx
       cmp       ebx,[rbp]
       jl        short M00_L00
M00_L01:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
; Total bytes of code 182

; PerfLabTests.LowLevelPerf.CallInterfaceMethod(PerfLabTests.AnInterface)
       sub       rsp,28
       mov       rcx,rdx
       mov       r11,7FFCE9D30578
       call      qword ptr [r11]
       nop
       add       rsp,28
       ret
; Total bytes of code 26

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.CreateAddAndClear<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConcurrentDictionary - Duration of single invocation	76.66 μs	88.56 μs	1.16	0.00	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear<Int32>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 88.56358050847457 > 79.83648200046906.
IsChangePoint: Marked as a change because one of 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -89.79073716613726 (T) = (0 -89081.19955166764) / Math.Sqrt((297868.79186870647 / (39)) + (260341.1768794159 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.16641467179243122 = (76371.8098768223 - 89081.19955166764) / 76371.8098768223 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.IterateFor<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableList - Duration of single invocation	14.22 μs	16.12 μs	1.13	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateFor<Int32>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.IterateFor<Int32>.ImmutableList(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.12028836251287 > 14.940326702729351.
IsChangePoint: Marked as a change because one of 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -101.13766269528195 (T) = (0 -15951.04437215802) / Math.Sqrt((1350.7489216860583 / (39)) + (5232.825320034671 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.11959214042402194 = (14247.192165994393 - 15951.04437215802) / 14247.192165994393 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IterateTryGetTenSegments - Duration of single invocation	43.81 ns	49.75 ns	1.14	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests<Byte>*'

Details

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetTenSegments

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.74658753538523 > 46.15075397683059.
IsChangePoint: Marked as a change because one of 12/6/2022 2:12:43 AM, 12/10/2022 11:25:25 PM, 12/17/2022 10:44:50 PM, 12/21/2022 9:23:17 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -54.3317434647019 (T) = (0 -50.173864843382226) / Math.Sqrt((0.1404087857757956 / (39)) + (0.21569227753374562 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.14617973734765838 = (43.774866374350786 - 50.173864843382226) / 43.774866374350786 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch, @kunalspathak
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SelectToArray - Duration of single invocation	275.27 ns	305.58 ns	1.11	0.03	False				Trace	Trace
SelectToArray - Duration of single invocation	473.53 ns	535.12 ns	1.13	0.08	False				Trace	Trace

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Details

Payloads

Baseline
Compare

Histogram

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Array)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 305.5794906795206 > 289.23635689963385.
IsChangePoint: Marked as a change because one of 12/10/2022 11:25:25 PM, 12/17/2022 10:44:50 PM, 12/21/2022 9:23:17 AM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -86.58711038721272 (T) = (0 -307.2820055929849) / Math.Sqrt((2.143934505340105 / (39)) + (1.525019768723927 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.11191851528207822 = (276.35298933306433 - 307.2820055929849) / 276.35298933306433 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```### Baseline Jit Disasm

```assembly
; System.Linq.Tests.Perf_Enumerable.SelectToArray(System.Linq.Tests.LinqTestData)
       push      rdi
       push      rsi
       sub       rsp,28
       mov       rsi,[rdx+8]
       mov       rcx,23B9A407250
       mov       rdx,[rcx]
       test      rdx,rdx
       jne       short M00_L00
       mov       rcx,offset MT_System.Func`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rdi,rax
       mov       rdx,23B9A4071B0
       mov       rdx,[rdx]
       lea       rcx,[rdi+8]
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,7FF8AFFCAF30
       mov       [rdi+18],rdx
       mov       rcx,23B9A407250
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,rdi
M00_L00:
       mov       rcx,rsi
       call      qword ptr [7FF8AFFCD000]; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       mov       rcx,rax
       add       rsp,28
       pop       rsi
       pop       rdi
       jmp       qword ptr [7FF8AFE63510]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
; Total bytes of code 127

; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       xor       eax,eax
       mov       [rsp+20],rax
       mov       rsi,rcx
       mov       rdi,rdx
       test      rsi,rsi
       je        near ptr M01_L07
       test      rdi,rdi
       je        near ptr M01_L08
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        short M01_L00
       mov       rcx,rbx
       mov       rdx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       mov       r8,offset MD_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]].Select[[System.Int32, System.Private.CoreLib]](System.Func`2<Int32,Int32>)
       call      CORINFO_HELP_VIRTUAL_FUNC_PTR
       mov       rcx,rbx
       mov       rdx,rdi
       call      rax
       jmp       near ptr M01_L06
M01_L00:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        near ptr M01_L04
       mov       rdx,rsi
       mov       rcx,offset MT_System.Int32[]
       call      qword ptr [7FF8AFA5D7F8]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfAny(Void*, System.Object)
       mov       rbp,rax
       test      rbp,rbp
       je        short M01_L02
       cmp       dword ptr [rbp+8],0
       je        short M01_L01
       mov       rcx,offset MT_System.Linq.Enumerable+SelectArrayIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbp
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       near ptr M01_L06
M01_L01:
       mov       rcx,7FF8AFCA7C08
       mov       edx,4
       call      CORINFO_HELP_CLASSINIT_SHARED_DYNAMICCLASS
       mov       rdx,23B9A401F48
       mov       rax,[rdx]
       jmp       near ptr M01_L06
M01_L02:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.List`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rsi,rax
       test      rsi,rsi
       je        short M01_L03
       mov       rcx,offset MT_System.Linq.Enumerable+SelectListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
       jmp       near ptr M01_L06
M01_L03:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectIListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbx
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       short M01_L06
M01_L04:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       je        short M01_L05
       xor       r8d,r8d
       mov       [rsp+20],r8
       lea       r8,[rsp+20]
       mov       rcx,rdi
       mov       rdx,rax
       call      qword ptr [7FF8AFFCD0D8]
       cmp       qword ptr [rsp+20],0
       je        short M01_L05
       mov       rax,[rsp+20]
       jmp       short M01_L06
M01_L05:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectEnumerableIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
M01_L06:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
M01_L07:
       mov       ecx,10
       call      qword ptr [7FF8AFDD1798]
       int       3
M01_L08:
       mov       ecx,0F
       call      qword ptr [7FF8AFDD1798]
       int       3
; Total bytes of code 557

; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
       push      rsi
       sub       rsp,20
       mov       rsi,rcx
       test      rsi,rsi
       je        short M02_L01
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA5D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       jne       short M02_L00
       mov       rcx,rsi
       add       rsp,20
       pop       rsi
       jmp       qword ptr [7FF8AFE63E28]
M02_L00:
       mov       rcx,rax
       mov       r11,7FF8AF8B0598
       add       rsp,20
       pop       rsi
       jmp       qword ptr [r11]
M02_L01:
       mov       ecx,10
       call      qword ptr [7FF8AFDD1798]
       int       3
; Total bytes of code 84

Compare Jit Disasm

; System.Linq.Tests.Perf_Enumerable.SelectToArray(System.Linq.Tests.LinqTestData)
       push      rdi
       push      rsi
       sub       rsp,28
       mov       rsi,[rdx+8]
       mov       rcx,15241807250
       mov       rdx,[rcx]
       test      rdx,rdx
       jne       short M00_L00
       mov       rcx,offset MT_System.Func`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rdi,rax
       mov       rdx,152418071B0
       mov       rdx,[rdx]
       lea       rcx,[rdi+8]
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,7FFA0D18AF30
       mov       [rdi+18],rdx
       mov       rcx,15241807250
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,rdi
M00_L00:
       mov       rcx,rsi
       call      qword ptr [7FFA0D18D000]; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       mov       rcx,rax
       add       rsp,28
       pop       rsi
       pop       rdi
       jmp       qword ptr [7FFA0D023510]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
; Total bytes of code 127

; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       xor       eax,eax
       mov       [rsp+20],rax
       mov       rsi,rcx
       mov       rdi,rdx
       test      rsi,rsi
       je        near ptr M01_L07
       test      rdi,rdi
       je        near ptr M01_L08
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        short M01_L00
       mov       rcx,rbx
       mov       rdx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       mov       r8,offset MD_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]].Select[[System.Int32, System.Private.CoreLib]](System.Func`2<Int32,Int32>)
       call      CORINFO_HELP_VIRTUAL_FUNC_PTR
       mov       rcx,rbx
       mov       rdx,rdi
       call      rax
       jmp       near ptr M01_L06
M01_L00:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        near ptr M01_L04
       mov       rdx,rsi
       mov       rcx,offset MT_System.Int32[]
       call      qword ptr [7FFA0CC1D7F8]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfAny(Void*, System.Object)
       mov       rbp,rax
       test      rbp,rbp
       je        short M01_L02
       cmp       dword ptr [rbp+8],0
       je        short M01_L01
       mov       rcx,offset MT_System.Linq.Enumerable+SelectArrayIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbp
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       near ptr M01_L06
M01_L01:
       mov       rcx,7FFA0CE68118
       mov       edx,4
       call      CORINFO_HELP_CLASSINIT_SHARED_DYNAMICCLASS
       mov       rdx,15241801F58
       mov       rax,[rdx]
       jmp       near ptr M01_L06
M01_L02:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.List`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rsi,rax
       test      rsi,rsi
       je        short M01_L03
       mov       rcx,offset MT_System.Linq.Enumerable+SelectListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
       jmp       near ptr M01_L06
M01_L03:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectIListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbx
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       short M01_L06
M01_L04:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       je        short M01_L05
       xor       r8d,r8d
       mov       [rsp+20],r8
       lea       r8,[rsp+20]
       mov       rcx,rdi
       mov       rdx,rax
       call      qword ptr [7FFA0D18D0D8]
       cmp       qword ptr [rsp+20],0
       je        short M01_L05
       mov       rax,[rsp+20]
       jmp       short M01_L06
M01_L05:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectEnumerableIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
M01_L06:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
M01_L07:
       mov       ecx,10
       call      qword ptr [7FFA0CF91798]
       int       3
M01_L08:
       mov       ecx,0F
       call      qword ptr [7FFA0CF91798]
       int       3
; Total bytes of code 557

; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
       push      rsi
       sub       rsp,20
       mov       rsi,rcx
       test      rsi,rsi
       je        short M02_L01
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       jne       short M02_L00
       mov       rcx,rsi
       add       rsp,20
       pop       rsi
       jmp       qword ptr [7FFA0D023E28]
M02_L00:
       mov       rcx,rax
       mov       r11,7FFA0CA705A0
       add       rsp,20
       pop       rsi
       jmp       qword ptr [r11]
M02_L01:
       mov       ecx,10
       call      qword ptr [7FFA0CF91798]
       int       3
; Total bytes of code 84

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: IList)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 535.1167007579127 > 497.9497986035288.
IsChangePoint: Marked as a change because one of 12/10/2022 11:25:25 PM, 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -51.90095249357905 (T) = (0 -532.1641996998612) / Math.Sqrt((36.43729423330508 / (39)) + (7.140647846614348 / (21))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (39) + (21) - 2, .025) and -0.12371590189233013 = (473.57539285837305 - 532.1641996998612) / 473.57539285837305 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```### Baseline Jit Disasm

```assembly
; System.Linq.Tests.Perf_Enumerable.SelectToArray(System.Linq.Tests.LinqTestData)
       push      rdi
       push      rsi
       sub       rsp,28
       mov       rsi,[rdx+8]
       mov       rcx,29762407250
       mov       rdx,[rcx]
       test      rdx,rdx
       jne       short M00_L00
       mov       rcx,offset MT_System.Func`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rdi,rax
       mov       rdx,297624071B0
       mov       rdx,[rdx]
       lea       rcx,[rdi+8]
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,7FF8AFFBC1F8
       mov       [rdi+18],rdx
       mov       rcx,29762407250
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,rdi
M00_L00:
       mov       rcx,rsi
       call      qword ptr [7FF8AFFBD2B8]; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       mov       rcx,rax
       add       rsp,28
       pop       rsi
       pop       rdi
       jmp       qword ptr [7FF8AFE53510]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
; Total bytes of code 127

; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       xor       eax,eax
       mov       [rsp+20],rax
       mov       rsi,rcx
       mov       rdi,rdx
       test      rsi,rsi
       je        near ptr M01_L07
       test      rdi,rdi
       je        near ptr M01_L08
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        short M01_L00
       mov       rcx,rbx
       mov       rdx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       mov       r8,offset MD_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]].Select[[System.Int32, System.Private.CoreLib]](System.Func`2<Int32,Int32>)
       call      CORINFO_HELP_VIRTUAL_FUNC_PTR
       mov       rcx,rbx
       mov       rdx,rdi
       call      rax
       jmp       near ptr M01_L06
M01_L00:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        near ptr M01_L04
       mov       rdx,rsi
       mov       rcx,offset MT_System.Int32[]
       call      qword ptr [7FF8AFA4D7F8]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfAny(Void*, System.Object)
       mov       rbp,rax
       test      rbp,rbp
       je        short M01_L02
       cmp       dword ptr [rbp+8],0
       je        short M01_L01
       mov       rcx,offset MT_System.Linq.Enumerable+SelectArrayIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbp
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       near ptr M01_L06
M01_L01:
       mov       rcx,7FF8AFC97C08
       mov       edx,4
       call      CORINFO_HELP_CLASSINIT_SHARED_DYNAMICCLASS
       mov       rdx,29762401F50
       mov       rax,[rdx]
       jmp       near ptr M01_L06
M01_L02:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.List`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rsi,rax
       test      rsi,rsi
       je        short M01_L03
       mov       rcx,offset MT_System.Linq.Enumerable+SelectListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
       jmp       near ptr M01_L06
M01_L03:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectIListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbx
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       short M01_L06
M01_L04:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       je        short M01_L05
       xor       r8d,r8d
       mov       [rsp+20],r8
       lea       r8,[rsp+20]
       mov       rcx,rdi
       mov       rdx,rax
       call      qword ptr [7FF8AFFBD390]
       cmp       qword ptr [rsp+20],0
       je        short M01_L05
       mov       rax,[rsp+20]
       jmp       short M01_L06
M01_L05:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectEnumerableIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
M01_L06:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
M01_L07:
       mov       ecx,10
       call      qword ptr [7FF8AFDC1798]
       int       3
M01_L08:
       mov       ecx,0F
       call      qword ptr [7FF8AFDC1798]
       int       3
; Total bytes of code 557

; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
       push      rsi
       sub       rsp,20
       mov       rsi,rcx
       test      rsi,rsi
       je        short M02_L01
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FF8AFA4D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       jne       short M02_L00
       mov       rcx,rsi
       add       rsp,20
       pop       rsi
       jmp       qword ptr [7FF8AFE53E28]
M02_L00:
       mov       rcx,rax
       mov       r11,7FF8AF8A05A8
       add       rsp,20
       pop       rsi
       jmp       qword ptr [r11]
M02_L01:
       mov       ecx,10
       call      qword ptr [7FF8AFDC1798]
       int       3
; Total bytes of code 84

Compare Jit Disasm

; System.Linq.Tests.Perf_Enumerable.SelectToArray(System.Linq.Tests.LinqTestData)
       push      rdi
       push      rsi
       sub       rsp,28
       mov       rsi,[rdx+8]
       mov       rcx,21DC6007250
       mov       rdx,[rcx]
       test      rdx,rdx
       jne       short M00_L00
       mov       rcx,offset MT_System.Func`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rdi,rax
       mov       rdx,21DC60071B0
       mov       rdx,[rdx]
       lea       rcx,[rdi+8]
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,7FFA0D18C1F8
       mov       [rdi+18],rdx
       mov       rcx,21DC6007250
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rdx,rdi
M00_L00:
       mov       rcx,rsi
       call      qword ptr [7FFA0D18D2B8]; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       mov       rcx,rax
       add       rsp,28
       pop       rsi
       pop       rdi
       jmp       qword ptr [7FFA0D023510]; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
; Total bytes of code 127

; System.Linq.Enumerable.Select[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>, System.Func`2<Int32,Int32>)
       push      rdi
       push      rsi
       push      rbp
       push      rbx
       sub       rsp,28
       xor       eax,eax
       mov       [rsp+20],rax
       mov       rsi,rcx
       mov       rdi,rdx
       test      rsi,rsi
       je        near ptr M01_L07
       test      rdi,rdi
       je        near ptr M01_L08
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        short M01_L00
       mov       rcx,rbx
       mov       rdx,offset MT_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]]
       mov       r8,offset MD_System.Linq.Enumerable+Iterator`1[[System.Int32, System.Private.CoreLib]].Select[[System.Int32, System.Private.CoreLib]](System.Func`2<Int32,Int32>)
       call      CORINFO_HELP_VIRTUAL_FUNC_PTR
       mov       rcx,rbx
       mov       rdx,rdi
       call      rax
       jmp       near ptr M01_L06
M01_L00:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.IList`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       mov       rbx,rax
       test      rbx,rbx
       je        near ptr M01_L04
       mov       rdx,rsi
       mov       rcx,offset MT_System.Int32[]
       call      qword ptr [7FFA0CC1D7F8]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfAny(Void*, System.Object)
       mov       rbp,rax
       test      rbp,rbp
       je        short M01_L02
       cmp       dword ptr [rbp+8],0
       je        short M01_L01
       mov       rcx,offset MT_System.Linq.Enumerable+SelectArrayIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbp
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       near ptr M01_L06
M01_L01:
       mov       rcx,7FFA0CE68118
       mov       edx,4
       call      CORINFO_HELP_CLASSINIT_SHARED_DYNAMICCLASS
       mov       rdx,21DC6001F60
       mov       rax,[rdx]
       jmp       near ptr M01_L06
M01_L02:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Collections.Generic.List`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D828]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfClass(Void*, System.Object)
       mov       rsi,rax
       test      rsi,rsi
       je        short M01_L03
       mov       rcx,offset MT_System.Linq.Enumerable+SelectListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
       jmp       near ptr M01_L06
M01_L03:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectIListIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rsi,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rsi+8],eax
       lea       rcx,[rsi+18]
       mov       rdx,rbx
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rsi+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rsi
       jmp       short M01_L06
M01_L04:
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IPartition`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       je        short M01_L05
       xor       r8d,r8d
       mov       [rsp+20],r8
       lea       r8,[rsp+20]
       mov       rcx,rdi
       mov       rdx,rax
       call      qword ptr [7FFA0D18D390]
       cmp       qword ptr [rsp+20],0
       je        short M01_L05
       mov       rax,[rsp+20]
       jmp       short M01_L06
M01_L05:
       mov       rcx,offset MT_System.Linq.Enumerable+SelectEnumerableIterator`2[[System.Int32, System.Private.CoreLib],[System.Int32, System.Private.CoreLib]]
       call      CORINFO_HELP_NEWSFAST
       mov       rbx,rax
       call      CORINFO_HELP_GETCURRENTMANAGEDTHREADID
       mov       [rbx+8],eax
       lea       rcx,[rbx+18]
       mov       rdx,rsi
       call      CORINFO_HELP_ASSIGN_REF
       lea       rcx,[rbx+20]
       mov       rdx,rdi
       call      CORINFO_HELP_ASSIGN_REF
       mov       rax,rbx
M01_L06:
       add       rsp,28
       pop       rbx
       pop       rbp
       pop       rsi
       pop       rdi
       ret
M01_L07:
       mov       ecx,10
       call      qword ptr [7FFA0CF91798]
       int       3
M01_L08:
       mov       ecx,0F
       call      qword ptr [7FFA0CF91798]
       int       3
; Total bytes of code 557

; System.Linq.Enumerable.ToArray[[System.Int32, System.Private.CoreLib]](System.Collections.Generic.IEnumerable`1<Int32>)
       push      rsi
       sub       rsp,20
       mov       rsi,rcx
       test      rsi,rsi
       je        short M02_L01
       mov       rdx,rsi
       mov       rcx,offset MT_System.Linq.IIListProvider`1[[System.Int32, System.Private.CoreLib]]
       call      qword ptr [7FFA0CC1D810]; System.Runtime.CompilerServices.CastHelpers.IsInstanceOfInterface(Void*, System.Object)
       test      rax,rax
       jne       short M02_L00
       mov       rcx,rsi
       add       rsp,20
       pop       rsi
       jmp       qword ptr [7FFA0D023E28]
M02_L00:
       mov       rcx,rax
       mov       r11,7FFA0CA705B0
       add       rsp,20
       pop       rsi
       jmp       qword ptr [r11]
M02_L01:
       mov       ecx,10
       call      qword ptr [7FFA0CF91798]
       int       3
; Total bytes of code 84

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.CtorGivenSize<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConcurrentDictionary - Duration of single invocation	226.35 ns	245.03 ns	1.08	0.05	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorGivenSize<String>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.CtorGivenSize<String>.ConcurrentDictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 245.03246665337477 > 232.6650881757695.
IsChangePoint: Marked as a change because one of 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -24.56781586341177 (T) = (0 -242.50366940405826) / Math.Sqrt((10.431615517322415 / (40)) + (7.943101980711896 / (21))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (21) - 2, .025) and -0.08812271493748952 = (222.86426528462795 - 242.50366940405826) / 222.86426528462795 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.IterateFor<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ImmutableList - Duration of single invocation	14.91 μs	15.90 μs	1.07	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateFor<String>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.IterateFor<String>.ImmutableList(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.902512533291555 > 15.664715177480232.
IsChangePoint: Marked as a change because one of 1/13/2023 4:37:08 PM, 1/18/2023 3:20:52 PM, 1/27/2023 7:12:54 PM, 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -34.02879577224974 (T) = (0 -16415.825859214612) / Math.Sqrt((1699.8626873477351 / (40)) + (38761.785851854846 / (21))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (21) - 2, .025) and -0.0989953318849595 = (14937.120643687125 - 16415.825859214612) / 14937.120643687125 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	3ff80e90e828bac0370c1930c9950c9650ae61b9
Compare	2b701237cf3169b63d6f61efd2e611c34d2622e2
Diff	Diff

Regressions in System.Collections.TryAddDefaultSize<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConcurrentDictionary - Duration of single invocation	63.79 μs	79.10 μs	1.24	0.01	False
Dictionary - Duration of single invocation	8.62 μs	9.06 μs	1.05	0.10	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddDefaultSize<Int32>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 79.09749365482233 > 66.92382576196857.
IsChangePoint: Marked as a change because one of 2/9/2023 12:40:40 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -120.91489896950517 (T) = (0 -79108.7515492921) / Math.Sqrt((164766.28390214598 / (40)) + (254571.07271373607 / (21))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (21) - 2, .025) and -0.2419140462473129 = (63699.05533183614 - 79108.7515492921) / 63699.05533183614 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.TryAddDefaultSize<Int32>.Dictionary(Count: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 9.058340383119408 > 8.915567841493628.
IsChangePoint: Marked as a change because one of 12/28/2022 7:19:51 AM, 1/5/2023 12:24:13 PM, 2/9/2023 4:10:34 PM, 2/14/2023 2:39:38 AM falls between 2/4/2023 10:21:07 PM and 2/14/2023 2:39:38 AM.
IsRegressionStdDev: Marked as regression because -13.718523841981185 (T) = (0 -9630.15318343178) / Math.Sqrt((10342.398999909683 / (40)) + (132238.30280433354 / (20))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (40) + (20) - 2, .025) and -0.13388662883343178 = (8493.047663274325 - 9630.15318343178) / 8493.047663274325 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Author:	performanceautofiler[bot]
Assignees:	EgorBo
Labels:	area-CodeGen-coreclr, untriaged
Milestone:	-

[cincuranet]

Probably caused by #81557.

More instances:

• [Perf] Windows/x64: 1 Regression on 2/9/2023 1:20:08 AM perf-autofiling-issues#12917

cc @stephentoub

[stephentoub]

"Regressions in System.Collections.TryAddDefaultSize" is surprising. I'll take a look...