Test failure in JIT/superpmi/superpmicollect/superpmicollect.sh

[v-haren]

failed in job: runtime-coreclr crossgen2 20200222.1

Error message:
Fatal error. Failed to load alternative JIT compiler\n at System.SpanHelpers.IndexOf(Char ByRef, Char, Int32)\n at System.String.Ctor(Char*)\n at System.AppContext.Setup(Char**, Char**, Int32)\n/home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh: line 193: 6805 Aborted __Command=$_DebuggerFullPath "$CORE_ROOT/crossgen2/crossgen2" -r:$CORE_ROOT/System..dll -r:$CORE_ROOT/Microsoft..dll -r:$CORE_ROOT/mscorlib.dll -r:$PWD/.dll --targetarch=x64 -O --inputbubble $ExtraCrossGen2Args -o:Bytemark.dll Bytemark.org\nManaged assembly not found: No such file or directory\nManaged assembly not found: No such file or directory\nERROR: no .mc files generated\n\nReturn code: 1\nRaw output file: /home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/Reports/JIT.superpmi/superpmicollect/superpmicollect.output.txt\nRaw output:\nBEGIN EXECUTION\nin takeLock\nWarning: No files matching /home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/.dll\nEmitting R2R PE file: /home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/superpmicollect.dll\n\nin ReleaseLock\n/home/helixbot/work/BB7009DF/p/corerun superpmicollect.dll ''\nSuperPMI collection and playback - BEGIN\nSetting environment variables:\n SuperPMIShimLogPath=/tmp/u2wu3ud0.aeySPMI\n SuperPMIShimPath=/home/helixbot/work/BB7009DF/p/libclrjit.so\n COMPlus_AltJit=*\n COMPlus_AltJitName=libsuperpmi-shim-collector.so\nRunning: /usr/bin/perl -pi -e 's/\r\n|\n|\r/\n/g' "/home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh"\nRunning: /bin/chmod +x "/home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh"\nRunning: /usr/bin/env bash /home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh\nBEGIN EXECUTION\nin takeLock\nWriting minidump with heap to file /home/helixbot/dotnetbuild/dumps/coredump.6805.dmp\nWritten 47734784 bytes (11654 pages) to core file\n\nin ReleaseLock\n/home/helixbot/work/BB7009DF/p/corerun Bytemark.dll ''\nExpected: 100\nActual: 255\nEND EXECUTION - FAILED\nRunning: /usr/bin/perl -pi -e 's/\r\n|\n|\r/\n/g' "/home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh"\nRunning: /bin/chmod +x "/home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh"\nRunning: /usr/bin/env bash /home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh\nBEGIN EXECUTION\n/home/helixbot/work/BB7009DF/p/corerun 10w5d_cs_do.dll ''\nExpected: 100\nActual: 255\nEND EXECUTION - FAILED\nSuperPMI collection and playback - FAILED\nExpected: 100\nActual: 101\nEND EXECUTION - FAILED\nTest Harness Exitcode is : 1\nTo run the test:\n> set CORE_ROOT=/home/helixbot/work/BB7009DF/p\n> /home/helixbot/work/BB7009DF/w/A7A60982/e/JIT/superpmi/superpmicollect/superpmicollect.sh\nExpected: True\nActual: False

[AriNuer]

Same test JIT/superpmi/superpmicollect/superpmicollect.sh failed with different error.
Job:
runtime-coreclr crossgen2 outerloop:20200304.1

Error message:

Managed assembly not found: No such file or directory
ERROR: replay of final file is not error free

Return code: 1
Raw output file: /home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/Reports/JIT.superpmi/superpmicollect/superpmicollect.output.txt
Raw output:
BEGIN EXECUTION
in takeLock
Warning: No files matching /home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/.dll
Emitting R2R PE file: /home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/superpmicollect.dll

in ReleaseLock
/home/helixbot/work/B6220979/p/corerun superpmicollect.dll ''
SuperPMI collection and playback - BEGIN
Setting environment variables:
SuperPMIShimLogPath=/tmp/and353c3.fytSPMI
SuperPMIShimPath=/home/helixbot/work/B6220979/p/libclrjit.so
COMPlus_AltJit=
COMPlus_AltJitName=libsuperpmi-shim-collector.so
Running: /usr/bin/perl -pi -e 's/\r\n|\n|\r/\n/g' "/home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh"
Running: /bin/chmod +x "/home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh"
Running: /usr/bin/env bash /home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh
BEGIN EXECUTION
/home/helixbot/work/B6220979/p/corerun Bytemark.dll ''
Expected: 100
Actual: 255
END EXECUTION - FAILED
Running: /usr/bin/perl -pi -e 's/\r\n|\n|\r/\n/g' "/home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh"
Running: /bin/chmod +x "/home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh"
Running: /usr/bin/env bash /home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/10w5d_cs_do/10w5d_cs_do.sh
BEGIN EXECUTION
in takeLock
Warning: No files matching /home/helixbot/work/B6220979/w/A58108C7/e/JIT/superpmi/superpmicollect/10w5d_cs_do/*.dll\nInfo: Method [10w5d_cs_do]testout1..cctor() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_1_1_1() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_1_1_2() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_1_1_5() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_1_1_6() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_1_2_1() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_1_2_5() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_1_2_4() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_1_6_4() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_3_1_1() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_3_1_2() was not compiled because https://github.com/dotnet/runtime/issues/32663: CORINFO_FIELD_STATIC_ADDRESS requires runtime JIT
Info: Method [10w5d_cs_do]testout1.Func_0_1_3_1_3() was not compiled because `h

Stack trace:
at JIT_superpmi._superpmicollect_superpmicollect_._superpmicollect_superpmicollect_sh() in /Users/runner/runners/2.165.0/work/1/s/artifacts/tests/coreclr/OSX.x64.Checked/TestWrappers/JIT.superpmi/JIT.superpmi.XUnitWrapper.cs:line 334

Details:
https://dev.azure.com/dnceng/public/_build/results?buildId=547414&view=ms.vss-test-web.build-test-results-tab&runId=17309172&resultId=103602&paneView=debug

[AriNuer]

Same test JIT/superpmi/superpmicollect/superpmicollect.sh failed in runtime-coreclr crossgen2:20200316.2
Error message:

ERROR: replay of final file is not error free

Return code: 1
Raw output file: /home/helixbot/work/AF220996/w/AE1909A3/e/JIT/superpmi/Reports/JIT.superpmi/superpmicollect/superpmicollect.output.txt
Raw output:
BEGIN EXECUTION
in takeLock
Warning: No files matching /home/helixbot/work/AF220996/w/AE1909A3/e/JIT/superpmi/superpmicollect/.dll
Emitting R2R PE file: /home/helixbot/work/AF220996/w/AE1909A3/e/JIT/superpmi/superpmicollect/superpmicollect.dll
in ReleaseLock
/home/helixbot/work/AF220996/p/corerun superpmicollect.dll ''
SuperPMI collection and playback - BEGIN
Setting environment variables:
SuperPMIShimLogPath=/tmp/h2moyzzx.ejzSPMI
SuperPMIShimPath=/home/helixbot/work/AF220996/p/libclrjit.so
COMPlus_AltJit= 
COMPlus_AltJitName=libsuperpmi-shim-collector.so
Running: /usr/bin/perl -pi -e 's/\r\n|\n|\r/\n/g' "/home/helixbot/work/AF220996/w/AE1909A3/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh"
Running: /bin/chmod +x "/home/helixbot/work/AF220996/w/AE1909A3/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh"
Running: /usr/bin/env bash /home/helixbot/work/AF220996/w/AE1909A3/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.sh\nBEGIN EXECUTION
in takeLock
Warning: No files matching /home/helixbot/work/AF220996/w/AE1909A3/e/JIT/superpmi/superpmicollect/Bytemark/*.dll
Warning: Method [Bytemark]ByteMark.BenchLUDecomp() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchNeural() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchNeuralJagged() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchIDEAEncryption() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchAssignRectangular() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchAssignJagged() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchFourier() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchEmFloatClass() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchEmFloat() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchBitOps() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchStringSort() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchNumericSortRectangular() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Warning: Method [Bytemark]ByteMark.BenchNumericSortJagged() was not compiled because: [TEMPORARY EXCEPTION MESSAGE] FileLoadErrorGeneric: xunit.performance.core
Emitting R2R PE file: /home/helixbot/work/AF220996/w/AE1909A3/e/JIT/superpmi/superpmicollect/Bytemark/Bytemark.dll
in ReleaseLock
/home/helixbot/work/AF220996/p/corerun Bytemark.dll ''
BBBBBB YYY Y TTTTTTT EEEEEEE
BBB B YYY Y TTT EEE
BBB B YYY Y TTT EEE
BBBBBB YYY Y TTT EEEEEEE
BBB B YYY TTT EEE
BBB B YYY TTT EEE
BBBBBB YYY TTT EEEEEEE

BYTEmark (tm) C# Mode Benchmark ver. 2 (06/99)
NUMERIC SORT(jagged): Iterations/sec: 880.02494 Index: 22.56879
NUMERIC SORT(rectangle): Iterations/sec:

Stack trace:
at JIT_superpmi._superpmicollect_superpmicollect_._superpmicollect_superpmicollect_sh() in /Users/runner/runners/2.165.0/work/1/s/artifacts/tests/coreclr/OSX.x64.Checked/TestWrappers/JIT.superpmi/JIT.superpmi.XUnitWrapper.cs:line 334
Details:
https://dev.azure.com/dnceng/public/_build/results?buildId=561824&view=ms.vss-test-web.build-test-results-tab&runId=17680390&resultId=102250&paneView=debug

[BruceForstall]

@nattress weren't you going to disable all these crossgen2 failing tests?

[davidwrighton]

These tests are now disabled for crossgen2, but we may wish to look into them in the future. Moving to 6.0

[trylek]

@BruceForstall - could you please suggest the way forward here in light of your recent changes?