[Mono][Android] Long running test: JIT/opt/OSR/pinnedlocal/pinnedlocal.sh

[karelz]

Update: This test usually takes about 1h to run on Android. Investigate to see if it is necessary to run it on Android.

============================================================================== The test fails on regular basis - see runfo results:

• 6/16 - 68 failures (41 in Rolling test runs) in last 7 days
  • 101 failures (62 in Rolling test runs) in last 30 days

Error:

      Expected: True
      Actual:   False
      Stack Trace:
           at JIT_opt._OSR_pinnedlocal_pinnedlocal_._OSR_pinnedlocal_pinnedlocal_sh()

Full console log:

``` JIT/opt/OSR/pinnedlocal/pinnedlocal.sh [FAIL] cmdLine:/datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 6/13/2022 10:59:16 PM, end: 6/13/2022 11:59:16 PM) Return code: -100 Raw output file: /datadisks/disk1/work/CD450A54/w/AC8A0973/uploads/Reports/JIT.opt/OSR/pinnedlocal/pinnedlocal.output.txt Raw output: BEGIN EXECUTION [1.0.0-prerelease.22310.1+43e9fe312ac5513edf763877ce9ebf5d57ca9f88] XHarness command issued: android run --instrumentation=net.dot.MonoRunner --package-name=net.dot.JIT_opt --output-directory=/datadisks/disk1/work/CD450A54/w/AC8A0973/uploads/Reports/JIT.opt/OSR/pinnedlocal --arg=entrypoint:libname=pinnedlocal.dll --expected-exit-code=100 -v cmdLine:/datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 6/13/2022 10:59:16 PM, end: 6/13/2022 11:59:16 PM) Test Harness Exitcode is : -100 To run the test: > set CORE_ROOT=/datadisks/disk1/work/CD450A54/p > /datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Expected: True Actual: False Stack Trace: at JIT_opt._OSR_pinnedlocal_pinnedlocal_._OSR_pinnedlocal_pinnedlocal_sh() Output: cmdLine:/datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 6/13/2022 10:59:16 PM, end: 6/13/2022 11:59:16 PM) Return code: -100 Raw output file: /datadisks/disk1/work/CD450A54/w/AC8A0973/uploads/Reports/JIT.opt/OSR/pinnedlocal/pinnedlocal.output.txt Raw output: BEGIN EXECUTION [1.0.0-prerelease.22310.1+43e9fe312ac5513edf763877ce9ebf5d57ca9f88] XHarness command issued: android run --instrumentation=net.dot.MonoRunner --package-name=net.dot.JIT_opt --output-directory=/datadisks/disk1/work/CD450A54/w/AC8A0973/uploads/Reports/JIT.opt/OSR/pinnedlocal --arg=entrypoint:libname=pinnedlocal.dll --expected-exit-code=100 -v cmdLine:/datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 6/13/2022 10:59:16 PM, end: 6/13/2022 11:59:16 PM) Test Harness Exitcode is : -100 To run the test: > set CORE_ROOT=/datadisks/disk1/work/CD450A54/p > /datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh ```

[ghost]

Tagging subscribers to 'arch-android': @steveisok, @akoeplinger See info in area-owners.md if you want to be subscribed.

Issue Details

---

The test fails on regular basis - see [runfo results](https://runfo.azurewebsites.net/search/tests/?q=started%3A~7%20definition%3Aruntime-extra-platforms%20name%3A%22jit%2Fopt%2Fosr%2Fpinnedlocal%2Fpinnedlocal.sh%22): * 6/16 - 68 failures in last 7 days Error: ``` Expected: True Actual: False Stack Trace: at JIT_opt._OSR_pinnedlocal_pinnedlocal_._OSR_pinnedlocal_pinnedlocal_sh() ``` Full console log:

``` JIT/opt/OSR/pinnedlocal/pinnedlocal.sh [FAIL] cmdLine:/datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 6/13/2022 10:59:16 PM, end: 6/13/2022 11:59:16 PM) Return code: -100 Raw output file: /datadisks/disk1/work/CD450A54/w/AC8A0973/uploads/Reports/JIT.opt/OSR/pinnedlocal/pinnedlocal.output.txt Raw output: BEGIN EXECUTION [1.0.0-prerelease.22310.1+43e9fe312ac5513edf763877ce9ebf5d57ca9f88] XHarness command issued: android run --instrumentation=net.dot.MonoRunner --package-name=net.dot.JIT_opt --output-directory=/datadisks/disk1/work/CD450A54/w/AC8A0973/uploads/Reports/JIT.opt/OSR/pinnedlocal --arg=entrypoint:libname=pinnedlocal.dll --expected-exit-code=100 -v cmdLine:/datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 6/13/2022 10:59:16 PM, end: 6/13/2022 11:59:16 PM) Test Harness Exitcode is : -100 To run the test: > set CORE_ROOT=/datadisks/disk1/work/CD450A54/p > /datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Expected: True Actual: False Stack Trace: at JIT_opt._OSR_pinnedlocal_pinnedlocal_._OSR_pinnedlocal_pinnedlocal_sh() Output: cmdLine:/datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 6/13/2022 10:59:16 PM, end: 6/13/2022 11:59:16 PM) Return code: -100 Raw output file: /datadisks/disk1/work/CD450A54/w/AC8A0973/uploads/Reports/JIT.opt/OSR/pinnedlocal/pinnedlocal.output.txt Raw output: BEGIN EXECUTION [1.0.0-prerelease.22310.1+43e9fe312ac5513edf763877ce9ebf5d57ca9f88] XHarness command issued: android run --instrumentation=net.dot.MonoRunner --package-name=net.dot.JIT_opt --output-directory=/datadisks/disk1/work/CD450A54/w/AC8A0973/uploads/Reports/JIT.opt/OSR/pinnedlocal --arg=entrypoint:libname=pinnedlocal.dll --expected-exit-code=100 -v cmdLine:/datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 6/13/2022 10:59:16 PM, end: 6/13/2022 11:59:16 PM) Test Harness Exitcode is : -100 To run the test: > set CORE_ROOT=/datadisks/disk1/work/CD450A54/p > /datadisks/disk1/work/CD450A54/w/AC8A0973/e/JIT/opt/OSR/pinnedlocal/pinnedlocal.sh ```

Author:	karelz
Assignees:	-
Labels:	`os-android`, `area-VM-meta-mono`
Milestone:	-

[karelz]

@SamMonoRT @fanyang-mono this is failing in ALL rolling test runs this week (and likely earlier) -- can you (or someone on your team) please disable the test ASAP? Thanks!

[steveisok]

/cc @fanyang-mono @SamMonoRT

[karelz]

There were similar failures also for non-Android tracked by #70641.

[SamMonoRT]

Seems like still happening --- never mind my question -- Do we still need to disable given the revert https://github.com/dotnet/runtime/pull/70627 PR was merged, as in are there failures since ?

[jkotas]

The reverted PR has nothing to do with the Mono failures. This test has been failing intermittently on Mono for very long time.

[SamMonoRT]

Interesting to hear about these failures only now. Will submit a PR to disable the test for now.

[fanyang-mono]

I took a look at the logs. This test usually takes around 1h to finish and often got killed due to over time. I will disable it for now.

[SamMonoRT]

Merged https://github.com/dotnet/runtime/pull/70843 to disable the test. Removing blocking-ci label and adding disabled-test one for further tracking

[karelz]

Thanks @fanyang-mono and @SamMonoRT for fast turnaround. It's appreciated!

[fanyang-mono]

Won't be able to get to it for .NET7. Moving to .NET8

[naricc]

Noticed that the same test is failing on iOSSimulator x64 runs, with exit code 90, but same stack trace:

      Stack Trace:
           at JIT_opt._OSR_pinnedlocal_pinnedlocal_._OSR_pinnedlocal_pinnedlocal_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

Not 100 % sure if this is the same issue.

[fanyang-mono]

Moving to 9.0.0