dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.07k stars 4.69k forks source link

[libraries-jitstress] Various regex tests time out under jitstress #100754

Closed jakobbotsch closed 2 months ago

jakobbotsch commented 6 months ago

Example pipeline run: https://dev.azure.com/dnceng-public/public/_build/results?buildId=631397&view=results Example console log: https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-heads-main-6cb54af51eea4845b7/System.Text.RegularExpressions.Tests/1/console.e637dad7.log?helixlogtype=result

DOTNET_EnableCrashReport=1
DOTNET_TieredCompilation=0
DOTNET_JitStress=1
DOTNET_DbgMiniDumpName=/home/helixbot/dotnetbuild/dumps/coredump.%d.dmp
DOTNET_DbgEnableMiniDump=1
...
[Long Running Test] 'System.Text.RegularExpressions.Tests.RegexCultureTests.CharactersComparedOneByOne_AnchoredPattern', Elapsed: 00:28:11
[Long Running Test] 'System.Text.RegularExpressions.Tests.RegexEnumerateMatchesTests.EnumerateMatches_CheckIndex', Elapsed: 00:28:07
[Long Running Test] 'System.Text.RegularExpressions.Tests.RegexUnicodeCharTests.WideLatin', Elapsed: 00:28:07
[Long Running Test] 'System.Text.RegularExpressions.Tests.RegexMultipleMatchTests.Matches_MultipleCapturingGroups', Elapsed: 00:28:06
[Long Running Test] 'System.Text.RegularExpressions.Tests.RegexCountTests.EnumerateMatches_ReturnsExpectedCount', Elapsed: 00:28:05
Killed
['System.Text.RegularExpressions.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]
dotnet-policy-service[bot] commented 6 months ago

Tagging subscribers to this area: @dotnet/area-system-text-regularexpressions See info in area-owners.md if you want to be subscribed.

jakobbotsch commented 5 months ago

These tests also sometimes time out even without any stress variables, with regular checked/debug builds of the runtime. Example pipeline run: https://dev.azure.com/dnceng-public/public/_build/results?buildId=637524&view=ms.vss-test-web.build-test-results-tab&runId=15704680&resultId=206394&paneView=debug Example console log: https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-100428-merge-89d25380d6384201b3/System.Text.RegularExpressions.Tests/1/console.cc7944e2.log?helixlogtype=result

steveharter commented 5 months ago

cc @stephentoub

stephentoub commented 3 months ago

@jakobbotsch, is this still happening? Is there a way to tie this issue with such issues happening such that CI automatically updates it with cases? Do we have a dump that shows what the tests are doing when the timeouts occur? The builds linked above are no longer available.

stephentoub commented 2 months ago

@jakobbotsch, is this still happening?

jakobbotsch commented 2 months ago

Sorry for missing your earlier ping. I haven't seen this in a while... Let's close it.

Is there a way to tie this issue with such issues happening such that CI automatically updates it with cases

Sadly build analysis does not support these pipelines. Hopefully some day we can get the tracking for these pipelines via build analysis.

stephentoub commented 2 months ago

ok, thanks