dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.37k stars 4.75k forks source link

[HttpStress] [SslStress] Linux stress test builds are broken #85338

Closed antonfirsov closed 1 year ago

antonfirsov commented 1 year ago

The Build CLR And Libraries phase is failing starting with April 13:

https://dev.azure.com/dnceng-public/public/_build/results?buildId=251483&view=logs&j=22fea640-1099-5f32-ec5d-316ad83f359a&t=ebe1360c-fe50-5ebc-628a-48ef9bf66506

2023-04-13T13:23:26.6081570Z   ILCompiler -> /repo/artifacts/bin/coreclr/linux.x64.Release/ilc/ilc.dll
2023-04-13T13:23:26.7889770Z   Generating native code
2023-04-13T13:23:50.3607628Z clang-9 : error : invalid linker name in argument '-fuse-ld=lld' [/repo/src/coreclr/tools/aot/ILCompiler/ILCompiler.csproj]
2023-04-13T13:23:50.3747182Z ##[error]clang-9(0,0): error : (NETCORE_ENGINEERING_TELEMETRY=Build) invalid linker name in argument '-fuse-ld=lld'
2023-04-13T13:23:50.3757194Z /repo/.packages/microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/build/Microsoft.NETCore.Native.targets(350,5): error MSB3073: The command ""/usr/local/bin/clang-9" "/repo/artifacts/obj/coreclr/ILCompiler/x64/Release/native/ilc.o" -o "/repo/artifacts/bin/coreclr/linux.x64.Release/ilc/native/ilc" -fuse-ld=lld /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libbootstrapper.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libRuntime.ServerGC.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libstdc++compat.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libnumasupportdynamic.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Globalization.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.IO.Compression.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Net.Security.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Security.Cryptography.Native.OpenSsl.a -g -Wl,-rpath,'$ORIGIN' -Wl,--build-id=sha1 -Wl,--as-needed -pthread -ldl -lz -lrt -lm -pie -Wl,-z,relro -Wl,-z,now -Wl,--discard-all" exited with code 1. [/repo/src/coreclr/tools/aot/ILCompiler/ILCompiler.csproj]
2023-04-13T13:23:50.3761088Z ##[error]/repo/.packages/microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/build/Microsoft.NETCore.Native.targets(350,5): error MSB3073: (NETCORE_ENGINEERING_TELEMETRY=Build) The command ""/usr/local/bin/clang-9" "/repo/artifacts/obj/coreclr/ILCompiler/x64/Release/native/ilc.o" -o "/repo/artifacts/bin/coreclr/linux.x64.Release/ilc/native/ilc" -fuse-ld=lld /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libbootstrapper.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libRuntime.ServerGC.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libstdc++compat.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libnumasupportdynamic.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Globalization.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.IO.Compression.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Net.Security.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Security.Cryptography.Native.OpenSsl.a -g -Wl,-rpath,'$ORIGIN' -Wl,--build-id=sha1 -Wl,--as-needed -pthread -ldl -lz -lrt -lm -pie -Wl,-z,relro -Wl,-z,now -Wl,--discard-all" exited with code 1.
2023-04-13T13:23:50.3830354Z 
2023-04-13T13:23:50.3831558Z Build FAILED.

The most likely cause is that the container has different versions of clang and lld installed, the issue is explained in https://github.com/dotnet/runtime/issues/84794#issuecomment-1509601271.

ghost commented 1 year ago

Tagging subscribers to this area: @dotnet/ncl See info in area-owners.md if you want to be subscribed.

Issue Details
The `Build CLR And Libraries` phase failing starting with April 13: https://dev.azure.com/dnceng-public/public/_build/results?buildId=251483&view=logs&j=22fea640-1099-5f32-ec5d-316ad83f359a&t=ebe1360c-fe50-5ebc-628a-48ef9bf66506 ``` 2023-04-13T13:23:26.6081570Z ILCompiler -> /repo/artifacts/bin/coreclr/linux.x64.Release/ilc/ilc.dll 2023-04-13T13:23:26.7889770Z Generating native code 2023-04-13T13:23:50.3607628Z clang-9 : error : invalid linker name in argument '-fuse-ld=lld' [/repo/src/coreclr/tools/aot/ILCompiler/ILCompiler.csproj] 2023-04-13T13:23:50.3747182Z ##[error]clang-9(0,0): error : (NETCORE_ENGINEERING_TELEMETRY=Build) invalid linker name in argument '-fuse-ld=lld' 2023-04-13T13:23:50.3757194Z /repo/.packages/microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/build/Microsoft.NETCore.Native.targets(350,5): error MSB3073: The command ""/usr/local/bin/clang-9" "/repo/artifacts/obj/coreclr/ILCompiler/x64/Release/native/ilc.o" -o "/repo/artifacts/bin/coreclr/linux.x64.Release/ilc/native/ilc" -fuse-ld=lld /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libbootstrapper.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libRuntime.ServerGC.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libstdc++compat.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libnumasupportdynamic.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Globalization.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.IO.Compression.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Net.Security.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Security.Cryptography.Native.OpenSsl.a -g -Wl,-rpath,'$ORIGIN' -Wl,--build-id=sha1 -Wl,--as-needed -pthread -ldl -lz -lrt -lm -pie -Wl,-z,relro -Wl,-z,now -Wl,--discard-all" exited with code 1. [/repo/src/coreclr/tools/aot/ILCompiler/ILCompiler.csproj] 2023-04-13T13:23:50.3761088Z ##[error]/repo/.packages/microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/build/Microsoft.NETCore.Native.targets(350,5): error MSB3073: (NETCORE_ENGINEERING_TELEMETRY=Build) The command ""/usr/local/bin/clang-9" "/repo/artifacts/obj/coreclr/ILCompiler/x64/Release/native/ilc.o" -o "/repo/artifacts/bin/coreclr/linux.x64.Release/ilc/native/ilc" -fuse-ld=lld /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libbootstrapper.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libRuntime.ServerGC.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libstdc++compat.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/sdk/libnumasupportdynamic.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Globalization.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.IO.Compression.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Net.Security.Native.a /repo/.packages/runtime.linux-x64.microsoft.dotnet.ilcompiler/8.0.0-preview.1.23110.8/framework/libSystem.Security.Cryptography.Native.OpenSsl.a -g -Wl,-rpath,'$ORIGIN' -Wl,--build-id=sha1 -Wl,--as-needed -pthread -ldl -lz -lrt -lm -pie -Wl,-z,relro -Wl,-z,now -Wl,--discard-all" exited with code 1. 2023-04-13T13:23:50.3830354Z 2023-04-13T13:23:50.3831558Z Build FAILED. ``` The most likely cause is that the container has different versions of clang and lld installed, the issue is explained in https://github.com/dotnet/runtime/issues/84794#issuecomment-1509601271.
Author: antonfirsov
Assignees: antonfirsov
Labels: `area-System.Net.Http`
Milestone: 8.0.0
antonfirsov commented 1 year ago

Looks like this has been broken by #84148, hopefully applying #84795 to eng/docker/libraries-sdk.linux.Dockerfile will fix this. /cc @sbomer