adamsitnik
commented
2 years ago Using the python script mentioned above is great to quickly get a 32 bit version of the SDK, but once you get it you might want to experiment with some changes locally.
When python script fails, it's going to print the path to the folder with auto-generated project. In the example below it's D:\projects\performance\artifacts\bin\MicroBenchmarks\Release\net7.0\b5b91f91-ffea-42f8-b3c4-564a95dfa491:
```log
[2022/02/03 12:41:10][INFO] Dumping COMPlus environment:
[2022/02/03 12:41:10][INFO] --------------------------------------------------
[2022/02/03 12:41:10][INFO] $ pushd "D:\projects\performance\src\benchmarks\micro"
[2022/02/03 12:41:10][INFO] $ dotnet run --project D:\projects\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net7.0 --no-restore --no-build -- --filter * --packages D:\projects\performance\artifacts\packages --buildTimeout 600
[2022/02/03 12:41:14][INFO] // Validating benchmarks:
[2022/02/03 12:41:20][INFO] // ***** BenchmarkRunner: Start *****
[2022/02/03 12:41:20][INFO] // ***** Found 4506 benchmark(s) in total *****
[2022/02/03 12:41:20][INFO] // ***** Building 1 exe(s) in Parallel: Start *****
[2022/02/03 12:41:29][INFO] // start dotnet restore /p:DebugType=portable -bl:benchmarkdotnet.binlog /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 /p:Deterministic=true /p:Optimize=true in D:\projects\performance\artifacts\bin\MicroBenchmarks\Release\net7.0\b5b91f91-ffea-42f8-b3c4-564a95dfa491
[2022/02/03 12:41:31][INFO] // command took 1.91s and exited with 0
[2022/02/03 12:41:31][INFO] // start dotnet build -c Release /p:DebugType=portable -bl:benchmarkdotnet.binlog --no-restore /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 /p:Deterministic=true /p:Optimize=true in D:\projects\performance\artifacts\bin\MicroBenchmarks\Release\net7.0\b5b91f91-ffea-42f8-b3c4-564a95dfa491
[2022/02/03 12:41:55][INFO] // command took 24.11s and exited with 1
[2022/02/03 12:41:55][INFO] // start dotnet build -c Release /p:DebugType=portable -bl:benchmarkdotnet.binlog --no-restore --no-dependencies /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 /p:Deterministic=true /p:Optimize=true in D:\projects\performance\artifacts\bin\MicroBenchmarks\Release\net7.0\b5b91f91-ffea-42f8-b3c4-564a95dfa491
[2022/02/03 12:42:11][INFO] // command took 16.47s and exited with 1
[2022/02/03 12:42:11][INFO] // ***** Done, took 00:00:51 (51.6 sec) *****
[2022/02/03 12:42:11][INFO] // Found 3 benchmarks:
[2022/02/03 12:42:11][INFO] // BilinearTest.Interpol_Scalar: Job-RXFPWE(PowerPlanMode=00000000-0000-0000-0000-000000000000, Arguments=/p:DebugType=portable,-bl:benchmarkdotnet.binlog, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1)
[2022/02/03 12:42:11][INFO] // BilinearTest.Interpol_Vector: Job-RXFPWE(PowerPlanMode=00000000-0000-0000-0000-000000000000, Arguments=/p:DebugType=portable,-bl:benchmarkdotnet.binlog, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1)
[2022/02/03 12:42:11][INFO] // BilinearTest.Interpol_AVX: Job-RXFPWE(PowerPlanMode=00000000-0000-0000-0000-000000000000, Arguments=/p:DebugType=portable,-bl:benchmarkdotnet.binlog, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1)
[2022/02/03 12:42:11][INFO]
[2022/02/03 12:42:11][INFO] // Build Error: Standard output:
[2022/02/03 12:42:11][INFO]
[2022/02/03 12:42:11][INFO] Standard error:
[2022/02/03 12:42:11][INFO] Time Elapsed 00:00:16.16
[2022/02/03 12:42:11][INFO] 50 Error(s)
[2022/02/03 12:42:11][INFO] 0 Warning(s)
```
You can modify the project (to apply some extra settings? use a local buld of Roslyn?) and build it using the downloaded SDK:
.\performance\tools\dotnet\x86\dotnet.exe build -c Release -f net7.0 D:\projects\performance\artifacts\bin\MicroBenchmarks\Release\net7.0\b5b91f91-ffea-42f8-b3c4-564a95dfa491\BenchmarkDotNet.Autogenerated.csprojBy doing that you get only the MSBuild output without BDN or python script noise.
cston
BenchmarkDotNet generates a project with boilerplate code that takes care of all common benchmarking pitfalls. In dotnet/performance repository we have more than 4 thousand benchmarks and when we are using 32 bit SDK to build the auto-generated project, it fails with OOM in Roslyn. Initially, I thought that it was caused by the fact that the generated project contains a single source file with more than 3 million lines of code. So I've changed BDN implementation to don't store more than 100 generated types in a single source file: https://github.com/dotnet/BenchmarkDotNet/pull/1914. The problem is that it did not help, I am still getting OOM.
Any help (including workarounds) would be much appreciated as it's currently blocking us from ensuring that we are shipping .NET 7 preview 1 without performance regressions.
cc @danmoseley @AndyAyersMS who has hit this issue recently
Version Used: x86,
4.1.6.6811part of the7.0.100-preview.2.22102.6 SDKbut it's reproducible with older versions as well (6.0)Steps to Reproduce:
Expected Behavior: It works fine.
Actual Behavior: It throws OOM.
Full stack trace: