search

ami-iit / onnx-cpp-benchmark

Simple tool to profile onnx inference with C++ APIs.
BSD 3-Clause "New" or "Revised" License
1 stars 1 forks source link

Windows CI failing July 2023 with pixi 0.0.6 #5

Closed traversaro closed 10 months ago

traversaro commented 1 year ago

Since ~3 days.

Last working: https://github.com/ami-iit/onnx-cpp-benchmark/actions/runs/5418652190 First failing: https://github.com/ami-iit/onnx-cpp-benchmark/actions/runs/5428645576

traversaro commented 1 year ago

Log:

2023-07-03T02:31:20.8391285Z 
2023-07-03T02:31:20.8392299Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "_LIB=" 
2023-07-03T02:31:20.8393930Z 
2023-07-03T02:31:20.8394243Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "_CPATH=" 
2023-07-03T02:31:20.8400275Z 
2023-07-03T02:31:20.8401456Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if "D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark\.pixi/env" == "" set "LIB=;\Library\lib" 
2023-07-03T02:31:20.8404379Z 
2023-07-03T02:31:20.8405137Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if "D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark\.pixi/env" == "" set "CPATH=;\Library\include" 
2023-07-03T02:31:20.8406696Z 
2023-07-03T02:31:20.8407425Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if not "D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark\.pixi/env" == "" set "LIB=;D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark\.pixi/env\Library\lib" 
2023-07-03T02:31:20.8411540Z 
2023-07-03T02:31:20.8412359Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if not "D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark\.pixi/env" == "" set "CPATH=;D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark\.pixi/env\Library\include" 
2023-07-03T02:31:20.8431911Z 
2023-07-03T02:31:20.8432603Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>SET DISTUTILS_USE_SDK=1 
2023-07-03T02:31:20.8435807Z 
2023-07-03T02:31:20.8436113Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>SET MSSdk=1 
2023-07-03T02:31:20.8439540Z 
2023-07-03T02:31:20.8439860Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>SET "VS_VERSION=16.0" 
2023-07-03T02:31:20.8443469Z 
2023-07-03T02:31:20.8443771Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>SET "VS_MAJOR=16" 
2023-07-03T02:31:20.8447114Z 
2023-07-03T02:31:20.8447429Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>SET "VS_YEAR=2019" 
2023-07-03T02:31:20.8450949Z 
2023-07-03T02:31:20.8451264Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "MSYS2_ARG_CONV_EXCL=/AI;/AL;/OUT;/out" 
2023-07-03T02:31:20.8454572Z 
2023-07-03T02:31:20.8454892Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "MSYS2_ENV_CONV_EXCL=CL" 
2023-07-03T02:31:20.8458874Z 
2023-07-03T02:31:20.8459237Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "PY_VCRUNTIME_REDIST=\bin\vcruntime140.dll" 
2023-07-03T02:31:20.8462703Z 
2023-07-03T02:31:20.8463003Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "CXX=cl.exe" 
2023-07-03T02:31:20.8466548Z 
2023-07-03T02:31:20.8466960Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "CC=cl.exe" 
2023-07-03T02:31:20.8470511Z 
2023-07-03T02:31:20.8470842Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "VSINSTALLDIR=" 
2023-07-03T02:31:20.8473960Z 
2023-07-03T02:31:20.8474279Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "NEWER_VS_WITH_OLDER_VC=0" 
2023-07-03T02:31:20.8478114Z 
2023-07-03T02:31:20.8478811Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>for /F "usebackq tokens=*" %i in (`vswhere.exe -nologo -products * -version [16.0,17.0) -property installationPath`) do (set "VSINSTALLDIR=%i\" ) 
2023-07-03T02:31:21.6378346Z 
2023-07-03T02:31:21.6379248Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" ) 
2023-07-03T02:31:21.6383333Z 
2023-07-03T02:31:21.6384418Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" (for /F "usebackq tokens=*" %i in (`vswhere.exe -nologo -products * -requires Microsoft.VisualStudio.ComponentGroup.VC.Tools.142.x86.x64 -property installationPath`) do (
2023-07-03T02:31:21.6385206Z set "VSINSTALLDIR=%i\"  
2023-07-03T02:31:21.6385667Z  set "NEWER_VS_WITH_OLDER_VC=1" 
2023-07-03T02:31:21.6385956Z ) ) 
2023-07-03T02:31:21.6386674Z 
2023-07-03T02:31:21.6390310Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" (for /F "usebackq tokens=*" %i in (`vswhere.exe -nologo -products * -requires Microsoft.VisualStudio.Component.VC.v142.x86.x64 -property installationPath`) do (
2023-07-03T02:31:21.6391173Z set "VSINSTALLDIR=%i\"  
2023-07-03T02:31:21.6391645Z  set "NEWER_VS_WITH_OLDER_VC=1" 
2023-07-03T02:31:21.6391942Z ) ) 
2023-07-03T02:31:21.6392191Z 
2023-07-03T02:31:21.6392699Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" (set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\" ) 
2023-07-03T02:31:21.6393245Z 
2023-07-03T02:31:21.6393899Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" (set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\" ) 
2023-07-03T02:31:21.6395422Z 
2023-07-03T02:31:21.6395998Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" (set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\BuildTools\" ) 
2023-07-03T02:31:21.6398199Z 
2023-07-03T02:31:21.6398725Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if not exist "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" (set "VSINSTALLDIR=C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\" ) 
2023-07-03T02:31:21.6402152Z 
2023-07-03T02:31:21.6402498Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>IF NOT "" == "" (
2023-07-03T02:31:21.6402825Z set "INCLUDE=;"  
2023-07-03T02:31:21.6403352Z  set "LIB=;;D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark\.pixi/env\Library\lib"  
2023-07-03T02:31:21.6403771Z  set "CMAKE_PREFIX_PATH=;" 
2023-07-03T02:31:21.6404226Z ) 
2023-07-03T02:31:21.6404720Z 
2023-07-03T02:31:21.6405005Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>call :GetWin10SdkDir 
2023-07-03T02:31:21.6419325Z 
2023-07-03T02:31:21.6419806Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>call :GetWin10SdkDirHelper HKLM\SOFTWARE\Wow6432Node  1>nul 2>&1 
2023-07-03T02:31:21.6619766Z 
2023-07-03T02:31:21.6620855Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if errorlevel 1 call :GetWin10SdkDirHelper HKCU\SOFTWARE\Wow6432Node  1>nul 2>&1 
2023-07-03T02:31:21.6621550Z 
2023-07-03T02:31:21.6622189Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if errorlevel 1 call :GetWin10SdkDirHelper HKLM\SOFTWARE  1>nul 2>&1 
2023-07-03T02:31:21.6623249Z 
2023-07-03T02:31:21.6623769Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if errorlevel 1 call :GetWin10SdkDirHelper HKCU\SOFTWARE  1>nul 2>&1 
2023-07-03T02:31:21.6624720Z 
2023-07-03T02:31:21.6627628Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if errorlevel 1 exit /B 1 
2023-07-03T02:31:21.6627868Z 
2023-07-03T02:31:21.6628359Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>exit /B 0 
2023-07-03T02:31:21.6631130Z 
2023-07-03T02:31:21.6631658Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>for /F %i in ('dir /ON /B "C:\Program Files (x86)\Windows Kits\10\\include\10.*"') DO (SET WindowsSDKVer=%~i ) 
2023-07-03T02:31:21.7120345Z 
2023-07-03T02:31:21.7121188Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.10240.0 ) 
2023-07-03T02:31:21.7122845Z 
2023-07-03T02:31:21.7123298Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.14393.0 ) 
2023-07-03T02:31:21.7126151Z 
2023-07-03T02:31:21.7126832Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.16299.0 ) 
2023-07-03T02:31:21.7129548Z 
2023-07-03T02:31:21.7130188Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.17134.0 ) 
2023-07-03T02:31:21.7132623Z 
2023-07-03T02:31:21.7133013Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.17763.0 ) 
2023-07-03T02:31:21.7135569Z 
2023-07-03T02:31:21.7136090Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.18362.0 ) 
2023-07-03T02:31:21.7138739Z 
2023-07-03T02:31:21.7140351Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.19041.0 ) 
2023-07-03T02:31:21.7141867Z 
2023-07-03T02:31:21.7142280Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.20348.0 ) 
2023-07-03T02:31:21.7145284Z 
2023-07-03T02:31:21.7145875Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.22000.0 ) 
2023-07-03T02:31:21.7148277Z 
2023-07-03T02:31:21.7148682Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>(SET WindowsSDKVer=10.0.22621.0 ) 
2023-07-03T02:31:21.7153168Z 
2023-07-03T02:31:21.7153807Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if errorlevel 1 (echo "Didn't find any windows 10 SDK. I'm not sure if things will work, but let's try..." )  else (echo Windows SDK version found as: "10.0.22621.0" ) 
2023-07-03T02:31:21.7154800Z Windows SDK version found as: "10.0.22621.0"
2023-07-03T02:31:21.7156472Z 
2023-07-03T02:31:21.7156848Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "CMAKE_PLAT=x64" 
2023-07-03T02:31:21.7160834Z 
2023-07-03T02:31:21.7161199Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "VCVARSBAT=64" 
2023-07-03T02:31:21.7165469Z 
2023-07-03T02:31:21.7165889Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>set "CMAKE_ARGS=-DCMAKE_BUILD_TYPE=Release" 
2023-07-03T02:31:21.7170985Z 
2023-07-03T02:31:21.7171638Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>IF "" == "1" (set "CMAKE_ARGS=-DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX= -DCMAKE_PROGRAM_PATH=\bin;\Scripts;\Library\bin;\bin;\Scripts;\Library\bin" ) 
2023-07-03T02:31:21.7173364Z 
2023-07-03T02:31:21.7173803Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>IF NOT "win-64" == "win-64" (
2023-07-03T02:31:21.7174209Z set "CONDA_BUILD_CROSS_COMPILATION=1"  
2023-07-03T02:31:21.7174945Z  set "CMAKE_ARGS=-DCMAKE_BUILD_TYPE=Release -DCMAKE_SYSTEM_NAME=Windows -DCMAKE_SYSTEM_PROCESSOR=AMD64" 
2023-07-03T02:31:21.7175624Z )  else (set "CONDA_BUILD_CROSS_COMPILATION=0" ) 
2023-07-03T02:31:21.7179374Z 
2023-07-03T02:31:21.7179786Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>IF 2019 GEQ 2019 (
2023-07-03T02:31:21.7180317Z set "CMAKE_GEN=Visual Studio 16 2019"  
2023-07-03T02:31:21.7181094Z  set "USE_NEW_CMAKE_GEN_SYNTAX=1" 
2023-07-03T02:31:21.7181432Z )  ELSE (
2023-07-03T02:31:21.7181881Z IF "win-64" == "win-64" (set "CMAKE_GEN=Visual Studio 16 2019 Win64" )  else (set "CMAKE_GEN=Visual Studio 16 2019" )  
2023-07-03T02:31:21.7182365Z  set "USE_NEW_CMAKE_GEN_SYNTAX=0" 
2023-07-03T02:31:21.7182615Z ) 
2023-07-03T02:31:21.7186522Z 
2023-07-03T02:31:21.7186884Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>echo "NEWER_VS_WITH_OLDER_VC=0" 
2023-07-03T02:31:21.7187782Z "NEWER_VS_WITH_OLDER_VC=0"
2023-07-03T02:31:21.7189558Z 
2023-07-03T02:31:21.7190173Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if "0" == "1" (set /p NEWER_VS= 0<"C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\\VC\Auxiliary\Build\Microsoft.VCToolsVersion.default.txt" ) 
2023-07-03T02:31:21.7191050Z 
2023-07-03T02:31:21.7191598Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>type "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\\VC\Auxiliary\Build\Microsoft.VCToolsVersion.default.txt" 
2023-07-03T02:31:21.7582615Z 14.29.30133
2023-07-03T02:31:21.7586332Z 
2023-07-03T02:31:21.7587186Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>dir "C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\\VC\Redist\MSVC\" 
2023-07-03T02:31:21.9691461Z  Volume in drive C is Windows
2023-07-03T02:31:21.9691908Z  Volume Serial Number is 9CEF-592B
2023-07-03T02:31:21.9692115Z 
2023-07-03T02:31:21.9692396Z  Directory of C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Redist\MSVC
2023-07-03T02:31:21.9694855Z 
2023-07-03T02:31:21.9979656Z 06/25/2023  11:04 PM    <DIR>          .
2023-07-03T02:31:21.9980322Z 06/25/2023  11:04 PM    <DIR>          ..
2023-07-03T02:31:21.9980860Z 06/25/2023  10:47 PM    <DIR>          14.16.27012
2023-07-03T02:31:21.9981494Z 06/25/2023  11:04 PM    <DIR>          14.25.28508
2023-07-03T02:31:21.9982056Z 06/25/2023  11:00 PM    <DIR>          14.29.30133
2023-07-03T02:31:21.9982799Z 06/25/2023  10:23 PM    <DIR>          v142
2023-07-03T02:31:21.9983638Z                0 File(s)              0 bytes
2023-07-03T02:31:21.9983991Z                6 Dir(s)  89,011,261,440 bytes free
2023-07-03T02:31:21.9987223Z 
2023-07-03T02:31:21.9987684Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>if "0" == "1" (
2023-07-03T02:31:21.9991324Z echo ""  
2023-07-03T02:31:21.9992025Z  if "~0,4" == "14.2" (set "CMAKE_GEN=Visual Studio 16 2019" )  else (set "CMAKE_GEN=Visual Studio 17 2022" )  
2023-07-03T02:31:21.9992668Z  set "USE_NEW_CMAKE_GEN_SYNTAX=1" 
2023-07-03T02:31:21.9992949Z ) 
2023-07-03T02:31:21.9993353Z 
2023-07-03T02:31:21.9993797Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>IF "" == "" SET "CMAKE_GENERATOR=Visual Studio 16 2019" 
2023-07-03T02:31:21.9995317Z 
2023-07-03T02:31:21.9995724Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>IF "1" == "1" (
2023-07-03T02:31:21.9996527Z IF "" == "" SET "CMAKE_GENERATOR_PLATFORM=x64"  
2023-07-03T02:31:21.9997052Z  IF "" == "" SET "CMAKE_GENERATOR_TOOLSET=v142" 
2023-07-03T02:31:21.9997456Z ) 
2023-07-03T02:31:22.0002662Z 
2023-07-03T02:31:22.0003186Z D:\a\onnx-cpp-benchmark\onnx-cpp-benchmark>pushd C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\ 
2023-07-03T02:31:22.0010685Z 
2023-07-03T02:31:22.0011182Z C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise>CALL "VC\Auxiliary\Build\vcvars64.bat" -vcvars_ver=14.29 10.0.22621.0 
2023-07-03T02:31:23.0493450Z **********************************************************************
2023-07-03T02:31:23.0494253Z ** Visual Studio 2019 Developer Command Prompt v16.11.27
2023-07-03T02:31:23.0494820Z ** Copyright (c) 2021 Microsoft Corporation
2023-07-03T02:31:23.0495517Z **********************************************************************
2023-07-03T02:31:25.7106126Z The input line is too long.
2023-07-03T02:31:25.7106761Z The syntax of the command is incorrect.
2023-07-03T02:31:25.7278567Z ##[error]Process completed with exit code 255.
traversaro commented 1 year ago

This works on pixi 0.0.5 and not on pixi 0.0.6, so it is probably regression related to pixi 0.0.6 .

traversaro commented 1 year ago

I am unable to replicate this on my local system.

traversaro commented 1 year ago

Apparenly the issue is related to path length: https://github.com/conda/conda/issues/1923 . However, it is interesting why this does not happen with regular mamba or with pixi 0.0.5 .

traversaro commented 1 year ago

As a workaround I pinned pixi to 0.0.5 in https://github.com/ami-iit/onnx-cpp-benchmark/pull/6 .

traversaro commented 1 year ago

https://github.com/prefix-dev/pixi/pull/169 should fix the problem upstream.

traversaro commented 10 months ago

Fixed by https://github.com/prefix-dev/pixi/pull/169 .