Closed skier233 closed 1 month ago
Hi @skier233
From what I see in your log, CMake cant find FFMpeg library. You need to download FFMpeg Windows build and provide CMake with the path to its location. Here's a CLI example of how its done in VALI CI: https://github.com/RomanArzumanyan/VALI/blob/03079c5d1ba4baf6903a08b5be7f80eceb66f7aa/.github/workflows/onPullRequest.yml#L90-L104
You don't need to set up Python venv, but the rest shall be relevant. Please make sure you follow this approach and LMK if you have any issues with that.
Hi @skier233
From what I see in your log, CMake cant find FFMpeg library. You need to download FFMpeg Windows build and provide CMake with the path to its location. Here's a CLI example of how its done in VALI CI:
You don't need to set up Python venv, but the rest shall be relevant. Please make sure you follow this approach and LMK if you have any issues with that.
I install ffmpeg with conda install conda-forge ffmpeg=6.1. I verify that the installation works and that nvdec and nvenc are in the list of encoders (also nvdec works using torchaudio).
I then set that path to: $env:SKBUILD_CONFIGURE_OPTIONS="-DFFMPEG_ROOT=C:\Users\tyler\anaconda3\envs\ai_model_server_experiment\Library\bin"
I see the ffmpeg.exe in that folder if I check manually
Hi @skier233
C:\Users\tyler\anaconda3\envs\ai_model_server_experiment\Library\bin
Please make sure that FFMPEG_ROOT
points to the directory which has both FFMpeg libraries and headers. ffmpeg.exe
is a binary application, it won't help compiler to build VALI source code.
If I install ffmpeg like this and set the path to the ffmpeg folder (which is exactly as it was downloaded so should have the headers and binary), I also get the same error:
# Define the download URL for the BtbN prebuilt FFmpeg with development files
$ffmpegUrl = "https://github.com/BtbN/FFmpeg-Builds/releases/download/latest/ffmpeg-n6.1-latest-win64-gpl-shared-6.1.zip"
# Download FFmpeg
Invoke-WebRequest -Uri $ffmpegUrl -OutFile ffmpeg.zip
# Extract the zip file using built-in tools
Expand-Archive -Path ffmpeg.zip -DestinationPath .\ffmpeg
# Define the source directory (it should be the only directory in the extracted folder)
$ffmpegSourceDir = Get-ChildItem -Directory .\ffmpeg | Select-Object -ExpandProperty FullName
# Define the destination directory
$ffmpegDestDir = "$env:CONDA_PREFIX\Library\ffmpeg"
# Ensure the destination directory exists and is empty
if (Test-Path -Path $ffmpegDestDir) {
Remove-Item -Recurse -Force -Path $ffmpegDestDir
}
New-Item -ItemType Directory -Path $ffmpegDestDir
# Move the entire FFmpeg folder to the conda environment
Copy-Item -Path "$ffmpegSourceDir\*" -Destination $ffmpegDestDir -Recurse -Force
# Update the PATH environment variable to include the FFmpeg binaries in the conda environment
$env:PATH = "$ffmpegDestDir\bin;$env:PATH"
# Clean up the downloaded zip and extracted files
Remove-Item -Recurse -Force .\ffmpeg
Remove-Item -Force ffmpeg.zip
# Verify installation using the full path
$ffmpegPath = "$ffmpegDestDir\bin\ffmpeg.exe"
& $ffmpegPath -hwaccels
# Confirm the correct ffmpeg is being used
Get-Command ffmpeg
# Check hardware acceleration support again
ffmpeg -hwaccels
ffmpeg version n6.1.1-100-g2aad37688c-20240520
$env:SKBUILD_CONFIGURE_OPTIONS="-DFFMPEG_ROOT=C:\Users\tyler\anaconda3\envs\ai_model_server_experiment\Library\ffmpeg"
Here is what the contents of that folder look like:
Headers are in the include folder, binaries in the bin folder
This gets the same error.
@skier233
Please don't forget to delete build cache after you've changed your build settings. Usually it's located _skbuild
folder.
@skier233
Please don't forget to delete build cache after you've changed your build settings. Usually it's located
_skbuild
folder.
I just deleted the folder inside that folder and tried again and it gets the same error.
Ok, what's your Python version?
Ok, what's your Python version?
Python 3.11.9
Here is my conda environment setup in case it helps:
name: ai_model_server_experiment
channels:
- defaults
- pytorch
- nvidia
- conda-forge
dependencies:
- python=3.11
- pytorch=2.3.0
- torchvision=0.18.0
- torchaudio
- pytorch-cuda=12.1
- ffmpeg=6.1 #currently installing this using the powershell instead
- pyyaml
- pip
- make
- pip:
- fastapi==0.111.0
- pycryptodomex==3.20.0
- uvicorn==0.29.0
- requests
- aiohttp
Any chance you can test vanilla python from https://www.python.org/downloads/windows/? I don't have an access to Anaconda distros, can't repro on my side.
Any chance you can test vanilla python from https://www.python.org/downloads/windows/? I don't have an access to Anaconda distros, can't repro on my side.
Tested with the vanilla python 3.11.0 on my host os and its the same error.
I assume that the quickest way to determine what's happening is to do as follows:
Meanwhile, please share the console output during your vanilla python build. You can run pip install . --verbose
to get more information in the log.
Here is the complete log:
PS C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI> pip install . --verbose
Using pip 24.0 from C:\Users\tyler\AppData\Local\Programs\Python\Python311\Lib\site-packages\pip (python 3.11)
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\appdirs-1.4.4-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\blinker-1.7.0-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\click-8.1.7-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\flask-2.3.3-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\itsdangerous-2.1.2-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\label_studio_tools-0.0.3-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\lxml-5.1.0-py3.11-win-amd64.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\requests-2.31.0-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\werkzeug-3.0.1-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Processing c:\coding\testing\pytorch\multilabelclassification_patreon\testing_copy\vali
Running command pip subprocess to install build dependencies
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com, https://pypi.ngc.nvidia.com
Ignoring ninja: markers 'platform_system != "Windows"' don't match your environment
Collecting setuptools>=42
Downloading setuptools-70.0.0-py3-none-any.whl.metadata (5.9 kB)
Collecting scikit-build
Downloading scikit_build-0.17.6-py3-none-any.whl.metadata (14 kB)
Collecting numpy
Downloading numpy-1.26.4-cp311-cp311-win_amd64.whl.metadata (61 kB)
---------------------------------------- 61.0/61.0 kB ? eta 0:00:00
Collecting cmake>=3.21
Downloading cmake-3.29.3-py3-none-win_amd64.whl.metadata (6.1 kB)
Collecting distro (from scikit-build)
Downloading distro-1.9.0-py3-none-any.whl.metadata (6.8 kB)
Collecting packaging (from scikit-build)
Downloading packaging-24.0-py3-none-any.whl.metadata (3.2 kB)
Collecting wheel>=0.32.0 (from scikit-build)
Downloading wheel-0.43.0-py3-none-any.whl.metadata (2.2 kB)
Downloading setuptools-70.0.0-py3-none-any.whl (863 kB)
--------------------------------------- 863.4/863.4 kB 27.5 MB/s eta 0:00:00
Downloading scikit_build-0.17.6-py3-none-any.whl (84 kB)
---------------------------------------- 84.3/84.3 kB ? eta 0:00:00
Downloading numpy-1.26.4-cp311-cp311-win_amd64.whl (15.8 MB)
---------------------------------------- 15.8/15.8 MB 59.4 MB/s eta 0:00:00
Downloading cmake-3.29.3-py3-none-win_amd64.whl (36.2 MB)
---------------------------------------- 36.2/36.2 MB 59.8 MB/s eta 0:00:00
Downloading wheel-0.43.0-py3-none-any.whl (65 kB)
---------------------------------------- 65.8/65.8 kB ? eta 0:00:00
Downloading distro-1.9.0-py3-none-any.whl (20 kB)
Downloading packaging-24.0-py3-none-any.whl (53 kB)
---------------------------------------- 53.5/53.5 kB ? eta 0:00:00
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\appdirs-1.4.4-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\blinker-1.7.0-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\click-8.1.7-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\flask-2.3.3-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\itsdangerous-2.1.2-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\label_studio_tools-0.0.3-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\lxml-5.1.0-py3.11-win-amd64.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\requests-2.31.0-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
DEPRECATION: Loading egg at c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages\werkzeug-3.0.1-py3.11.egg is deprecated. pip 24.3 will enforce this behaviour change. A possible replacement is to use pip for package installation.. Discussion can be found at https://github.com/pypa/pip/issues/12330
Installing collected packages: wheel, setuptools, packaging, numpy, distro, cmake, scikit-build
Successfully installed cmake-3.29.3 distro-1.9.0 numpy-1.26.4 packaging-24.0 scikit-build-0.17.6 setuptools-70.0.0 wheel-0.43.0
Installing build dependencies ... done
Running command Getting requirements to build wheel
<string>:9: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
running egg_info
writing src\PyNvCodec.egg-info\PKG-INFO
writing dependency_links to src\PyNvCodec.egg-info\dependency_links.txt
writing requirements to src\PyNvCodec.egg-info\requires.txt
writing top-level names to src\PyNvCodec.egg-info\top_level.txt
reading manifest file 'src\PyNvCodec.egg-info\SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'src\PyNvCodec.egg-info\SOURCES.txt'
Getting requirements to build wheel ... done
Running command Preparing metadata (pyproject.toml)
<string>:9: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
running dist_info
creating C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec.egg-info
writing C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec.egg-info\PKG-INFO
writing dependency_links to C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec.egg-info\dependency_links.txt
writing requirements to C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec.egg-info\requires.txt
writing top-level names to C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec.egg-info\top_level.txt
writing manifest file 'C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec.egg-info\SOURCES.txt'
reading manifest file 'C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec.egg-info\SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec.egg-info\SOURCES.txt'
creating 'C:\Users\tyler\AppData\Local\Temp\pip-modern-metadata-qt4h72l0\PyNvCodec-3.0.0.dist-info'
Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: numpy in c:\users\tyler\appdata\local\programs\python\python311\lib\site-packages (from PyNvCodec==3.0.0) (1.26.2)
Building wheels for collected packages: PyNvCodec
Running command Building wheel for PyNvCodec (pyproject.toml)
<string>:9: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
--------------------------------------------------------------------------------
-- Trying 'Ninja (Visual Studio 17 2022 x64 v143)' generator
--------------------------------
---------------------------
----------------------
-----------------
------------
-------
--
Not searching for unused variables given on the command line.
CMake Deprecation Warning at CMakeLists.txt:1 (cmake_minimum_required):
Compatibility with CMake < 3.5 will be removed from a future version of
CMake.
Update the VERSION argument <min> value or use a ...<max> suffix to tell
CMake that the project does not need compatibility with older versions.
CMake Error: CMake was unable to find a build program corresponding to "Ninja". CMAKE_MAKE_PROGRAM is not set. You probably need to select a different build tool.
-- Configuring incomplete, errors occurred!
--
-------
------------
-----------------
----------------------
---------------------------
--------------------------------
-- Trying 'Ninja (Visual Studio 17 2022 x64 v143)' generator - failure
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-- Trying 'Visual Studio 17 2022 x64 v143' generator
--------------------------------
---------------------------
----------------------
-----------------
------------
-------
--
Not searching for unused variables given on the command line.
CMake Deprecation Warning at CMakeLists.txt:1 (cmake_minimum_required):
Compatibility with CMake < 3.5 will be removed from a future version of
CMake.
Update the VERSION argument <min> value or use a ...<max> suffix to tell
CMake that the project does not need compatibility with older versions.
-- Selecting Windows SDK version 10.0.22621.0 to target Windows 10.0.19045.
-- The C compiler identification is MSVC 19.39.33523.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.39.33519/bin/Hostx64/x64/cl.exe - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- The CXX compiler identification is MSVC 19.39.33523.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.39.33519/bin/Hostx64/x64/cl.exe - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Configuring done (3.4s)
-- Generating done (0.0s)
-- Build files have been written to: C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/_cmake_test_compile/build
--
-------
------------
-----------------
----------------------
---------------------------
--------------------------------
-- Trying 'Visual Studio 17 2022 x64 v143' generator - success
--------------------------------------------------------------------------------
Configuring Project
Working directory:
C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI\_skbuild\win-amd64-3.11\cmake-build
Command:
'C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\cmake\data\bin/cmake.exe' 'C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI' -G 'Visual Studio 17 2022' --no-warn-unused-cli '-DCMAKE_INSTALL_PREFIX:PATH=C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI\_skbuild\win-amd64-3.11\cmake-install\src' -DPYTHON_VERSION_STRING:STRING=3.11.0 -DSKBUILD:INTERNAL=TRUE '-DCMAKE_MODULE_PATH:PATH=C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\skbuild\resources\cmake' '-DPYTHON_EXECUTABLE:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\python.exe' '-DPYTHON_INCLUDE_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\Include' '-DPYTHON_LIBRARY:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\libs\python311.lib' '-DPython_EXECUTABLE:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\python.exe' '-DPython_ROOT_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311' -DPython_FIND_REGISTRY:STRING=NEVER '-DPython_INCLUDE_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\Include' '-DPython_LIBRARY:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\libs\python311.lib' '-DPython_NumPy_INCLUDE_DIRS:PATH=C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\numpy\core\include' '-DPython3_EXECUTABLE:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\python.exe' '-DPython3_ROOT_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311' -DPython3_FIND_REGISTRY:STRING=NEVER '-DPython3_INCLUDE_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\Include' '-DPython3_LIBRARY:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\libs\python311.lib' '-DPython3_NumPy_INCLUDE_DIRS:PATH=C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\numpy\core\include' -T v143 -A x64 -DCMAKE_BUILD_TYPE:STRING=Release -DFFMPEG_ROOT=C:Userstyleranaconda3envsai_model_server_experimentLibraryffmpeg
Not searching for unused variables given on the command line.
-- Selecting Windows SDK version 10.0.22621.0 to target Windows 10.0.19045.
-- The C compiler identification is MSVC 19.39.33523.0
-- The CXX compiler identification is MSVC 19.39.33523.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.39.33519/bin/Hostx64/x64/cl.exe - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.39.33519/bin/Hostx64/x64/cl.exe - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found CUDAToolkit: C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.8/include (found suitable version "11.8.89", minimum required is "11.2")
-- Found Python3: C:/Users/tyler/AppData/Local/Programs/Python/Python311/python.exe (found suitable version "3.11.0", minimum required is "3.6") found components: Interpreter Development Development.Module Development.Embed
-- Populating pybind11
-- Selecting Windows SDK version 10.0.22621.0 to target Windows 10.0.19045.
-- Configuring done (0.4s)
-- Generating done (0.0s)
-- Build files have been written to: C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/_skbuild/win-amd64-3.11/cmake-build/_deps/pybind11-subbuild
MSBuild version 17.9.8+b34f75857 for .NET Framework
1>Checking Build System
1>Creating directories for 'pybind11-populate'
Performing download step (download, verify and extract) for 'pybind11-populate'
-- Downloading...
dst='C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/_skbuild/win-amd64-3.11/cmake-build/_deps/pybind11-subbuild/pybind11-populate-prefix/src/v2.10.0.tar.gz'
timeout='none'
inactivity timeout='none'
-- Using src='https://github.com/pybind/pybind11/archive/v2.10.0.tar.gz'
-- verifying file...
file='C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/_skbuild/win-amd64-3.11/cmake-build/_deps/pybind11-subbuild/pybind11-populate-prefix/src/v2.10.0.tar.gz'
-- Downloading... done
-- extracting...
src='C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/_skbuild/win-amd64-3.11/cmake-build/_deps/pybind11-subbuild/pybind11-populate-prefix/src/v2.10.0.tar.gz'
dst='C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/_skbuild/win-amd64-3.11/cmake-build/_deps/pybind11-src'
-- extracting... [tar xfz]
-- extracting... [analysis]
-- extracting... [rename]
-- extracting... [clean up]
-- extracting... done
Building Custom Rule C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/_skbuild/win-amd64-3.11/cmake-build/_deps/pybind11-subbuild/CMakeLists.txt
No update step for 'pybind11-populate'
No patch step for 'pybind11-populate'
No configure step for 'pybind11-populate'
No build step for 'pybind11-populate'
No install step for 'pybind11-populate'
No test step for 'pybind11-populate'
Completed 'pybind11-populate'
Building Custom Rule C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/_skbuild/win-amd64-3.11/cmake-build/_deps/pybind11-subbuild/CMakeLists.txt
CMake Deprecation Warning at _skbuild/win-amd64-3.11/cmake-build/_deps/pybind11-src/CMakeLists.txt:8 (cmake_minimum_required):
Compatibility with CMake < 3.5 will be removed from a future version of
CMake.
Update the VERSION argument <min> value or use a ...<max> suffix to tell
CMake that the project does not need compatibility with older versions.
-- pybind11 v2.10.0
-- Performing Test HAS_MSVC_GL_LTCG
-- Performing Test HAS_MSVC_GL_LTCG - Success
CMake Warning (dev) in src/PyNvCodec/CMakeLists.txt:
A logical block opening on the line
C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec/CMakeLists.txt:68 (if)
closes on the line
C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec/CMakeLists.txt:70 (endif)
with mis-matching arguments.
This warning is for project developers. Use -Wno-dev to suppress it.
-- FFMPEG_DLLS:
-- The CUDA compiler identification is NVIDIA 12.1.66
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.1/bin/nvcc.exe - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- Performing Test COMPILER_HAS_DEPRECATED_ATTR
-- Performing Test COMPILER_HAS_DEPRECATED_ATTR - Failed
-- Performing Test COMPILER_HAS_DEPRECATED
-- Performing Test COMPILER_HAS_DEPRECATED - Success
-- Found CUDAToolkit: C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v12.1/include (found suitable version "12.1.66", minimum required is "11.2")
CMake Warning (dev) in src/TC/CMakeLists.txt:
A logical block opening on the line
C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC/CMakeLists.txt:42 (if)
closes on the line
C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC/CMakeLists.txt:44 (endif)
with mis-matching arguments.
This warning is for project developers. Use -Wno-dev to suppress it.
-- Configuring done (16.3s)
CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
AVCODEC_INCLUDE_DIRS
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
AVCODEC_LIBRARIES
linked by target "_PyNvCodec" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
linked by target "TC" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
AVFORMAT_INCLUDE_DIRS
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
AVFORMAT_LIBRARIES
linked by target "_PyNvCodec" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
linked by target "TC" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
AVUTIL_INCLUDE_DIRS
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
AVUTIL_LIBRARIES
linked by target "_PyNvCodec" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
linked by target "TC" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
SWRESAMPLE_INCLUDE_DIRS
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
SWRESAMPLE_LIBRARIES
linked by target "_PyNvCodec" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
linked by target "TC" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
SWSCALE_INCLUDE_DIRS
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
used as include directory in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
SWSCALE_LIBRARIES
linked by target "_PyNvCodec" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/PyNvCodec
linked by target "TC" in directory C:/Coding/Testing/PyTorch/MultiLabelClassification_Patreon/testing_copy/VALI/src/TC
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/PyNvCodec/CMakeLists.txt:
Found relative path while evaluating include directories of "_PyNvCodec":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "TC":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "ALL_BUILD":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "ALL_BUILD":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "ALL_BUILD":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
CMake Error in src/TC/CMakeLists.txt:
Found relative path while evaluating include directories of "ALL_BUILD":
"AVFORMAT_INCLUDE_DIRS-NOTFOUND"
-- Generating done (0.1s)
CMake Generate step failed. Build files cannot be regenerated correctly.
Traceback (most recent call last):
File "C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\skbuild\setuptools_wrap.py", line 666, in setup
env = cmkr.configure(
^^^^^^^^^^^^^^^
File "C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\skbuild\cmaker.py", line 357, in configure
raise SKBuildError(msg)
An error occurred while configuring with CMake.
Command:
'C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\cmake\data\bin/cmake.exe' 'C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI' -G 'Visual Studio 17 2022' --no-warn-unused-cli '-DCMAKE_INSTALL_PREFIX:PATH=C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI\_skbuild\win-amd64-3.11\cmake-install\src' -DPYTHON_VERSION_STRING:STRING=3.11.0 -DSKBUILD:INTERNAL=TRUE '-DCMAKE_MODULE_PATH:PATH=C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\skbuild\resources\cmake' '-DPYTHON_EXECUTABLE:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\python.exe' '-DPYTHON_INCLUDE_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\Include' '-DPYTHON_LIBRARY:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\libs\python311.lib' '-DPython_EXECUTABLE:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\python.exe' '-DPython_ROOT_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311' -DPython_FIND_REGISTRY:STRING=NEVER '-DPython_INCLUDE_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\Include' '-DPython_LIBRARY:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\libs\python311.lib' '-DPython_NumPy_INCLUDE_DIRS:PATH=C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\numpy\core\include' '-DPython3_EXECUTABLE:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\python.exe' '-DPython3_ROOT_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311' -DPython3_FIND_REGISTRY:STRING=NEVER '-DPython3_INCLUDE_DIR:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\Include' '-DPython3_LIBRARY:PATH=C:\Users\tyler\AppData\Local\Programs\Python\Python311\libs\python311.lib' '-DPython3_NumPy_INCLUDE_DIRS:PATH=C:\Users\tyler\AppData\Local\Temp\pip-build-env-we_xzxkx\overlay\Lib\site-packages\numpy\core\include' -T v143 -A x64 -DCMAKE_BUILD_TYPE:STRING=Release -DFFMPEG_ROOT=C:Userstyleranaconda3envsai_model_server_experimentLibraryffmpeg
Source directory:
C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI
Working directory:
C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI\_skbuild\win-amd64-3.11\cmake-build
Please see CMake's output for more information.
error: subprocess-exited-with-error
× Building wheel for PyNvCodec (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
full command: 'C:\Users\tyler\AppData\Local\Programs\Python\Python311\python.exe' 'C:\Users\tyler\AppData\Local\Programs\Python\Python311\Lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py' build_wheel 'C:\Users\tyler\AppData\Local\Temp\tmp_1j3nccr'
cwd: C:\Coding\Testing\PyTorch\MultiLabelClassification_Patreon\testing_copy\VALI
Building wheel for PyNvCodec (pyproject.toml) ... error
ERROR: Failed building wheel for PyNvCodec
Failed to build PyNvCodec
ERROR: Could not build wheels for PyNvCodec, which is required to install pyproject.toml-based projects
Path to FFMpeg is crippled. Here's how it looks in your log file:
-DFFMPEG_ROOT=C:Userstyleranaconda3envsai_model_server_experimentLibraryffmpeg
It happens because you use backward slashes:
$env:SKBUILD_CONFIGURE_OPTIONS="-DFFMPEG_ROOT=C:\Users\tyler\anaconda3\envs\ai_model_server_experiment\Library\ffmpeg
Please use forward slashes instead:
set SKBUILD_CONFIGURE_OPTIONS="-DFFMPEG_ROOT=D:/install/ffmpeg-master-latest-win64-gpl-shared"
Path to FFMpeg is crippled. Here's how it looks in your log file:
-DFFMPEG_ROOT=C:Userstyleranaconda3envsai_model_server_experimentLibraryffmpeg
It happens because you use backward slashes:
$env:SKBUILD_CONFIGURE_OPTIONS="-DFFMPEG_ROOT=C:\Users\tyler\anaconda3\envs\ai_model_server_experiment\Library\ffmpeg
Please use forward slashes instead:
set SKBUILD_CONFIGURE_OPTIONS="-DFFMPEG_ROOT=D:/install/ffmpeg-master-latest-win64-gpl-shared"
That did it. The install succeeds now. What a classic mistake. Thanks for the help debugging this!
You're welcome )
You're welcome )
One last question, is PytorchNvCodec no longer supported? I see it mentioned in the README still. If its no longer supported, is there any documentation on the new recommended flow with Pytorch?
I see it mentioned in the README still
It's my mistake, I forgot to cleanup the readme.
PytorchNvCodec
is dead because VALI now supportsDLPack
specification and can share the memory with torch.
is there any documentation on the new recommended flow with Pytorch?
You can follow torch segmentation unit test: https://github.com/RomanArzumanyan/VALI/blob/03079c5d1ba4baf6903a08b5be7f80eceb66f7aa/tests/test_TorchSegmentation.py#L226-L231
Basically all VALI unit tests are written with lots of comments, one can follow them as samples.
Also there's an API documentation, you can find the link on the repo main page.
I see it mentioned in the README still
It's my mistake, I forgot to cleanup the readme.
PytorchNvCodec
is dead because VALI now supportsDLPack
specification and can share the memory with torch.is there any documentation on the new recommended flow with Pytorch?
You can follow torch segmentation unit test:
Basically all VALI unit tests are written with lots of comments, one can follow them as samples.
Also there's an API documentation, you can find the link on the repo main page.
That's awesome that they now share the memory. I'll look around in there. Thanks for the help!
I've followed the windows installation steps exactly but I'm running into issues when trying to build VALI on windows: