Open JeanChristopheMorinPerso opened 1 year ago
I'm getting the same error where the traceback is slightly different (maybe a different conda-build version): an output of a multi-output package has been skipped because of the --skip-existing
flag, and then this is ignored in later stages of conda-build. It looks like the conda-package-handling conversion step is causing the error, and also there would be an error in anaconda upload if anaconda_upload
was set:
INFO # Automatic uploading is disabled
INFO # If you want to upload package(s) to anaconda.org later, type:
INFO
INFO
INFO # To have conda build upload to anaconda.org automatically, use
INFO # conda config --set anaconda_upload yes
INFO anaconda upload \
INFO /upload/linux-64/_mutex_mxnet-0.0.50-openblas.tar.bz2 \
INFO /upload/linux-64/libmxnet-1.9.1-openblas_h8848447_1.tar.bz2 \
INFO /upload/linux-64/mxnet-openblas-1.9.1-h687809c_0.tar.bz2 \
INFO /upload/linux-64/py-mxnet-1.9.1-py311h7bb801d_1.tar.bz2 \
INFO /upload/linux-64/py-mxnet-1.9.1-py310h04ad4eb_1.tar.bz2 \
INFO /upload/linux-64/py-mxnet-1.9.1-py38h04ad4eb_1.tar.bz2 \
INFO /upload/linux-64/py-mxnet-1.9.1-py39h04ad4eb_1.tar.bz2 \
INFO /upload/linux-64/mxnet-1.9.1-h06a4308_1.tar.bz2
INFO anaconda_upload is not set. Not uploading wheels: []
INFO Traceback (most recent call last):
INFO File "/opt/conda/lib/python3.9/site-packages/conda_package_handling/streaming.py", line 32, in _extract
INFO with open(filename, "rb") as fileobj:
INFO FileNotFoundError: [Errno 2] No such file or directory: '/upload/linux-64/_mutex_mxnet-0.0.50-openblas.tar.bz2'
INFO
INFO The above exception was the direct cause of the following exception:
INFO
INFO Traceback (most recent call last):
INFO File "/opt/conda/bin/conda-build", line 11, in <module>
INFO sys.exit(main())
INFO File "/opt/conda/lib/python3.9/site-packages/conda_build/cli/main_build.py", line 495, in main
INFO execute(sys.argv[1:])
INFO File "/opt/conda/lib/python3.9/site-packages/conda_build/cli/main_build.py", line 475, in execute
INFO outputs = api.build(
INFO File "/opt/conda/lib/python3.9/site-packages/conda_build/api.py", line 180, in build
INFO return build_tree(
INFO File "/opt/conda/lib/python3.9/site-packages/conda_build/build.py", line 3228, in build_tree
INFO hash_inputs = get_hash_input(tarballs)
INFO File "/opt/conda/lib/python3.9/site-packages/conda_build/inspect_pkg.py", line 342, in get_hash_input
INFO hash_input = package_has_file(pkg, 'info/hash_input.json')
INFO File "/opt/conda/lib/python3.9/site-packages/conda_build/utils.py", line 1201, in package_has_file
INFO conda_package_handling.api.extract(
INFO File "/opt/conda/lib/python3.9/site-packages/conda_package_handling/api.py", line 77, in extract
INFO format.extract(fn, dest_dir, components=components)
INFO File "/opt/conda/lib/python3.9/site-packages/conda_package_handling/tarball.py", line 73, in extract
INFO streaming._extract(str(fn), str(dest_dir), components=["pkg"])
INFO File "/opt/conda/lib/python3.9/site-packages/conda_package_handling/streaming.py", line 42, in _extract
INFO raise exceptions.InvalidArchiveError(filename, f"failed with error: {str(e)}") from e
INFO conda_package_handling.exceptions.InvalidArchiveError: Error with archive /upload/linux-64/_mutex_mxnet-0.0.50-openblas.tar.bz2. You probably need to delete and re-download or re-create this file. Message was:
INFO
INFO failed with error: [Errno 2] No such file or directory: '/upload/linux-64/_mutex_mxnet-0.0.50-openblas.tar.bz2'
I've hit this again: https://github.com/AnacondaRecipes/vs2019-feedstock/pull/2 This time due to a subpackage having an independent build number
INFO [DEBUG:VsDevCmd.bat] Sending telemetry
INFO [DEBUG:core\vsdevcmd_end] initializing with arguments ''
INFO [DEBUG:VsDevCmd] Writing post-execution environment to C:\cygwin64\tmp\dd_vsdevcmd16_env.log
INFO [vcvarsall.bat] Environment initialized for: 'x64'
INFO usage: cl [ option... ] filename... [ /link linkoption... ]
INFO
INFO Resource usage statistics from testing vs2019_win-64:
INFO Process count: 1
INFO CPU time: Sys=0:00:00.3, User=0:00:00.2
INFO Memory: 6.9M
INFO Disk usage: 723B
INFO Time elapsed: 0:00:04.1
INFO
INFO
INFO TEST END: C:\b\abs_e8f6qtqave\upload\win-64\vs2019_win-64-19.29.30154-h96f319f_4.tar.bz2
INFO Renaming work directory 'C:\b\abs_e8f6qtqave\croot\vs_activation_and_runtime_1719526468325\work' to
'C:\b\abs_e8f6qtqave\croot\vs_activation_and_runtime_1719526468325\work_moved_vs_activation_and_runtime-1.0.0-haa95532_4_win-64_main_build_loop'
INFO shutil.move(work)=C:\b\abs_e8f6qtqave\croot\vs_activation_and_runtime_1719526468325\work,
dest=C:\b\abs_e8f6qtqave\croot\vs_activation_and_runtime_1719526468325\work_moved_vs_activation_and_runtime-1.0.0-haa95532_4_win-64_main_build_loop)
INFO
INFO # >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<
INFO
INFO Traceback (most recent call last):
INFO File "C:\miniconda3\lib\site-packages\conda_package_handling\streaming.py", line 28, in _stream_components
INFO with open(filename, "rb") as fileobj:
INFO FileNotFoundError: [Errno 2] No such file or directory: 'C:\\b\\abs_e8f6qtqave\\upload\\win-64\\vc-14.2-h2eaa2aa_1.tar.bz2'
INFO
INFO The above exception was the direct cause of the following exception:
INFO
INFO Traceback (most recent call last):
INFO File "C:\miniconda3\lib\site-packages\conda\exception_handler.py", line 18, in __call__
INFO return func(*args, **kwargs)
INFO File "C:\miniconda3\lib\site-packages\conda\cli\main.py", line 84, in main_subshell
INFO exit_code = do_call(args, parser)
INFO File "C:\miniconda3\lib\site-packages\conda\cli\conda_argparse.py", line 176, in do_call
06/27/24 18:16:20 INFO result = plugin_subcommand.action(getattr(args, "_args", args))
INFO File "C:\miniconda3\lib\site-packages\conda_build\plugin.py", line 17, in build
INFO return execute(args)
INFO File "C:\miniconda3\lib\site-packages\conda_build\cli\main_build.py", line 590, in execute
INFO api.build(
INFO File "C:\miniconda3\lib\site-packages\conda_build\api.py", line 250, in build
INFO return build_tree(
INFO File "C:\miniconda3\lib\site-packages\conda_build\build.py", line 3862, in build_tree
INFO hash_inputs = get_hash_input(tarballs)
INFO File "C:\miniconda3\lib\site-packages\conda_build\inspect_pkg.py", line 351, in get_hash_input
INFO hash_input = package_has_file(pkg, "info/hash_input.json")
INFO File "C:\miniconda3\lib\site-packages\conda_build\utils.py", line 1140, in package_has_file
INFO conda_package_handling.api.extract(
INFO File "C:\miniconda3\lib\site-packages\conda_package_handling\api.py", line 77, in extract
INFO format.extract(fn, dest_dir, components=components)
INFO File "C:\miniconda3\lib\site-packages\conda_package_handling\tarball.py", line 70, in extract
INFO streaming._extract(str(fn), str(dest_dir), components=["pkg"])
INFO File "C:\miniconda3\lib\site-packages\conda_package_handling\streaming.py", line 51, in _extract
INFO for stream in _stream_components(filename, components, dest_dir=dest_dir):
INFO File "C:\miniconda3\lib\site-packages\conda_package_handling\streaming.py", line 37, in _stream_components
INFO raise exceptions.InvalidArchiveError(filename, f"failed with error: {str(e)}") from e
INFO conda_package_handling.exceptions.InvalidArchiveError: Error with archive C:\b\abs_e8f6qtqave\upload\win-64\vc-14.2-h2eaa2aa_1.tar.bz2. You probably need to delete and re-download or re-create this
file. Message was:
INFO
INFO failed with error: [Errno 2] No such file or directory: 'C:\\b\\abs_e8f6qtqave\\upload\\win-64\\vc-14.2-h2eaa2aa_1.tar.bz2'
INFO
INFO `$ C:\miniconda3\Scripts\conda-script.py build C:\b\abs_e8f6qtqave\clone\recipe --output-folder C:\b\abs_e8f6qtqave\upload --cache-dir C:\b\abs_e8f6qtqave\src_cache --extra-meta
sha=c054a4b96060d76364aa064d356ed3469d7d6739 remote_url=git@github.com:AnacondaRecipes/vs2019-feedstock.git flow_run_id=e8c272f9-ae9c-4ea8-9278-af3d58182d4a --suppress-variables --skip-existing
--error-overlinking --croot C:\b\abs_e8f6qtqave\croot`
INFO
INFO environment variables:
INFO CIO_TEST=<not set>
INFO CONDA_ALLOW_SOFTLINKS=false
INFO CONDA_DEFAULT_ENV=base
INFO CONDA_EXE=C:\miniconda3\Scripts\conda.exe
INFO CONDA_PKGS_DIRS=C:\b\abs_e8f6qtqave\pkg_dirs
INFO CONDA_PREFIX=C:\miniconda3
INFO CONDA_PROMPT_MODIFIER=(base)
INFO CONDA_PYTHON_EXE=C:\miniconda3\python.exe
INFO CONDA_REPODATA_USE_ZST=false
INFO CONDA_ROOT=C:\miniconda3
INFO CONDA_SHLVL=1
INFO CURL_CA_BUNDLE=<not set>
INFO INFOPATH=/usr/local/info:/usr/share/info:/usr/info
INFO LD_PRELOAD=<not set>
INFO ORIGINAL_PATH=/cygdrive/c/miniconda3:/cygdrive/c/miniconda3/Library/mingw-w64/bin:/c
INFO ygdrive/c/miniconda3/Library/usr/bin:/cygdrive/c/miniconda3/Library/bi
INFO n:/cygdrive/c/miniconda3/Scripts:/cygdrive/c/miniconda3/bin:/cygdrive/
INFO c/miniconda3/condabin:/cygdrive/c/Program Files
INFO (x86)/Intel/oneAPI/tbb/latest/redist/intel64/vc_mt:/cygdrive/c/Program
INFO Files
INFO (x86)/Intel/oneAPI/tbb/latest/redist/ia32/vc_mt:/cygdrive/c/Program
INFO Files (x86)/Intel/oneAPI/mpi/latest/bin:/cygdrive/c/Program Files
INFO (x86)/Intel/oneAPI/mpi/latest/bin/release:/cygdrive/c/Program Files
INFO (x86)/Intel/oneAPI/mpi/latest/libfabric/bin:/cygdrive/c/Program Files
INFO (x86)/Intel/oneAPI/mpi/latest/libfabric/bin/utils:/cygdrive/c/Program
INFO Files (x86)/Intel/oneAPI/compiler/latest/windows/redist/intel64_win/co
06/27/24 18:16:21 INFO mpiler:/cygdrive/c/Program Files (x86)/Intel/oneAPI/compiler/latest/wi
INFO ndows/redist/ia32_win/compiler:/cygdrive/c/Windows/system32:/cygdrive/
INFO c/Windows:/cygdrive/c/Windows/System32/Wbem:/cygdrive/c/Windows/System
INFO 32/WindowsPowerShell/v1.0:/cygdrive/c/Windows/System32/OpenSSH:/cygdri
INFO ve/c/Program Files/Amazon/cfn-
INFO bootstrap:/cygdrive/c/ProgramData/chocolatey/bin:/cygdrive/c/Program
INFO Files/Amazon/AWSCLIV2:/cygdrive/c/Program Files/OpenSSH-
INFO Win64:/cygdrive/c/Users/builder-
INFO admin/AppData/Local/Microsoft/WindowsApps:/cygdrive/c/Users/builder-
INFO admin/.dotnet/tools
INFO PATH=C:\cygwin64\usr\local\bin;C:\cygwin64\bin;C:\miniconda3;C:\miniconda3\
INFO Library\mingw-w64\bin;C:\miniconda3\Library\usr\bin;C:\miniconda3\Libr
INFO ary\bin;C:\miniconda3\Scripts;C:\miniconda3\bin;C:\miniconda3\condabin
INFO ;C:\Program Files
INFO (x86)\Intel\oneAPI\tbb\latest\redist\intel64\vc_mt;C:\Program Files
INFO (x86)\Intel\oneAPI\tbb\latest\redist\ia32\vc_mt;C:\Program Files
INFO (x86)\Intel\oneAPI\mpi\latest\bin;C:\Program Files
INFO (x86)\Intel\oneAPI\mpi\latest\bin\release;C:\Program Files
INFO (x86)\Intel\oneAPI\mpi\latest\libfabric\bin;C:\Program Files
INFO (x86)\Intel\oneAPI\mpi\latest\libfabric\bin\utils;C:\Program Files (x8
INFO 6)\Intel\oneAPI\compiler\latest\windows\redist\intel64_win\compiler;C:
INFO \Program Files (x86)\Intel\oneAPI\compiler\latest\windows\redist\ia32_
INFO win\compiler;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C
INFO :\Windows\System32\WindowsPowerShell\v1.0;C:\Windows\System32\OpenSSH;
INFO C:\Program Files\Amazon\cfn-
INFO bootstrap;C:\ProgramData\chocolatey\bin;C:\Program
INFO Files\Amazon\AWSCLIV2;C:\Program Files\OpenSSH-Win64;C:\Users\builder-
INFO admin\AppData\Local\Microsoft\WindowsApps;C:\Users\builder-
INFO admin\.dotnet\tools
INFO PSMODULEPATH=C:\Users\builder-admin\Documents\WindowsPowerShell\Modules;C:\Windows\
INFO system32\WindowsPowerShell\v1.0\Modules;C:\Program
INFO Files\WindowsPowerShell\Modules
INFO PYTHONPATH=C:\prefect
INFO REQUESTS_CA_BUNDLE=<not set>
INFO SSL_CERT_FILE=C:\miniconda3\Library\ssl\cacert.pem
INFO
INFO active environment : base
INFO active env location : C:\miniconda3
INFO shell level : 1
INFO user config file : C:\Users\builder-admin\.condarc
INFO populated config files : C:\miniconda3\.condarc
INFO C:\Users\builder-admin\.condarc
INFO conda version : 24.5.0
INFO conda-build version : 24.5.1
INFO python version : 3.9.18.final.0
INFO solver : libmamba (default)
INFO virtual packages : __archspec=1=skylake_avx512
INFO __conda=24.5.0=0
INFO __win=0=0
INFO base environment : C:\miniconda3 (writable)
INFO conda av data dir : C:\miniconda3\etc\conda
INFO conda av metadata url : None
INFO channel URLs : https://repo.anaconda.com/pkgs/main/win-64
INFO https://repo.anaconda.com/pkgs/main/noarch
INFO https://repo.anaconda.com/pkgs/r/win-64
INFO https://repo.anaconda.com/pkgs/r/noarch
06/27/24 18:16:22 INFO https://repo.anaconda.com/pkgs/msys2/win-64
INFO https://repo.anaconda.com/pkgs/msys2/noarch
INFO package cache : C:\b\abs_e8f6qtqave\pkg_dirs
INFO envs directories : C:\miniconda3\envs
INFO C:\Users\builder-admin\.conda\envs
INFO C:\Users\builder-admin\AppData\Local\conda\conda\envs
INFO platform : win-64
INFO user-agent : conda/24.5.0 requests/2.32.2 CPython/3.9.18 Windows/10 Windows/10.0.17763 solver/libmamba conda-libmamba-solver/24.1.0 libmambapy/1.5.8
INFO administrator : True
INFO netrc file : None
INFO offline mode : False
INFO
INFO
INFO An unexpected error has occurred. Conda has prepared the above report.
INFO If you suspect this error is being caused by a malfunctioning plugin,
INFO consider using the --no-plugins option to turn off plugins.
INFO
INFO Example: conda --no-plugins install <package>
INFO
INFO Alternatively, you can set the CONDA_NO_PLUGINS environment variable on
INFO the command line to run the command without plugins enabled.
INFO
INFO Example: CONDA_NO_PLUGINS=true conda install <package>
INFO
INFO # Automatic uploading is disabled
INFO # If you want to upload package(s) to anaconda.org later, type:
INFO
INFO
INFO # To have conda build upload to anaconda.org automatically, use
INFO # $ conda config --set anaconda_upload yes
INFO anaconda upload ^
INFO C:\b\abs_e8f6qtqave\upload\win-64\vs2015_runtime-14.29.30133-h43f2093_4.tar.bz2 ^
INFO C:\b\abs_e8f6qtqave\upload\win-64\vs2019_win-64-19.29.30154-h96f319f_4.tar.bz2 ^
INFO C:\b\abs_e8f6qtqave\upload\win-64\vc-14.2-h2eaa2aa_1.tar.bz2
ERROR Command failed with exit code 1
Checklist
What happened?
In https://github.com/AnacondaRecipes/pybind11-feedstock/pull/14, conda-build fails during the upload with
FileNotFoundError: [Errno 2] No such file or directory: '/upload/noarch/pybind11-abi-4-hd3eb1b0_0.tar.bz2
.pybind11-abi-4
already exists in defaults, so conda-build skips it and then fails to upload it (since it was skipped).In the logs:
Conda Info
Conda Config
Conda list
Additional Context
No response