Open beckermr opened 4 years ago
cc @jjhelmus @leofang @isuruf
Note that mamba seems to come to a different solution
(base) root@53232016349f:/# mamba create -n mpi_test2 -c conda-forge python=3.7 openmpi openmpi-mpicc
__ __ __ __
/ \ / \ / \ / \
/ \/ \/ \/ \
███████████████/ /██/ /██/ /██/ /████████████████████████
/ / \ / \ / \ / \ \____
/ / \_/ \_/ \_/ \ o \__,
/ _/ \_____/ `
|/
███╗ ███╗ █████╗ ███╗ ███╗██████╗ █████╗
████╗ ████║██╔══██╗████╗ ████║██╔══██╗██╔══██╗
██╔████╔██║███████║██╔████╔██║██████╔╝███████║
██║╚██╔╝██║██╔══██║██║╚██╔╝██║██╔══██╗██╔══██║
██║ ╚═╝ ██║██║ ██║██║ ╚═╝ ██║██████╔╝██║ ██║
╚═╝ ╚═╝╚═╝ ╚═╝╚═╝ ╚═╝╚═════╝ ╚═╝ ╚═╝
mamba (0.5.1) supported by @QuantStack
GitHub: https://github.com/TheSnakePit/mamba
Twitter: https://twitter.com/QuantStack
█████████████████████████████████████████████████████████████
conda-forge/noarch [====================] (00m:01s) Done
conda-forge/linux-64 [====================] (00m:02s) Done
Looking for: ['python=3.7', 'openmpi', 'openmpi-mpicc']
Transaction
Prefix: /opt/conda/envs/mpi_test2
Updating specs:
- python==3.7
- openmpi
- openmpi-mpicc
Package Version Build Channel Size
───────────────────────────────────────────────────────────────────────────────────────────
Install:
───────────────────────────────────────────────────────────────────────────────────────────
_libgcc_mutex 0.1 conda_forge conda-forge/linux-64 3 KB
_openmp_mutex 4.5 1_gnu conda-forge/linux-64 22 KB
binutils_impl_linux-64 2.34 h2122c62_9 conda-forge/linux-64 9 MB
binutils_linux-64 2.34 h47ac705_27 conda-forge/linux-64 22 KB
ca-certificates 2020.6.20 hecda079_0 conda-forge/linux-64 Cached
certifi 2020.6.20 py37hc8dfbb8_0 conda-forge/linux-64 Cached
gcc_impl_linux-64 7.5.0 hdb87b24_16 conda-forge/linux-64 38 MB
gcc_linux-64 7.5.0 hf34d7eb_27 conda-forge/linux-64 23 KB
kernel-headers_linux-64 2.6.32 h77966d4_13 conda-forge/noarch 707 KB
ld_impl_linux-64 2.34 hc38a660_9 conda-forge/linux-64 612 KB
libffi 3.2.1 he1b5a44_1007 conda-forge/linux-64 47 KB
libgcc-devel_linux-64 7.5.0 h42c25f5_16 conda-forge/linux-64 4 MB
libgcc-ng 9.3.0 h24d8f2e_16 conda-forge/linux-64 8 MB
libgfortran-ng 7.5.0 hdf63c60_16 conda-forge/linux-64 1 MB
libgomp 9.3.0 h24d8f2e_16 conda-forge/linux-64 378 KB
libstdcxx-ng 9.3.0 hdf63c60_16 conda-forge/linux-64 4 MB
mpi 1.0 openmpi conda-forge/linux-64 4 KB
ncurses 6.2 he1b5a44_1 conda-forge/linux-64 993 KB
openmpi 4.0.5 hdf1f1ad_1 conda-forge/linux-64 4 MB
openmpi-mpicc 4.0.5 h516909a_1 conda-forge/linux-64 8 KB
openssl 1.1.1g h516909a_1 conda-forge/linux-64 Cached
pip 20.2.3 py_0 conda-forge/noarch 1 MB
python 3.7.8 h425cb1d_1_cpython conda-forge/linux-64 53 MB
python_abi 3.7 1_cp37m conda-forge/linux-64 Cached
readline 8.0 he28a2e2_2 conda-forge/linux-64 281 KB
setuptools 49.6.0 py37hc8dfbb8_0 conda-forge/linux-64 948 KB
sqlite 3.33.0 h4cf870e_0 conda-forge/linux-64 1 MB
sysroot_linux-64 2.12 h77966d4_13 conda-forge/noarch 30 MB
tk 8.6.10 hed695b0_0 conda-forge/linux-64 3 MB
wheel 0.35.1 pyh9f0ad1d_0 conda-forge/noarch 29 KB
xz 5.2.5 h516909a_1 conda-forge/linux-64 343 KB
zlib 1.2.11 h516909a_1009 conda-forge/linux-64 106 KB
Summary:
Install: 32 packages
Total download: 162 MB
───────────────────────────────────────────────────────────────────────────────────────────
Confirm changes: [Y/n]
I think this is because mamba always maximizes build number ahead of other things? @wolfv any comments here?
A workaround for this issue is to use strict channel priority.
strict channel priority does not appear to solve this issue
(base) root@1b942bcdbb53:/# conda config --show
add_anaconda_token: True
add_pip_as_python_dependency: True
aggressive_update_packages:
- ca-certificates
- certifi
- openssl
allow_conda_downgrades: False
allow_cycles: True
allow_non_channel_urls: False
allow_softlinks: False
always_copy: False
always_softlink: False
always_yes: None
anaconda_upload: None
auto_activate_base: True
auto_stack: 0
auto_update_conda: True
bld_path:
changeps1: True
channel_alias: https://conda.anaconda.org
channel_priority: strict
channels:
- https://conda.anaconda.org/conda-forge
client_ssl_cert: None
client_ssl_cert_key: None
clobber: False
conda_build: {}
create_default_packages: []
croot: /opt/conda/conda-bld
custom_channels:
pkgs/main: https://repo.anaconda.com
pkgs/r: https://repo.anaconda.com
pkgs/pro: https://repo.anaconda.com
custom_multichannels:
defaults:
- https://repo.anaconda.com/pkgs/main
- https://repo.anaconda.com/pkgs/r
local:
debug: False
default_channels:
- https://repo.anaconda.com/pkgs/main
- https://repo.anaconda.com/pkgs/r
default_python: 3.7
default_threads: None
deps_modifier: not_set
dev: False
disallowed_packages: []
download_only: False
dry_run: False
enable_private_envs: False
env_prompt: ({default_env})
envs_dirs:
- /opt/conda/envs
- /root/.conda/envs
error_upload_url: https://conda.io/conda-post/unexpected-error
execute_threads: 1
extra_safety_checks: False
force: False
force_32bit: False
force_reinstall: False
force_remove: False
ignore_pinned: False
json: False
local_repodata_ttl: 1
migrated_channel_aliases: []
migrated_custom_channels: {}
non_admin_enabled: True
notify_outdated_conda: True
offline: False
override_channels_enabled: True
path_conflict: clobber
pinned_packages: []
pip_interop_enabled: False
pkgs_dirs:
- /opt/conda/pkgs
- /root/.conda/pkgs
proxy_servers: {}
quiet: False
remote_backoff_factor: 1
remote_connect_timeout_secs: 9.15
remote_max_retries: 3
remote_read_timeout_secs: 60.0
repodata_fns:
- current_repodata.json
- repodata.json
repodata_threads: None
report_errors: None
restore_free_channel: False
rollback_enabled: True
root_prefix: /opt/conda
safety_checks: warn
sat_solver: pycosat
separate_format_cache: False
shortcuts: True
show_channel_urls: None
solver_ignore_timestamps: False
ssl_verify: True
subdir: linux-64
subdirs:
- linux-64
- noarch
target_prefix_override:
track_features: []
unsatisfiable_hints: True
unsatisfiable_hints_check_depth: 2
update_modifier: update_specs
use_index_cache: False
use_local: False
use_only_tar_bz2: False
verbosity: 0
verify_threads: 1
whitelist_channels: []
(base) root@1b942bcdbb53:/# conda create -n mpi_test2 -c conda-forge python=3.7 openmpi openmpi-mpicc
Collecting package metadata (current_repodata.json): done
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done
## Package Plan ##
environment location: /opt/conda/envs/mpi_test2
added / updated specs:
- openmpi
- openmpi-mpicc
- python=3.7
The following packages will be downloaded:
package | build
---------------------------|-----------------
_libgcc_mutex-0.1 | conda_forge 3 KB conda-forge
_openmp_mutex-4.5 | 1_gnu 22 KB conda-forge
binutils_impl_linux-64-2.34| h2122c62_9 9.2 MB conda-forge
binutils_linux-64-2.34 | h47ac705_27 22 KB conda-forge
gcc_impl_linux-64-7.5.0 | hda68d29_13 42.7 MB conda-forge
gcc_linux-64-7.5.0 | hf34d7eb_27 23 KB conda-forge
kernel-headers_linux-64-2.6.32| h77966d4_13 707 KB conda-forge
ld_impl_linux-64-2.34 | hc38a660_9 612 KB conda-forge
libffi-3.2.1 | he1b5a44_1007 47 KB conda-forge
libgcc-ng-9.3.0 | h24d8f2e_16 7.8 MB conda-forge
libgfortran-ng-7.5.0 | hdf63c60_16 1.3 MB conda-forge
libgomp-9.3.0 | h24d8f2e_16 378 KB conda-forge
libstdcxx-ng-9.3.0 | hdf63c60_16 4.0 MB conda-forge
mpi-1.0 | openmpi 4 KB conda-forge
openmpi-4.0.5 | hdf1f1ad_1 3.9 MB conda-forge
openmpi-mpicc-4.0.5 | h516909a_1 8 KB conda-forge
pip-20.2.3 | py_0 1.1 MB conda-forge
python-3.7.8 |h6f2ec95_1_cpython 53.1 MB conda-forge
readline-8.0 | he28a2e2_2 281 KB conda-forge
setuptools-49.6.0 | py37hc8dfbb8_0 948 KB conda-forge
sysroot_linux-64-2.12 | h77966d4_13 30.2 MB conda-forge
tk-8.6.10 | hed695b0_0 3.2 MB conda-forge
wheel-0.35.1 | pyh9f0ad1d_0 29 KB conda-forge
zlib-1.2.11 | h516909a_1009 106 KB conda-forge
------------------------------------------------------------
Total: 159.7 MB
The following NEW packages will be INSTALLED:
_libgcc_mutex conda-forge/linux-64::_libgcc_mutex-0.1-conda_forge
_openmp_mutex conda-forge/linux-64::_openmp_mutex-4.5-1_gnu
binutils_impl_lin~ conda-forge/linux-64::binutils_impl_linux-64-2.34-h2122c62_9
binutils_linux-64 conda-forge/linux-64::binutils_linux-64-2.34-h47ac705_27
ca-certificates conda-forge/linux-64::ca-certificates-2020.6.20-hecda079_0
certifi conda-forge/linux-64::certifi-2020.6.20-py37hc8dfbb8_0
gcc_impl_linux-64 conda-forge/linux-64::gcc_impl_linux-64-7.5.0-hda68d29_13
gcc_linux-64 conda-forge/linux-64::gcc_linux-64-7.5.0-hf34d7eb_27
kernel-headers_li~ conda-forge/noarch::kernel-headers_linux-64-2.6.32-h77966d4_13
ld_impl_linux-64 conda-forge/linux-64::ld_impl_linux-64-2.34-hc38a660_9
libffi conda-forge/linux-64::libffi-3.2.1-he1b5a44_1007
libgcc-ng conda-forge/linux-64::libgcc-ng-9.3.0-h24d8f2e_16
libgfortran-ng conda-forge/linux-64::libgfortran-ng-7.5.0-hdf63c60_16
libgomp conda-forge/linux-64::libgomp-9.3.0-h24d8f2e_16
libstdcxx-ng conda-forge/linux-64::libstdcxx-ng-9.3.0-hdf63c60_16
mpi conda-forge/linux-64::mpi-1.0-openmpi
ncurses conda-forge/linux-64::ncurses-6.2-he1b5a44_1
openmpi conda-forge/linux-64::openmpi-4.0.5-hdf1f1ad_1
openmpi-mpicc conda-forge/linux-64::openmpi-mpicc-4.0.5-h516909a_1
openssl conda-forge/linux-64::openssl-1.1.1g-h516909a_1
pip conda-forge/noarch::pip-20.2.3-py_0
python conda-forge/linux-64::python-3.7.8-h6f2ec95_1_cpython
python_abi conda-forge/linux-64::python_abi-3.7-1_cp37m
readline conda-forge/linux-64::readline-8.0-he28a2e2_2
setuptools conda-forge/linux-64::setuptools-49.6.0-py37hc8dfbb8_0
sqlite conda-forge/linux-64::sqlite-3.33.0-h4cf870e_0
sysroot_linux-64 conda-forge/noarch::sysroot_linux-64-2.12-h77966d4_13
tk conda-forge/linux-64::tk-8.6.10-hed695b0_0
wheel conda-forge/noarch::wheel-0.35.1-pyh9f0ad1d_0
xz conda-forge/linux-64::xz-5.2.5-h516909a_1
zlib conda-forge/linux-64::zlib-1.2.11-h516909a_1009
Proceed ([y]/n)?
in otherwords, the offending builds are ours.
cc @isuruf
yep, mamba always prefers higher build numbers if there is no conflict.
@beckermr, you are talking about a different issue than @leofang who was talking about pulling in a gcc build with the old sysroot.
Ahhhhhhh! Thank you @isuruf!
To reproduce @leofang's issue, you need to add defaults
and then have flexible
channel priority
Right. I do think the separate issue here matters though. Any thoughts?
I agree, but that's not the most pressing issue right now.
Sure. I am not in a rush either. I just wanted to make sure this issue should remain open.
Issue:
The solver doesn't appear to pull the latest build
Here is what is available.
When you specify
gcc_impl_linux-64=7.5.0
at the command line, it works correctly.Note that builds past 13 have extra and more complicated deps due to the cross-compiling PRs.
The columns here are the package, constrains and depends.
Environment (
conda list
):Details about
conda
and system (conda info
):