search

moj-analytical-services / docker-conda-base

Base conda docker image with some packages installed
MIT License
0 stars 1 forks source link

Fails to build (maybe doesn't matter) #5

Open RobinL opened 5 years ago

RobinL commented 5 years ago

This problem seems to have reared its head again slightly differently

What i did

git clone git@github.com:moj-analytical-services/docker-conda-base.git
cd docker-conda-base
docker build -t conda-base .

Error:

Collecting package metadata: ...working... done
Solving environment: ...working... failed

ResolvePackageNotFound:
  - r-pillar==1.4.0=h6115d3f_0

The command '/bin/bash -c conda env update --file environment.yaml -n base' returned a non-zero code: 1

ALso note:

Step 4/7 : RUN conda search r-pillar
 ---> Running in ff963a2ca9f9
Loading channels: ...working... done
# Name                       Version           Build  Channel             
r-pillar                       1.0.1 mro343h889e2dd_0  pkgs/r              
r-pillar                       1.0.1  r343h889e2dd_0  pkgs/r              
r-pillar                       1.2.1  r350h912f1d8_0  pkgs/r              
r-pillar                       1.2.3 mro350h576908c_0  pkgs/r              
r-pillar                       1.3.0 mro351hf348343_0  pkgs/r              
r-pillar                       1.3.0  r351h6115d3f_0  pkgs/r              
r-pillar                       1.3.1   r36h6115d3f_0  pkgs/r

Happy to try and fix this but not sure best way to start. I can't figure out how I can 'get into' the environment (given it fails to build'), which means I can't issue a conda install --update r-pillar and then re-export the environment.

Also conscious it might not matter - presumably we can just import your built image in new work and then conda install on top...

RobinL commented 5 years ago

I manually edited the environment to add in a r-pillar that is currently found but now I get:

UnsatisfiableError: The following specifications were found to be in conflict:
  - r-pillar==1.3.0=r351h6115d3f_0
  - r-tibble==2.0.1=r351h96ca727_0 -> r-pillar[version='>=1.3.1']
Use "conda search <package> --info" to see the dependencies for each package.

oddly, that r-tibble seems to no longer exist:

Step 4/7 : RUN conda search r-tibble
 ---> Running in 41bfc9a944a9
Loading channels: ...working... done
# Name                       Version           Build  Channel             
r-tibble                         1.0        r3.3.1_0  pkgs/r              
r-tibble                         1.2        r3.3.1_0  pkgs/r              
r-tibble                         1.2        r3.3.2_0  pkgs/r              
r-tibble                       1.3.3        r3.4.1_0  pkgs/r              
r-tibble                       1.3.4  r342h041fa31_0  pkgs/r              
r-tibble                       1.4.1 mro343h086d26f_0  pkgs/r              
r-tibble                       1.4.1  r343h086d26f_0  pkgs/r              
r-tibble                       1.4.2 mro350hbc2858b_0  pkgs/r              
r-tibble                       1.4.2 mro351hd10c6a6_0  pkgs/r              
r-tibble                       1.4.2  r350hb353451_0  pkgs/r              
r-tibble                       1.4.2  r351h96ca727_0  pkgs/r              
r-tibble                       2.1.1   r36h96ca727_0  pkgs/r
RobinL commented 5 years ago

This seems relevant: https://stackoverflow.com/a/53592767/1779128

RobinL commented 5 years ago

Could it be because my FROM continuumio/miniconda3 is later than yours? should we pin to sha?

RobinL commented 5 years ago

Or maybe we should use --no-builds with conda env export and let conda figure out dependency chain?

RobinL commented 5 years ago

I got rid of builds with find =[^=]+$ replace ` on theenvironment.yaml` and now it builds, here's the file:

name: base
channels:
  - moj-analytical-services
  - conda-forge
  - defaults
dependencies:
  - _libgcc_mutex=0.1=main
  - _r-mutex=1.0.0=anacondar_1
  - altair=2.3.0=py37_1001
  - arrow-cpp=0.12.0=py37h0e61e49_0
  - asn1crypto=0.24.0=py37_1003
  - attrs=18.2.0=py_0
  - binutils_impl_linux-64=2.28.1=had2808c_3
  - binutils_linux-64=7.2.0=had2808c_27
  - blas=1.0=mkl
  - boost-cpp=1.68.0=h11c811c_1000
  - boto=2.49.0=py_0
  - boto3=1.9.89=py_0
  - botocore=1.12.90=py_0
  - bwidget=1.9.11=0
  - bz2file=0.98=py_0
  - bzip2=1.0.6=h14c3975_1002
  - ca-certificates=2019.3.9=hecc5488_0
  - cairo=1.14.12=h80bd089_1005
  - certifi=2019.3.9=py37_0
  - cffi=1.11.5=py37h9745a5d_1001
  - chardet=3.0.4=py37_1003
  - conda=4.6.14=py37_0
  - cryptography=2.5=py37hb7f436b_1
  - curl=7.63.0=h646f8bb_1000
  - cython=0.29.4=py37hf484d3e_0
  - docutils=0.14=py37_1001
  - entrypoints=0.3=py37_1000
  - fontconfig=2.13.1=he4413a7_1000
  - freetype=2.9.1=he983fc9_1006
  - fribidi=1.0.5=h516909a_1002
  - gcc_impl_linux-64=7.2.0=habb00fd_3
  - gcc_linux-64=7.2.0=h550dcbe_27
  - gensim=3.5.0=py37h04863e7_1000
  - gettext=0.19.8.1=hc5be6a0_1002
  - gfortran_impl_linux-64=7.2.0=hdf63c60_3
  - gfortran_linux-64=7.2.0=h550dcbe_27
  - giflib=5.1.4=h14c3975_1001
  - glib=2.56.2=had28632_1001
  - graphite2=1.3.13=hf484d3e_1000
  - gsl=2.4=h294904e_1006
  - gxx_impl_linux-64=7.2.0=hdf63c60_3
  - gxx_linux-64=7.2.0=h550dcbe_27
  - harfbuzz=1.9.0=he243708_1001
  - icu=58.2=hf484d3e_1000
  - idna=2.7=py37_1002
  - intel-openmp=2019.1=144
  - jinja2=2.10.1=py_0
  - jmespath=0.9.3=py_1
  - jpeg=9c=h14c3975_1001
  - jsonschema=3.0.0a3=py37_1000
  - krb5=1.16.2=hc83ff2d_1000
  - libblas=3.8.0=10_mkl
  - libcblas=3.8.0=10_mkl
  - libcurl=7.63.0=h01ee5af_1000
  - libedit=3.1.20170329=hf8c457e_1001
  - libffi=3.2.1=he1b5a44_1006
  - libgcc-ng=8.2.0=hdf63c60_1
  - libgfortran-ng=7.3.0=hdf63c60_0
  - libiconv=1.15=h516909a_1005
  - libjpeg-turbo=2.0.1=h14c3975_1000
  - libpng=1.6.36=h84994c4_1000
  - libprotobuf=3.6.1=hdbcaa40_1001
  - libssh2=1.8.0=h1ad7b7a_1003
  - libstdcxx-ng=8.2.0=hdf63c60_1
  - libtiff=4.0.10=h648cc4a_1001
  - libuuid=2.32.1=h14c3975_1000
  - libxcb=1.13=h14c3975_1002
  - libxml2=2.9.9=h13577e0_2
  - lz4=2.1.9=py37hd79334b_0
  - lz4-c=1.8.3=he1b5a44_1001
  - make=4.2.1=h14c3975_2004
  - markupsafe=1.1.0=py37h14c3975_1000
  - mkl=2019.1=144
  - mkl_fft=1.0.10=py37h14c3975_1
  - mkl_random=1.0.2=py37h637b7d7_2
  - ncurses=6.1=hf484d3e_1002
  - nodejs=11.9.0=hf484d3e_0
  - numpy=1.15.4=py37h7e9f1db_0
  - numpy-base=1.15.4=py37hde5b4d6_0
  - openjpeg=2.3.0=hf38bd82_1003
  - openssl=1.0.2r=h14c3975_0
  - pandas=0.24.1=py37hf484d3e_0
  - pandoc=2.6=1
  - pango=1.40.14=hf0c64fd_1003
  - parquet-cpp=1.5.1=4
  - pcre=8.42=h439df22_0
  - pip=10.0.1=py37_0
  - pixman=0.34.0=h14c3975_1003
  - poppler=0.67.0=h2fc8fa2_1002
  - poppler-data=0.4.9=1
  - pthread-stubs=0.4=h14c3975_1001
  - pyarrow=0.12.0=py37hbbcf98d_2
  - pycosat=0.6.3=py37h14c3975_1001
  - pycparser=2.18=py_1
  - pyopenssl=18.0.0=py37_1000
  - pyrsistent=0.14.9=py37h14c3975_1000
  - pysocks=1.6.8=py37_1002
  - python=3.7.1=hd21baee_1000
  - python-dateutil=2.8.0=py_0
  - pytz=2018.9=py_0
  - r-assertthat=0.2.0=r351h6115d3f_1001
  - r-aws.ec2metadata=0.1.5=r351h6115d3f_1002
  - r-aws.s3=0.3.20=r35h6115d3f_1002
  - r-aws.signature=0.4.5=r351h6115d3f_1001
  - r-backports=1.1.3=r351h96ca727_1000
  - r-base=3.5.1=he45234b_1004
  - r-base64enc=0.1_3=r35hcdcec82_1003
  - r-bh=1.69.0_1=r35h6115d3f_1
  - r-bindr=0.1.1=r35h6115d3f_1002
  - r-bindrcpp=0.2.2=r35h0357c0b_1002
  - r-bitops=1.0_6=r35hcdcec82_1003
  - r-broom=0.5.1=r351h6115d3f_1000
  - r-callr=3.1.1=r351h6115d3f_1000
  - r-catools=1.17.1.1=r351h29659fb_1002
  - r-cellranger=1.1.0=r35h6115d3f_1002
  - r-cli=1.1.0=r35h6115d3f_1
  - r-clipr=0.5.0=r351h6115d3f_0
  - r-clisymbols=1.2.0=r35h6115d3f_1002
  - r-codetools=0.2_16=r35h6115d3f_1001
  - r-colorspace=1.4_0=r351h96ca727_0
  - r-crayon=1.3.4=r35h6115d3f_1002
  - r-curl=3.3=r35hcdcec82_1
  - r-data.table=1.12.0=r351h96ca727_0
  - r-dbi=1.0.0=r35h6115d3f_1002
  - r-dbplyr=1.3.0=r351h6115d3f_1000
  - r-desc=1.2.0=r35h6115d3f_1002
  - r-devtools=2.0.1=r351h6115d3f_1000
  - r-digest=0.6.18=r351h96ca727_1000
  - r-dplyr=0.7.8=r351h29659fb_1000
  - r-evaluate=0.12=r351h6115d3f_1000
  - r-fansi=0.4.0=r35hcdcec82_1001
  - r-feather=0.3.2=r351h29659fb_1000
  - r-forcats=0.3.0=r351h6115d3f_1001
  - r-formatr=1.5=r351h6115d3f_1001
  - r-fs=1.2.6=r351h29659fb_1000
  - r-generics=0.0.2=r35h6115d3f_1002
  - r-ggplot2=3.1.0=r351h6115d3f_1000
  - r-gh=1.0.1=r35h6115d3f_1002
  - r-git2r=0.24.0=r351h47c54a8_1
  - r-glue=1.3.0=r351h14c3975_1002
  - r-gtable=0.2.0=r351h6115d3f_1001
  - r-haven=2.0.0=r351h29659fb_1000
  - r-highr=0.7=r351h6115d3f_1001
  - r-hms=0.4.2=r351h6115d3f_1000
  - r-htmltools=0.3.6=r35he1b5a44_1003
  - r-httpuv=1.4.5.1=r351hf484d3e_1000
  - r-httr=1.4.0=r35h6115d3f_1001
  - r-hunspell=3.0=r35h0357c0b_1001
  - r-igraph=1.2.4.1=r35h6786f55_1
  - r-ini=0.3.1=r35h6115d3f_1002
  - r-isocodes=2018.06.29=r351h6115d3f_1000
  - r-janeaustenr=0.1.5=r35h6115d3f_1002
  - r-jsonlite=1.6=r35hcdcec82_1001
  - r-knitr=1.21=r351h6115d3f_1000
  - r-labeling=0.3=r35h6115d3f_1002
  - r-later=0.7.5=r351h29659fb_1000
  - r-lattice=0.20_38=r35hcdcec82_1001
  - r-lazyeval=0.2.1=r351h96ca727_1002
  - r-lintr=1.0.3=r35h6115d3f_1001
  - r-lubridate=1.7.4=r35h0357c0b_1002
  - r-magrittr=1.5=r35h6115d3f_1002
  - r-markdown=0.9=r351h96ca727_1000
  - r-mass=7.3_51.1=r351h96ca727_1000
  - r-matrix=1.2_15=r351h96ca727_1000
  - r-memoise=1.1.0=r35h6115d3f_1002
  - r-mgcv=1.8_26=r351h96ca727_1000
  - r-mime=0.6=r351h96ca727_1000
  - r-modelr=0.1.2=r351h6115d3f_1001
  - r-munsell=0.5.0=r35h6115d3f_1002
  - r-nlme=3.1_137=r351ha65eedd_1000
  - r-openssl=1.1=r351hff1dc39_1001
  - r-packrat=0.5.0=r35h6115d3f_1001
  - r-pdftools=2.0=r351h9c8f241_1000
  - r-pillar=1.4.2=r35h6115d3f_2
  - r-pkgbuild=1.0.2=r351h6115d3f_1001
  - r-pkgconfig=2.0.2=r35h6115d3f_1002
  - r-pkgload=1.0.2=r35h0357c0b_1001
  - r-plogr=0.2.0=r35h6115d3f_1002
  - r-plyr=1.8.4=r35h0357c0b_1003
  - r-praise=1.0.0=r35h6115d3f_1002
  - r-prettyunits=1.0.2=r35h6115d3f_1002
  - r-processx=3.2.1=r351h96ca727_1000
  - r-progress=1.2.0=r351h6115d3f_1002
  - r-promises=1.0.1=r35h0357c0b_1001
  - r-ps=1.3.0=r35hcdcec82_1001
  - r-purrr=0.2.5=r351h96ca727_1002
  - r-r6=2.3.0=r351h6115d3f_1000
  - r-rcmdcheck=1.3.2=r351h6115d3f_1000
  - r-rcolorbrewer=1.1_2=r35h6115d3f_1002
  - r-rcpp=1.0.0=r351h29659fb_1000
  - r-readr=1.3.1=r35h0357c0b_1001
  - r-readxl=1.2.0=r351h29659fb_1000
  - r-rematch=1.0.1=r35h6115d3f_1002
  - r-remotes=2.0.2=r351h6115d3f_1000
  - r-reprex=0.2.1=r351h6115d3f_1000
  - r-reshape2=1.4.3=r35h0357c0b_1004
  - r-reticulate=1.10=r351h29659fb_1001
  - r-rex=1.1.2=r35h6115d3f_1001
  - r-rlang=0.3.4=r351hcdcec82_0
  - r-rmarkdown=1.11=r351h6115d3f_1000
  - r-rprojroot=1.3_2=r35h6115d3f_1002
  - r-rstudioapi=0.9.0=r351h6115d3f_0
  - r-rvest=0.3.2=r351h6115d3f_1001
  - r-s3tools=0.0.9=r351_0
  - r-scales=1.0.0=r35h0357c0b_1002
  - r-selectr=0.4_1=r35h6115d3f_1001
  - r-sessioninfo=1.1.1=r35h6115d3f_1001
  - r-shiny=1.2.0=r351_1000
  - r-snowballc=0.5.1=r351h96ca727_1001
  - r-sourcetools=0.1.7=r35he1b5a44_1001
  - r-stopwords=0.9.0=r35h6115d3f_1002
  - r-stringdist=0.9.5.1=r351h96ca727_1000
  - r-stringi=1.2.4=r351h29659fb_1001
  - r-stringr=1.3.1=r351h6115d3f_1001
  - r-testthat=2.0.1=r351h29659fb_1000
  - r-tibble=2.0.1=r351h96ca727_0
  - r-tidyr=0.8.2=r351h29659fb_1002
  - r-tidyselect=0.2.5=r35h0357c0b_1001
  - r-tidytext=0.2.0=r351h6115d3f_1000
  - r-tidyverse=1.2.1=r35h6115d3f_1002
  - r-tinytex=0.10=r351h6115d3f_0
  - r-tokenizers=0.2.1=r35h0357c0b_1001
  - r-usethis=1.4.0=r351h6115d3f_1000
  - r-utf8=1.1.4=r35hcdcec82_1001
  - r-vctrs=0.1.0=r351h96ca727_1000
  - r-viridislite=0.3.0=r35h6115d3f_1002
  - r-webshot=0.5.1=r35h6115d3f_1001
  - r-whisker=0.3_2=r35h6115d3f_1002
  - r-withr=2.1.2=r35h6115d3f_1001
  - r-xfun=0.4=r351h6115d3f_1000
  - r-xml2=1.2.0=r35h0357c0b_1003
  - r-xopen=1.0.0=r35h6115d3f_1001
  - r-xtable=1.8_3=r351_2000
  - r-yaml=2.2.0=r35hcdcec82_1002
  - r-zeallot=0.1.0=r35h6115d3f_1001
  - readline=7.0=hf8c457e_1001
  - requests=2.19.1=py37_1001
  - ruamel_yaml=0.15.46=py37h14c3975_0
  - s3transfer=0.2.0=py37_0
  - scikit-learn=0.20.2=py37hd81dba3_0
  - scipy=1.2.0=py37h7c811a0_0
  - setuptools=40.2.0=py37_0
  - six=1.11.0=py37_1001
  - smart_open=1.8.0=py_0
  - sqlite=3.26.0=h67949de_1001
  - thrift-cpp=0.12.0=h23e226f_1001
  - tk=8.6.8=h84994c4_1000
  - tktable=2.10=h14c3975_0
  - toolz=0.9.0=py_1
  - urllib3=1.23=py37_1001
  - wheel=0.31.1=py37_1001
  - xorg-kbproto=1.0.7=h14c3975_1002
  - xorg-libice=1.0.9=h516909a_1004
  - xorg-libsm=1.2.3=h84519dc_1000
  - xorg-libx11=1.6.7=h14c3975_1000
  - xorg-libxau=1.0.9=h14c3975_0
  - xorg-libxdmcp=1.1.3=h516909a_0
  - xorg-libxext=1.3.3=h516909a_1004
  - xorg-libxrender=0.9.10=h516909a_1002
  - xorg-renderproto=0.11.1=h14c3975_1002
  - xorg-xextproto=7.3.0=h14c3975_1002
  - xorg-xproto=7.0.31=h14c3975_1007
  - xz=5.2.4=h14c3975_1001
  - yaml=0.1.7=h14c3975_1001
  - zlib=1.2.11=h516909a_1005
  - zstd=1.3.7=h0a35d5f_1001