Open ijstokes opened 7 years ago
What version of anaconda-project is this? I think I may have fixed this in latest code, because it was confusing to prompt for CONDA_PREFIX.
Does it keep looping by itself or are you hitting a key when it prompts "Value for CONDA_PREFIX"?
Confusing errors aside, the actual problem is that the packages can't be installed.
It was looping by itself. I was at breakfast and what you see is what I was staring at when I got back.
I am using anaconda-project v0.4.1.
I removed boto, didn't make a difference, still failed (but didn't complain about boto, or anything else, just went into the loop with that CONDA_PREFIX
prompt). I tried this several times, all failing. I wondered if it might be a hotel wifi issue?
Maybe anaconda-project.yml
can't take package specs in the same format as conda env export
, with the second = sign? I dunno! But now this anaconda-project.yml
file works on my Mac:
And here is the output, right up to when the Jupyter Notebook logging starts to appear:
$ anaconda-project --verbose run
$ conda create --yes --quiet --prefix /Users/ijstokes/teaching/python/pycon2017-anaconda-project-data-science-apps/mnist_digit_recognition/envs/default --channel conda-forge --channel defaults pyasn1=0.1.9 python patsy=0.4.1 greenlet=0.4.11 get_terminal_size=1.0.0 simplegeneric=0.8.1 decorator=4.0.11 xlsxwriter=0.9.6 pycrypto=2.6.1 widgetsnbextension=1.2.6 lazy-object-proxy=1.2.2 setuptools=27.2.0 partd=0.3.7 nbconvert=4.2.0 jdcal=1.3 markupsafe=0.23 jinja2=2.9.4 nbformat=4.2.0 ptyprocess=0.5.1 readline=6.2 cryptography=1.7.1 ipython_genutils=0.1.0 pytz=2016.10 dill=0.2.5 datashape=0.5.4 unicodecsv=0.14.1 h5py=2.6.0 notebook=4.3.1 isort=4.2.5 bokeh=0.12.4 libtiff=4.0.6 numpydoc=0.6.0 pylint=1.6.4 contextlib2=0.5.4 ply=3.9 sip=4.18 clyent=1.2.2 configobj=5.0.6 prompt_toolkit=1.0.9 rope=0.9.4 libxslt=1.1.29 sockjs-tornado=1.0.3 wcwidth=0.1.7 odo=0.5.0 openssl=1.0.2k keras jupyter_client=4.4.0 python=3.6 libiconv=1.14 pyparsing=2.1.4 tensorflow scipy=0.18.1 fastcache=1.0.2 numpy=1.11.3 sympy=1.0 sqlite=3.13.0 pycparser=2.17 sqlalchemy=1.1.5 zlib=1.2.8 cffi=1.9.1 hdf5=1.8.17 nose=1.3.7 idna=2.2 lxml=3.7.2 locket=0.2.0 openpyxl=2.4.1 redis=3.2.0 click=6.7 cytoolz=0.8.2 pep8=1.7.0 mistune=0.7.3 six=1.10.0 itsdangerous=0.24 pickleshare=0.7.4 imagesize=0.7.1 cython=0.25.2 path.py=10.0 pyopenssl=16.2.0 ipykernel=4.5.2 jupyter_core=4.2.1 ipywidgets=5.2.2 python-dateutil=2.6.0 heapdict=1.0.0 statsmodels=0.6.1 mkl=2017.0.1 multipledispatch=0.4.9 numexpr=2.6.1 numba=0.30.1 pillow=4.0.0 chardet=2.3.0 colorama=0.3.7 jbig=2.1 icu=54.1 xz=5.2.2 pip=9.0.1 graphviz xlrd=1.0.0 xlwings=0.10.2 dask=0.13.0 scikit-learn=0.18.1 pyflakes=1.5.0 blaze=0.10.1 et_xmlfile=1.0.1 bitarray=0.8.1 pytest=3.0.5 redis-py=2.10.5 ruamel_yaml=0.11.14 libxml2=2.9.4 scikit-image=0.12.3 wheel=0.29.0 pycurl=7.43.0 mkl-service=1.1.2 pathlib2=2.2.0 psutil=5.0.1 pyzmq=16.0.2 xlwt=1.2.0 bottleneck=1.2.0 jedi=0.9.0 werkzeug=0.11.15 pygments=2.1.3 pandas=0.19.2 jsonschema=2.5.1 traitlets=4.3.1 singledispatch=3.4.0.3 py=1.4.32 terminado=0.6 pycosat=0.6.1 backports=1.0 pexpect=4.2.1 gevent=1.2.1 wrapt=1.10.8 toolz=0.8.2 ipython=5.1.0 anaconda-project=0.4.1 chest=0.2.3 networkx=1.11 yaml=0.1.6 jpeg=9b cycler=0.10.0 llvmlite=0.15.0 pyyaml=3.12 seaborn=0.7.1 nltk=3.2.2 snowballstemmer=1.2.1 tornado=4.4.2 cloudpickle=0.2.2 mpmath=0.19 pytables=3.3.0 requests=2.12.4 libpng=1.6.27
$ /Users/ijstokes/teaching/python/pycon2017-anaconda-project-data-science-apps/mnist_digit_recognition/envs/default/bin/pip install --quiet --no-deps pydot_ng
$ conda info --json
$ /Users/ijstokes/teaching/python/pycon2017-anaconda-project-data-science-apps/mnist_digit_recognition/envs/default/bin/jupyter-notebook /Users/ijstokes/teaching/python/pycon2017-anaconda-project-data-science-apps/mnist_digit_recognition/tensorflow_digit_recognizer.ipynb --NotebookApp.default_url=/notebooks/tensorflow_digit_recognizer.ipynb
[W 11:22:58.152 NotebookApp] Error loading server extension hide_code
Did I answer your question? I never pressed enter. The prompt appeared, sat there for some time, and then "more stuff happened". The only thing I ever did was i) start the process/command; and ii) CTRL-C to kill it.
Since it is now working for me I'm going to close this but if @havocp you think this is bringing up a bona fide bug then maybe you want to re-open it (or open a new one that has the details, sans my rambling).
@havocp if the packages can't be installed why is it trying again and again? And which packages can't be installed? conda now (usually) provides useful information about where the problem is, but I couldn't spot anything like that here (besides the boto issue, which was not the root cause of the problem -- command still didn't work even with boto removed).
I don't understand at all why it's trying again and again; perhaps python's input()
function has an implicit timeout? That seems likely.
I think with latest anaconda-project you won't get the prompt for CONDA_PREFIX in this scenario, just the actual conda error. But if input()
has a timeout I'd want to fix that for cases where we do prompt, so I'll reopen this to address that issue.
This is probably a separate issue, and I don't have time now to try and isolate and reproduce, but I just discovered that even in my working instance of anaconda-project run
(executed after deleting the previous environment, to have a fresh start), I was missing libpng
despite it being listed in the packages
section of anaconda-project.yml
. I'm mentioning this here since the necessary files and some debug output are all caught up in this issue.
There might actually be a bug in here, but I can't tell. Mostly I just need some advice on how to proceed. Below is the trace output from
anaconda-project --verbose run
using this file:anaconda-project.txt
After 40 minutes it still has not exited, though it isn't burning any CPU time, so something is just sitting there quietly doing nothing and then briefly waking up to take another crack at whatever is getting stuck, failing, sleeping, retrying, and so on. (at least that's what it looks like to me).
It seems odd that it would ever say to me:
Since that is a value that is set automatically by conda's
activate
script (at least TTBOMK).In the first round of failure there is the useful nugget:
So I don't need
boto
, and I'll take it out of my YAML file (it is only there because I didconda env export > anaconda-project.yml
to give me a starting point). I'll provide an update once I've done that and tested out a few more things.NOTE: in the trace below only the very first line is what I executed. Everything else is
anaconda-project
output (which in many places confusingly looks like stuff I may have executed).