ContinuumIO / anaconda-issues

Anaconda issue tracking
646 stars 220 forks source link

ERROR conda.core.link:_execute(507) #10439

Open Hofphi opened 5 years ago

Hofphi commented 5 years ago

Can not find anything in the forum on this error report. Maybe you can help me with this:


Creating conda environment https:/bitbucket.org/snakemake/snakemake-wrappers/raw/0.27.1/bio/fastqc/environment.yaml...
Downloading remote packages.
CreateCondaEnvironmentException:
Could not create conda environment from /tmp/tmpztksqgwq.yaml:
Solving environment: ...working... done
Preparing transaction: ...working... done
Verifying transaction: ...working... done
Executing transaction: ...working... failed
ERROR conda.core.link:_execute(507): An error occurred while installing package 'conda-forge::openjdk-11.0.1-h470a237_14'.
ProcessLookupError(3, 'No such process')
Attempting to roll back.

Rolling back transaction: ...working... done

ProcessLookupError(3, 'No such process')

Environment Information

conda info

     active environment : None
       user config file : /home/hofphi00/.condarc
 populated config files : 
          conda version : 4.5.12
    conda-build version : not installed
         python version : 3.6.7.final.0
       base environment : /home/hofphi00/miniconda3  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/free/linux-64
                          https://repo.anaconda.com/pkgs/free/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://repo.anaconda.com/pkgs/pro/linux-64
                          https://repo.anaconda.com/pkgs/pro/noarch
          package cache : /home/hofphi00/miniconda3/pkgs
                          /home/hofphi00/.conda/pkgs
       envs directories : /home/hofphi00/miniconda3/envs
                          /home/hofphi00/.conda/envs
               platform : linux-64
             user-agent : conda/4.5.12 requests/2.21.0 CPython/3.6.7 Linux/3.10.0-862.14.4.el7.x86_64 centos/7 glibc/2.17
                UID:GID : 3066188:3066188
             netrc file : None
           offline mode : False
conda list --show-channel-urls
# packages in environment at /home/hofphi00/miniconda3:
#
# Name                    Version                   Build  Channel
aioeasywebdav             2.2.0                    py36_0    conda-forge
aiohttp                   3.4.4            py36h7b6447c_0    defaults
appdirs                   1.4.3            py36h28b3542_0    defaults
asn1crypto                0.24.0                   py36_0    defaults
async-timeout             3.0.1                    py36_0    defaults
attrs                     18.2.0           py36h28b3542_0    defaults
bcrypt                    3.1.5            py36h7b6447c_0    defaults
blas                      1.0                         mkl    defaults
boto3                     1.9.66                   py36_0    defaults
botocore                  1.12.67                  py36_0    defaults
bzip2                     1.0.6                h14c3975_5    defaults
ca-certificates           2018.03.07                    0    defaults
cachetools                2.1.0                      py_0    conda-forge
cairo                     1.14.12              h7636065_2    defaults
certifi                   2018.11.29               py36_0    defaults
cffi                      1.11.5           py36he75722e_1    defaults
chardet                   3.0.4                    py36_1    defaults
conda                     4.5.12                   py36_0    defaults
conda-env                 2.6.0                         1    defaults
configargparse            0.13.0                   py36_0    defaults
cryptography              2.4.2            py36h1ba5d50_0    defaults
cryptography-vectors      2.4.2                    py36_0    defaults
datrie                    0.7.1            py36h7b6447c_1    defaults
decorator                 4.3.0                    py36_0    defaults
docutils                  0.14                     py36_0    defaults
dropbox                   9.2.0                    py36_0    defaults
expat                     2.2.6                he6710b0_0    defaults
filechunkio               1.6                      py36_0    bioconda
fontconfig                2.12.6               h49f89f6_0    defaults
freetype                  2.8                  hab7d2ae_1    defaults
fribidi                   1.0.5                h7b6447c_0    defaults
ftputil                   3.2                      py36_0    bioconda
gettext                   0.19.8.1             hd7bead4_3    defaults
gitdb2                    2.0.5                    py36_0    defaults
gitpython                 2.1.11                   py36_0    defaults
glib                      2.56.2               hd408876_0    defaults
google-auth               1.2.1                      py_0    conda-forge
google-auth-httplib2      0.0.3                      py_2    conda-forge
google-cloud-core         0.24.1                   py36_0    conda-forge
google-cloud-storage      1.1.1                    py36_0    conda-forge
google-resumable-media    0.0.2                    py36_0    conda-forge
googleapis-common-protos  1.5.5                      py_0    conda-forge
graphite2                 1.3.12               h23475e2_2    defaults
graphviz                  2.40.1               h25d223c_0    defaults
harfbuzz                  1.7.6                h5f0a787_1    defaults
httplib2                  0.12.0                py36_1000    conda-forge
icu                       58.2                 h9c2bf20_1    defaults
idna                      2.8                      py36_0    defaults
idna_ssl                  1.1.0                    py36_0    defaults
intel-openmp              2019.1                      144    defaults
jinja2                    2.10                     py36_0    defaults
jmespath                  0.9.3                    py36_0    defaults
jpeg                      9b                   h024ee3a_2    defaults
jsonschema                2.6.0                    py36_0    defaults
libedit                   3.1.20170329         h6b74fdf_2    defaults
libffi                    3.2.1                hd88cf55_4    defaults
libgcc-ng                 8.2.0                hdf63c60_1    defaults
libgfortran-ng            7.3.0                hdf63c60_0    defaults
libiconv                  1.15                 h63c8f33_5    defaults
libpng                    1.6.35               hbc83047_0    defaults
libprotobuf               3.6.1                hd408876_0    defaults
libsodium                 1.0.16               h1bed415_0    defaults
libstdcxx-ng              8.2.0                hdf63c60_1    defaults
libtiff                   4.0.9                he85c1e1_2    defaults
libtool                   2.4.6                h7b6447c_5    defaults
libuuid                   2.32.1               h470a237_2    conda-forge
libxcb                    1.13                 h1bed415_1    defaults
libxml2                   2.9.8                h26e45fe_1    defaults
markupsafe                1.1.0            py36h7b6447c_0    defaults
mkl                       2019.1                      144    defaults
mkl_fft                   1.0.6            py36hd81dba3_0    defaults
mkl_random                1.0.2            py36hd81dba3_0    defaults
multidict                 4.5.2            py36h7b6447c_0    defaults
ncurses                   6.1                  he6710b0_1    defaults
networkx                  2.2                      py36_1    defaults
numpy                     1.15.4           py36h7e9f1db_0    defaults
numpy-base                1.15.4           py36hde5b4d6_0    defaults
openjdk                   8.0.152              h46b5887_1    defaults
openssl                   1.1.1a               h7b6447c_0    defaults
pandas                    0.23.4           py36h04863e7_0    defaults
pango                     1.41.0               hd475d92_0    defaults
paramiko                  2.4.2                    py36_0    defaults
pcre                      8.42                 h439df22_0    defaults
pip                       18.1                     py36_0    defaults
pixman                    0.34.0               hceecf20_3    defaults
prettytable               0.7.2                      py_2    conda-forge
protobuf                  3.6.1            py36he6710b0_0    defaults
psutil                    5.4.8            py36h7b6447c_0    defaults
pthread-stubs             0.3                  h0ce48e5_1    defaults
pyasn1                    0.4.4            py36h28b3542_0    defaults
pyasn1-modules            0.2.2                    py36_0    defaults
pycosat                   0.6.3            py36h14c3975_0    defaults
pycparser                 2.19                     py36_0    defaults
pygraphviz                1.3              py36h14c3975_1    defaults
pynacl                    1.3.0            py36h7b6447c_0    defaults
pyopenssl                 18.0.0                   py36_0    defaults
pyrsistent                0.14.7           py36h470a237_0    conda-forge
pysftp                    0.2.9                    py36_0    bioconda
pysocks                   1.6.8                    py36_0    defaults
python                    3.6.7                h0371630_0    defaults
python-dateutil           2.7.5                    py36_0    defaults
python-irodsclient        0.7.0                      py_0    conda-forge
pytz                      2018.7                   py36_0    defaults
pyyaml                    3.13             py36h14c3975_0    defaults
ratelimiter               1.2.0                 py36_1000    conda-forge
readline                  7.0                  h7b6447c_5    defaults
requests                  2.21.0                   py36_0    defaults
rsa                       3.1.4                    py36_0    bioconda
ruamel_yaml               0.15.46          py36h14c3975_0    defaults
s3transfer                0.1.13                   py36_0    defaults
setuptools                40.6.3                   py36_0    defaults
six                       1.12.0                   py36_0    defaults
smmap2                    2.0.5                    py36_0    defaults
snakemake                 5.3.1                         0    bioconda
snakemake-minimal         5.3.1                      py_0    bioconda
sqlite                    3.26.0               h7b6447c_0    defaults
tk                        8.6.8                hbc83047_0    defaults
urllib3                   1.24.1                   py36_0    defaults
wheel                     0.32.3                   py36_0    defaults
wrapt                     1.10.11          py36h14c3975_2    defaults
xmlrunner                 1.7.7                      py_0    conda-forge
xorg-kbproto              1.0.7                h470a237_2    conda-forge
xorg-libice               1.0.9                h470a237_4    conda-forge
xorg-libsm                1.2.3                h8c8a85c_0    conda-forge
xorg-libx11               1.6.6                h470a237_0    conda-forge
xorg-libxau               1.0.8                h470a237_6    conda-forge
xorg-libxdmcp             1.1.2                h470a237_7    conda-forge
xorg-libxext              1.3.3                h470a237_4    conda-forge
xorg-libxpm               3.5.12               h470a237_2    conda-forge
xorg-libxrender           0.9.10               h470a237_2    conda-forge
xorg-libxt                1.1.5                h470a237_2    conda-forge
xorg-renderproto          0.11.1               h470a237_2    conda-forge
xorg-xextproto            7.3.0                h470a237_2    conda-forge
xorg-xproto               7.0.31               h470a237_7    conda-forge
xz                        5.2.4                h14c3975_4    defaults
yaml                      0.1.7                had09818_2    defaults
yarl                      1.2.6            py36h14c3975_0    defaults
zlib                      1.2.11               h7b6447c_3    defaults
gabefair commented 5 years ago

Did you ever figure this out?

Hofphi commented 5 years ago

Hey gabefair,

unfortunately I could not resolve the issue yet. I tried removing miniconda and reinstalling but without any success. The error message changed to this here:

# >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

    Traceback (most recent call last):
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/exceptions.py", line 819, in __call__
        return func(*args, **kwargs)
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda_env/cli/main.py", line 74, in do_call
        exit_code = getattr(module, func_name)(args, parser)
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda_env/cli/main_create.py", line 108, in execute
        installer.install(prefix, pkg_specs, args, env)
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda_env/installers/conda.py", line 39, in install
        unlink_link_transaction.execute()
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/core/link.py", line 223, in execute
        self.verify()
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/common/io.py", line 46, in decorated
        return f(*args, **kwds)
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/core/link.py", line 210, in verify
        exceptions = self._verify(self.prefix_setups, self.prefix_action_groups)
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/core/link.py", line 486, in _verify
        cls._verify_transaction_level(prefix_setups),
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/core/link.py", line 481, in <genexpr>
        exceptions = tuple(exc for exc in concatv(
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/core/link.py", line 334, in _verify_individual_level
        error_result = axn.verify()
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/core/path_actions.py", line 428, in verify
        create_link(self.source_full_path, self.intermediate_path, LinkType.copy)
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/gateways/disk/create.py", line 334, in create_link
        copy(src, dst)
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/gateways/disk/create.py", line 272, in copy
        _do_copy(src, dst)
      File "/home/hofphi00/miniconda3/lib/python3.6/site-packages/conda/gateways/disk/create.py", line 286, in _do_copy
        copyfileobj(fsrc, fdst, buffer_size)
    ProcessLookupError: [Errno 3] No such process

`$ /home/hofphi00/miniconda3/bin/conda-env create --file /scratch/hofphi00/dropSeqPipe/.snakemake/conda/13723821.yaml --prefix /scratch/hofphi00/dropSeqPipe/.snakemake/conda/13723821`

I tried executing this line here: /home/hofphi00/miniconda3/bin/conda-env create --file /scratch/hofphi00/dropSeqPipe/.snakemake/conda/13723821.yaml --prefix /scratch/hofphi00/dropSeqPipe/.snakemake/conda/13723821

which gave me the same error. I am really clueless on how to deal with this error. Any suggestions are very welcome!

youlimlee commented 5 years ago

I have a same problem.

ERROR conda.core.link:_execute(507): An error occurred while installing package 'defaults::tensorflow-base-1.12.0-eigen_py36h45df0d8_0'. PermissionError(13, 'Permission denied') Attempting to roll back. Rolling back transaction: done PermissionError(13, 'Permission denied')

Does anyone knows how can I solve this?

MASE13 commented 5 years ago

same issue on two different win10 devices running anaconda

KuhnHuge commented 5 years ago

same issue on two different win10 devices running anaconda

I had the same issue ,and I just solve it .But I'm not good at English. 只需要以管理员身份打开就好了。(Just open as an administrator.) 3101142694@qq.com

matrpyth commented 5 years ago

I have the same problem and even opening the command window as an administrator did not work for me.

ERROR conda.core.link:_execute(507): An error occurred while installing package 'conda-forge::openssl-1.0.2o-vc9_0'. PermissionError(13, 'Permission denied') Attempting to roll back. Rolling back transaction: done PermissionError(13, 'Permission denied')

Is there another way than trying the admin cmd?

Nathan-Furnal commented 5 years ago

Same problem on a windows 10 machine

ERROR conda.core.link:_execute(507): An error occurred while uninstalling package 'anaconda::openssl-1.1.1-he774522_0'

giangnguyen2412 commented 5 years ago

Following this fixed the problem: https://github.com/conda/conda/issues/3448 Uninstall miniconda and install again using Just me(Not everyone).

fromSun2Moon commented 5 years ago

if you use over window 8 , try command line Run as administrator! In my case, I go over it.

lindafa commented 5 years ago

I had the same problem today. I am using win10. You just have to run the anaconda Prompt as administrator, it should work.

fpetruccelli commented 5 years ago

RUN as ADMIN. RUN as ADMIN. It will work.

eavandoorn commented 5 years ago

Similar error today. It occurs when provisioning a Vagrant Ubuntu VM, or installing into said VM from its BASH command line. I'm getting the errors on two separate machines running Windows 8.1 and 10, and not getting it on another machine that still runs Windows 7 (when using the same Vagrant file for provisioning).

In contrast to the original error posted, the ERROR conda.core.link:_execute(507) is accompanied by OSError(26, 'Text file busy'). Like Nathan wrote above on January 5th, the error is generated when uninstalling openssl (in my case as part of an installation of Jupyter Notebook, with openssl being updated from version 1.1.1a-h7b6447c_0 to version 1.1.1b-h7b6447c_1). Output from lsof shows that the python executable is being written to, which is probably why I'm seeing the 'Text file busy' error. Please advise if I need to open a new issue because of different behavior, I can imagine this is not as easily solved by running as admin (for completeness' sake, I'm running cmd as admin under Windows).

marabout2015 commented 5 years ago

@fpetruccelli , no running as admin does not allow this to work. Sorry.

manouzi commented 5 years ago

same problem

marabout2015 commented 5 years ago

@manouzi I worked around this by reinstalling Anaconda 3 version 4.4.10 from an old installer I had from last year. I use it without updating conda. I don't know whether that solution is possible for you.

harisbal commented 5 years ago

Cloning the environment worked for me

dkruijs commented 5 years ago

Similar error today. It occurs when provisioning a Vagrant Ubuntu VM, or installing into said VM from its BASH command line. I'm getting the errors on two separate machines running Windows 8.1 and 10, and not getting it on another machine that still runs Windows 7 (when using the same Vagrant file for provisioning).

In contrast to the original error posted, the ERROR conda.core.link:_execute(507) is accompanied by OSError(26, 'Text file busy'). Like Nathan wrote above on January 5th, the error is generated when uninstalling openssl (in my case as part of an installation of Jupyter Notebook, with openssl being updated from version 1.1.1a-h7b6447c_0 to version 1.1.1b-h7b6447c_1). Output from lsof shows that the python executable is being written to, which is probably why I'm seeing the 'Text file busy' error. Please advise if I need to open a new issue because of different behavior, I can imagine this is not as easily solved by running as admin (for completeness' sake, I'm running cmd as admin under Windows).

I've found a workaround for this by simply electing to install Anaconda (actually Miniconda, in our case) 'one folder up', so that it is not included in the synced folder which is also accessible in Windows. I read a post somewhere (unfortunately cannot find it anymore) by mr. Hashimoto himself in response to a similar issue, saying that Windows is quite aggressive with file locking. So I tried to remove windows (Windows 10) from the equation by not placing Anaconda into the synced folder. This made any openssl errors go away!

It's not technically proper, since Anaconda expects itself to be installed in the user's folder (which should be /home/vagrant), but I do not expect it to cause any problems.

I am curious to hear if this works for anyone else.

EDIT: I've found the original comment that inspired this workaround: https://github.com/hashicorp/vagrant/issues/2282#issuecomment-25475134