Conda out of memory error on Mac M1

[Remorax]

• [X] I read the conda-forge documentation and could not find the solution for my problem there.

Issue:

I am unable to install any package using conda. On running an installation command such as:

conda install transformers

I get a CondaMemoryError. The full error message is described below:

/Users/vivek/.local/lib/python3.8/site-packages/requests/__init__.py:89: RequestsDependencyWarning: urllib3 (1.26.3) or chardet (3.0.4) doesn't match a supported version!
  warnings.warn("urllib3 ({}) or chardet ({}) doesn't match a supported "
Collecting package metadata (current_repodata.json): failed

CondaMemoryError: The conda process ran out of memory. Increase system memory and/or try again

I have around 1.5GB of free memory, checking Activity Monitor, so I am not sure what the problem is.

Environment (conda list):

``` # packages in environment at /Users/vivek/miniforge3: # # Name Version Build Channel absl-py 0.11.0 pypi_0 pypi aiohttp 3.7.4 py38h30f7421_0 conda-forge anyio 2.2.0 py38h10201cd_0 conda-forge appnope 0.1.2 py38h10201cd_1 conda-forge argon2-cffi 20.1.0 py38h30f7421_2 conda-forge astunparse 1.6.3 pypi_0 pypi async-timeout 3.0.1 py_1000 conda-forge async_generator 1.10 py_0 conda-forge attrs 20.3.0 pyhd3deb0d_0 conda-forge babel 2.9.0 pyhd3deb0d_0 conda-forge backcall 0.2.0 pyh9f0ad1d_0 conda-forge backports 1.0 py_2 conda-forge backports.functools_lru_cache 1.6.1 py_0 conda-forge bleach 3.3.0 pyh44b312d_0 conda-forge boto 2.49.0 py_0 conda-forge boto3 1.17.24 pyhd8ed1ab_0 conda-forge botocore 1.20.24 pyhd8ed1ab_0 conda-forge brotlipy 0.7.0 py38h30f7421_1001 conda-forge bz2file 0.98 py_0 conda-forge bzip2 1.0.8 h27ca646_4 conda-forge c-ares 1.17.1 h27ca646_1 conda-forge ca-certificates 2020.12.5 h4653dfc_0 conda-forge cached-property 1.5.2 pypi_0 pypi cachetools 4.2.1 pyhd8ed1ab_0 conda-forge catalogue 2.0.1 py38h10201cd_2 conda-forge certifi 2020.12.5 py38h10201cd_1 conda-forge cffi 1.14.5 py38he62ddd7_0 conda-forge chardet 4.0.0 py38h10201cd_1 conda-forge click 7.1.2 pyh9f0ad1d_0 conda-forge colorama 0.4.4 pyh9f0ad1d_0 conda-forge conda 4.9.2 py38h10201cd_0 conda-forge conda-package-handling 1.7.2 py38h51573d8_0 conda-forge cryptography 3.4.4 py38h6abee02_0 conda-forge cycler 0.10.0 py_2 conda-forge cymem 2.0.5 py38h3f7e68f_1 conda-forge cython-blis 0.7.4 py38h8369297_0 conda-forge dataclasses 0.8 pyhc8e2a94_1 conda-forge decorator 4.4.2 py_0 conda-forge defusedxml 0.6.0 py_0 conda-forge entrypoints 0.3 pyhd8ed1ab_1003 conda-forge flask 1.1.2 pyh9f0ad1d_0 conda-forge flatbuffers 1.12 pypi_0 pypi freetype 2.10.4 h17b34a0_1 conda-forge gast 0.4.0 pypi_0 pypi google-api-core 1.25.1 pyhd8ed1ab_0 conda-forge google-auth 1.27.1 pypi_0 pypi google-auth-oauthlib 0.4.3 pypi_0 pypi google-cloud-core 1.5.0 pyhd3deb0d_0 conda-forge google-cloud-storage 1.19.0 py_0 conda-forge google-crc32c 1.1.2 py38h10a7082_0 conda-forge google-pasta 0.2.0 pypi_0 pypi google-resumable-media 1.2.0 pyhd3deb0d_0 conda-forge googleapis-common-protos 1.52.0 py38h10201cd_1 conda-forge grpcio 1.33.2 pypi_0 pypi h5py 2.10.0 pypi_0 pypi idna 2.10 pyh9f0ad1d_0 conda-forge importlib-metadata 3.7.0 py38h10201cd_0 conda-forge inflection 0.5.1 pyh9f0ad1d_0 conda-forge install 1.3.4 pypi_0 pypi ipykernel 5.5.0 py38h2cb4d76_1 conda-forge ipython 7.21.0 py38h2cb4d76_0 conda-forge ipython_genutils 0.2.0 py_1 conda-forge itsdangerous 1.1.0 py_0 conda-forge jedi 0.18.0 py38h10201cd_2 conda-forge jinja2 2.11.3 pyh44b312d_0 conda-forge jmespath 0.10.0 pyh9f0ad1d_0 conda-forge joblib 1.0.1 pyhd8ed1ab_0 conda-forge jpeg 9d h27ca646_0 conda-forge json5 0.9.5 pyh9f0ad1d_0 conda-forge jsonschema 3.2.0 pyhd8ed1ab_3 conda-forge jupyter-packaging 0.7.12 pyhd8ed1ab_0 conda-forge jupyter_client 6.1.11 pyhd8ed1ab_1 conda-forge jupyter_core 4.7.1 py38h10201cd_0 conda-forge jupyter_server 1.4.1 py38h10201cd_0 conda-forge jupyterlab 3.0.10 pyhd8ed1ab_0 conda-forge jupyterlab_pygments 0.1.2 pyh9f0ad1d_0 conda-forge jupyterlab_server 2.3.0 pyhd8ed1ab_0 conda-forge keras-preprocessing 1.1.2 pypi_0 pypi kiwisolver 1.3.1 py38h12a6f45_1 conda-forge lcms2 2.12 had6a04f_0 conda-forge libblas 3.9.0 8_openblas conda-forge libcblas 3.9.0 8_openblas conda-forge libcrc32c 1.1.1 h9f76cd9_2 conda-forge libcxx 11.1.0 h168391b_0 conda-forge libffi 3.3 h9f76cd9_2 conda-forge libgfortran 5.0.0.dev0 11_0_0_hdc626ea_19 conda-forge libgfortran5 11.0.0.dev0 hdc626ea_19 conda-forge liblapack 3.9.0 8_openblas conda-forge libopenblas 0.3.12 openmp_h2ecc587_1 conda-forge libpng 1.6.37 hf7e6567_2 conda-forge libprotobuf 3.15.5 habe5f53_0 conda-forge libsodium 1.0.18 h27ca646_1 conda-forge libtiff 4.2.0 h70663a0_0 conda-forge libwebp-base 1.2.0 h27ca646_0 conda-forge llvm-openmp 11.0.1 hb3022d6_0 conda-forge lz4-c 1.9.3 h9f76cd9_0 conda-forge markdown 3.3.4 pypi_0 pypi markupsafe 1.1.1 py38h30f7421_3 conda-forge matplotlib 3.3.4 py38h150bfb4_0 conda-forge matplotlib-base 3.3.4 py38ha029820_0 conda-forge mistune 0.8.4 py38h30f7421_1003 conda-forge multidict 5.1.0 py38h30f7421_1 conda-forge murmurhash 1.0.5 py38h3f7e68f_0 conda-forge nbclassic 0.2.6 pyhd8ed1ab_0 conda-forge nbclient 0.5.3 pyhd8ed1ab_0 conda-forge nbconvert 6.0.7 py38h10201cd_3 conda-forge nbformat 5.1.2 pyhd8ed1ab_1 conda-forge ncurses 6.2 h9aa5885_4 conda-forge nest-asyncio 1.4.3 pyhd8ed1ab_0 conda-forge nltk 3.4.4 py_0 conda-forge notebook 6.2.0 py38h10201cd_0 conda-forge numpy 1.18.5 pypi_0 pypi oauthlib 3.1.0 pypi_0 pypi olefile 0.46 pyh9f0ad1d_1 conda-forge openssl 1.1.1j h27ca646_0 conda-forge opt-einsum 3.3.0 pypi_0 pypi packaging 20.9 pyh44b312d_0 conda-forge pandas 1.2.3 py38h9b9bf68_0 conda-forge pandocfilters 1.4.2 py_1 conda-forge parso 0.8.1 pyhd8ed1ab_0 conda-forge pathy 0.4.0 pyhd8ed1ab_0 conda-forge pexpect 4.8.0 pyh9f0ad1d_2 conda-forge pickleshare 0.7.5 py_1003 conda-forge pillow 8.1.1 py38h5cebd47_0 conda-forge pip 20.2.4 pypi_0 pypi preshed 3.0.5 py38h3f7e68f_0 conda-forge prometheus_client 0.9.0 pyhd3deb0d_0 conda-forge prompt-toolkit 3.0.16 pyha770c72_0 conda-forge protobuf 3.15.4 pypi_0 pypi ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge pyasn1 0.4.8 py_0 conda-forge pyasn1-modules 0.2.8 pypi_0 pypi pycosat 0.6.3 py38h30f7421_1006 conda-forge pycparser 2.20 pyh9f0ad1d_2 conda-forge pydantic 1.7.3 py38h30f7421_1 conda-forge pygments 2.8.0 pyhd8ed1ab_0 conda-forge pyopenssl 20.0.1 pyhd8ed1ab_0 conda-forge pyparsing 2.4.7 pyh9f0ad1d_0 conda-forge pyrsistent 0.17.3 py38h30f7421_2 conda-forge pysocks 1.7.1 py38h10201cd_3 conda-forge python 3.8.6 h12cc5a1_5_cpython conda-forge python-dateutil 2.8.1 py_0 conda-forge python_abi 3.8 1_cp38 conda-forge pytz 2021.1 pyhd8ed1ab_0 conda-forge pyzmq 22.0.3 py38h876209b_1 conda-forge readline 8.0 hc8eb9b7_2 conda-forge requests 2.25.1 pyhd3deb0d_0 conda-forge requests-oauthlib 1.3.0 pypi_0 pypi rsa 4.7.2 pyh44b312d_0 conda-forge ruamel_yaml 0.15.80 py38h30f7421_1004 conda-forge s3transfer 0.3.4 pyhd8ed1ab_0 conda-forge scikit-learn 0.24.1 py38h397cc00_0 conda-forge scipy 1.6.0 py38hdf044fb_0 conda-forge send2trash 1.5.0 py_0 conda-forge setuptools 54.0.0 pypi_0 pypi shellingham 1.4.0 pyh44b312d_0 conda-forge six 1.15.0 pyh9f0ad1d_0 conda-forge smart_open 2.2.1 pyh9f0ad1d_0 conda-forge sniffio 1.2.0 py38h10201cd_1 conda-forge spacy 3.0.4 py38h3578e97_0 conda-forge spacy-legacy 3.0.1 pyhd8ed1ab_0 conda-forge sqlite 3.34.0 h6d56c25_0 conda-forge srsly 2.4.0 py38h3f7e68f_2 conda-forge tensorboard 2.4.1 pypi_0 pypi tensorboard-plugin-wit 1.8.0 pypi_0 pypi tensorflow 2.4.0rc0 pypi_0 pypi tensorflow-estimator 2.4.0 pypi_0 pypi tensorflow-hub 0.11.0 pypi_0 pypi termcolor 1.1.0 pypi_0 pypi terminado 0.9.2 py38h10201cd_0 conda-forge testpath 0.4.4 py_0 conda-forge thinc 8.0.2 py38h3578e97_0 conda-forge threadpoolctl 2.1.0 pyh5ca1d4c_0 conda-forge tk 8.6.10 hf7e6567_1 conda-forge tornado 6.1 py38h30f7421_1 conda-forge tqdm 4.57.0 pyhd8ed1ab_0 conda-forge traitlets 5.0.5 py_0 conda-forge typeguard 2.11.1 pypi_0 pypi typer 0.3.2 pyhd8ed1ab_0 conda-forge typing-extensions 3.7.4.3 0 conda-forge typing_extensions 3.7.4.3 py_0 conda-forge tzdata 2021a he74cb21_0 conda-forge urllib3 1.26.3 pyhd8ed1ab_0 conda-forge validators 0.18.2 pyhd3deb0d_0 conda-forge wasabi 0.8.2 pyh44b312d_0 conda-forge wcwidth 0.2.5 pyh9f0ad1d_2 conda-forge webencodings 0.5.1 py_1 conda-forge werkzeug 1.0.1 pyh9f0ad1d_0 conda-forge wheel 0.36.2 pypi_0 pypi wrapt 1.12.1 pypi_0 pypi xz 5.2.5 h642e427_1 conda-forge yaml 0.2.5 h642e427_0 conda-forge yarl 1.6.3 py38h30f7421_1 conda-forge zeromq 4.3.4 h9f76cd9_0 conda-forge zipp 3.4.0 py_0 conda-forge zlib 1.2.11 h31e879b_1009 conda-forge zstd 1.4.9 h5b28eab_0 conda-forge ```

Details about conda and system ( conda info ):

``` active environment : None shell level : 0 user config file : /Users/vivek/.condarc populated config files : /Users/vivek/miniforge3/.condarc /Users/vivek/.condarc conda version : 4.9.2 conda-build version : not installed python version : 3.8.6.final.0 virtual packages : __osx=11.1=0 __unix=0=0 __archspec=1=arm64 base environment : /Users/vivek/miniforge3 (read only) channel URLs : https://conda.anaconda.org/conda-forge/osx-arm64 https://conda.anaconda.org/conda-forge/noarch package cache : /Users/vivek/miniforge3/pkgs /Users/vivek/.conda/pkgs envs directories : /Users/vivek/.conda/envs /Users/vivek/miniforge3/envs platform : osx-arm64 user-agent : conda/4.9.2 requests/2.20.0 CPython/3.8.6 Darwin/20.2.0 OSX/11.1 UID:GID : 501:20 netrc file : /Users/vivek/.netrc offline mode : False ```

[hmaarrfk]

I'm not too sure if this is a miniforge issue. are you able totry to use mamba? it usually helps.

also, if you're bought an 8GB version, seriously consider returning your laptop getting a 16GB version

[wolfv]

It does sound more like a conda issue. The readthedocs team had good experiences with mamba as it has a lower memory footprint.

[intohay]

Did you try inserting "sudo" in front of the command? When I had the same issue as you, it helped me.

[Prasanna28Devadiga]

I'm not too sure if this is a miniforge issue. are you able totry to use mamba? it usually helps.

also, if you're bought an 8GB version, seriously consider returning your laptop getting a 16GB version

I'm unable to run conda install pydrive even with 4gb spare ram. Seriously doubt the issue here is with the RAM.

[hmaarrfk]

have you tried to use mamba? Conda forge is quite large....

[Prasanna28Devadiga]

I tried reinstalling conda. Its working fine now

[yzlnew]

Same issue keeps recurring after conda reinstallation.

[hmaarrfk]

are you using conda or mamba?

[yzlnew]

are you using conda or mamba?

conda

[hmaarrfk]

Please try to use mamba. It really does help on memory constrained systems. We know that conda has a hard time with conda-forge.

[yzlnew]

Please try to use mamba. It really does help on memory constrained systems. We know that conda has a hard time with conda-forge.

I'm on a 16GB model and experiencing this issue under certain situation but I can't reproduce it anymore.

[hmaarrfk]

unfortunately this really isn't the place to discuss bugs with Conda. please report them upstream.

[avinash051]

i am also facing this issue .. CondaMemoryError: The conda process ran out of memory. Increase system memory and/or try again....and stuck in between the project can anyone tell me how to resolve the issue.

[hmaarrfk]

Please open a new issue and provide as much information about your setup as possible.

[avinash051]

even not able to uninstall conda

[avinash051]

is there any way to encounter then please tell me

[spfeifer222]

Please try to use mamba. It really does help on memory constrained systems. We know that conda has a hard time with conda-forge.

This is hard to do if this error occures during installation of mamba itself.

[hmaarrfk]

Fyi Mambaforge bundles it.

[spfeifer222]

Thanks for your info!