PyPy and conda-forge | PyPy

[utterances-bot]

PyPy and conda-forge | PyPy

https://www.pypy.org/posts/2022/11/pypy-and-conda-forge.html

[elcolie]

I had init already.

CommandNotFoundError: Your shell has not been properly configured to use 'conda activate'.
To initialize your shell, run
...

[cyz1cyz]

When I run command "conda create -c conda-forge -n pp39 pypy python=3.9". It shows:

>>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

Traceback (most recent call last):
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 277, in _load
    raw_repodata_str = fetch_repodata_remote_request(
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 670, in fetch_repodata_remote_request
    raise Response304ContentUnchanged()
conda.core.subdir_data.Response304ContentUnchanged

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\exceptions.py", line 1129, in __call__
    return func(*args, **kwargs)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\cli\main.py", line 86, in main_subshell
    exit_code = do_call(args, p)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\cli\conda_argparse.py", line 93, in do_call
    return getattr(module, func_name)(args, parser)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\notices\core.py", line 72, in wrapper
    return_value = func(*args, **kwargs)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\cli\main_create.py", line 43, in execute
    install(args, parser, 'create')
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\cli\install.py", line 261, in install
    unlink_link_transaction = solver.solve_for_transaction(
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\solve.py", line 156, in solve_for_transaction
    unlink_precs, link_precs = self.solve_for_diff(update_modifier, deps_modifier,
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\solve.py", line 199, in solve_for_diff
    final_precs = self.solve_final_state(update_modifier, deps_modifier, prune, ignore_pinned,
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\solve.py", line 304, in solve_final_state
    ssc = self._collect_all_metadata(ssc)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\common\io.py", line 86, in decorated
    return f(*args, **kwds)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\solve.py", line 467, in _collect_all_metadata
    index, r = self._prepare(prepared_specs)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\solve.py", line 1061, in _prepare
    reduced_index = get_reduced_index(self.prefix, self.channels,
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\index.py", line 301, in get_reduced_index
    new_records = SubdirData.query_all(spec, channels=channels, subdirs=subdirs,
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 137, in query_all
    result = tuple(concat(executor.map(subdir_query, channel_urls)))
  File "C:\Users\60434\miniconda3\lib\concurrent\futures\_base.py", line 621, in result_iterator
    yield _result_or_cancel(fs.pop())
  File "C:\Users\60434\miniconda3\lib\concurrent\futures\_base.py", line 319, in _result_or_cancel
    return fut.result(timeout)
  File "C:\Users\60434\miniconda3\lib\concurrent\futures\_base.py", line 458, in result
    return self.__get_result()
  File "C:\Users\60434\miniconda3\lib\concurrent\futures\_base.py", line 403, in __get_result
    raise self._exception
  File "C:\Users\60434\miniconda3\lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 129, in <lambda>
    subdir_query = lambda url: tuple(SubdirData(Channel(url), repodata_fn=repodata_fn).query(
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 142, in query
    self.load()
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 207, in load
    _internal_state = self._load()
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 295, in _load
    _internal_state = self._read_local_repdata(mod_etag_headers.get('_etag'),
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 344, in _read_local_repdata
    _internal_state = self._process_raw_repodata_str(raw_repodata_str)
  File "C:\Users\60434\miniconda3\lib\site-packages\conda\core\subdir_data.py", line 382, in _process_raw_repodata_str
    json_obj = json.loads(raw_repodata_str or '{}')
  File "C:\Users\60434\miniconda3\lib\json\__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "C:\Users\60434\miniconda3\lib\json\decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "C:\Users\60434\miniconda3\lib\json\decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Unterminated string starting at: line 4258881 column 7 (char 128466834)

$ C:\Users\60434\miniconda3\Scripts\conda-script.py create -c conda-forge -n pp39 pypy python=3.9

environment variables: CIO_TEST= CONDA_DEFAULT_ENV=py39 CONDA_EXE=C:\Users\60434\miniconda3\Scripts\conda.exe CONDA_PREFIX=C:\Users\60434\miniconda3\envs\py39 CONDA_PROMPT_MODIFIER=(py39) CONDA_PYTHON_EXE=C:\Users\60434\miniconda3\python.exe CONDA_ROOT=C:\Users\60434\miniconda3 CONDA_SHLVL=1 CURL_CA_BUNDLE= HOMEPATH=\Users\60434 PATH=C:\Users\60434\miniconda3\envs\py39;C:\Users\60434\miniconda3\envs\py3 9\Library\mingw- w64\bin;C:\Users\60434\miniconda3\envs\py39\Library\usr\bin;C:\Users\6 0434\miniconda3\envs\py39\Library\bin;C:\Users\60434\miniconda3\envs\p y39\Scripts;C:\Users\60434\miniconda3\envs\py39\bin;C:\Users\60434\min iconda3\condabin;C:\Program Files\PowerShell\7;C:\Program Files\Window sApps\Microsoft.WindowsTerminal_1.15.2875.0_x64__8wekyb3d8bbwe;C:\WIND OWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\W indowsPowerShell\v1.0;C:\WINDOWS\System32\OpenSSH;C:\Program Files\MATLAB\R2022a\bin;C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit;C:\Program Files\Git\cmd;C:\Program Files\dotnet;C:\Program Files\PowerShell\7;C:\Users\60434\AppData\Loca l\Programs\Python\Python310\Scripts;C:\Users\60434\AppData\Local\Progr ams\Python\Python310;C:\Users\60434\AppData\Local\Microsoft\WindowsApp s;C:\Users\60434\AppData\Local\Programs\Microsoft VS Code\bin;D:\geant 4\install\bin;D:\Qt\Tools\CMake_64\bin;D:\Qt\5.15.11\msvc2019_64\bin;D :\clangd_15.0.3\bin;C:\Program Files\MATLAB\R2022a\extern\bin\win64;D: \Qt\6.4.0\msvc2019_64\bin;C:\Users\60434.dotnet\tools PSMODULEPATH=C:\Users\60434\Documents\PowerShell\Modules;C:\Program Files\PowerShell\Modules;c:\program files\powershell\7\Modules;C:\Program Files\WindowsPowerShell\Modules; C:\WINDOWS\system32\WindowsPowerShell\v1.0\Modules REQUESTS_CA_BUNDLE= SSL_CERT_FILE=

 active environment : py39
active env location : C:\Users\60434\miniconda3\envs\py39
        shell level : 1
   user config file : C:\Users\60434\.condarc

populated config files : C:\Users\60434.condarc conda version : 22.9.0 conda-build version : not installed python version : 3.10.6.final.0 virtual packages : win=0=0 archspec=1=x86_64 base environment : C:\Users\60434\miniconda3 (writable) conda av data dir : C:\Users\60434\miniconda3\etc\conda conda av metadata url : None channel URLs : https://mirrors.bfsu.edu.cn/anaconda/cloud/conda-forge/win-64 https://mirrors.bfsu.edu.cn/anaconda/cloud/conda-forge/noarch https://mirrors.bfsu.edu.cn/anaconda/pkgs/main/win-64 https://mirrors.bfsu.edu.cn/anaconda/pkgs/main/noarch https://mirrors.bfsu.edu.cn/anaconda/pkgs/r/win-64 https://mirrors.bfsu.edu.cn/anaconda/pkgs/r/noarch https://mirrors.bfsu.edu.cn/anaconda/pkgs/msys2/win-64 https://mirrors.bfsu.edu.cn/anaconda/pkgs/msys2/noarch package cache : C:\Users\60434\miniconda3\pkgs C:\Users\60434.conda\pkgs C:\Users\60434\AppData\Local\conda\conda\pkgs envs directories : C:\Users\60434\miniconda3\envs C:\Users\60434.conda\envs C:\Users\60434\AppData\Local\conda\conda\envs platform : win-64 user-agent : conda/22.9.0 requests/2.28.1 CPython/3.10.6 Windows/10 Windows/10.0.22621 administrator : False netrc file : None offline mode : False

An unexpected error has occurred. Conda has prepared the above report.

If submitted, this report will be used by core maintainers to improve future releases of conda. Would you like conda to send this report to the core maintainers? [y/N]:

It looks like have some error,I hope it can be fixed.

[mattip]

@cyz1cyz this is a conda problem. Did you submit the report as requested? FWIW, the command conda create -c conda-forge -n pp39 pypy python=3.9 works for me on windows with the same version of conda: 22.09 from miniconda. Perhaps it was a temporary download problem?

[cyz1cyz]

When I use conda-forge to install pypy3.8,it is all good. But when I do same with pypy39,it failed.@mattip

[mattip]

Did you try again? Perhaps it was a temporary internet failure. (No need to repost the error message)

[cyz1cyz]

Wow, When I clean .condarc ,then the error is disappeared.@mattip

[mpeters2]

(base)$ conda create -c conda-forge -n my-pypy-env pypy python=3.9 Collecting package metadata (current_repodata.json): done Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source. Collecting package metadata (repodata.json): done Solving environment: | Found conflicts! Looking for incompatible packages. This can take several minutes. Press CTRL-C to abort. failed

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versions

Package python conflicts for: python=3.9 pypy -> python[version='3.6.12|3.6.12|3.7.10|3.7.10|3.7.12|3.8.12|3.8.13|3.8.16|3.9.16|3.9.12|3.9.10|3.7.9|3.6.9|3.6.9|3.6.9|3.6.9',build='0_73_pypy|2_73_pypy|3_73_pypy|4_73_pypy|5_73_pypy|0_73_pypy|0_73_pypy|1_73_pypy|5_73_pypy|1_73_pypy'] Note that strict channel priority may have removed packages required for satisfiability.

[mattip]

@mpeters2 what platform/os are you using?

[mpeters2]

MacOS 12.6.2, ARM64

[mattip]

PyPy currently is not available for MacOS arm64 on conda. You have to force the x86_64 version. Support for macOS arm64 for pypy3 is complicated:

• Since conda-forge has not yet connected to a CI provider with macOS arm64 hardware, the first hurdle is to cross-compile the arm64 build on x86_64 macOS machines, and so far PyPy does not support this kind of cross-compilation.
• Once that gets worked out, conda-forge needs to start a migration to build out packages for the new python offering. This is a resource intensive process. It is not clear that there is enough demand to make this worthwhile.

[ahrib]

@mattip I don't think cross compile is the ideal solution - e.g. how would you run your tests?

It may be better to wait for updated github actions - Apple M1 runners are planned for Q4 2023: https://github.com/orgs/github/projects/4247?pane=issue&itemId=5944419

or something that could be immediately implemented - use an alternative CI provider that already supports this platform e.g. tart https://tart.run/integrations/github-actions/

[Astrotech89]

Any plans to update the conda-forge for python 3.10?

[mattip]

@Astrotech89 it is not a high priority. Is there something you could do with 3.10 that you cannot do with 3.9?

[xflicsu]

Some python package need python >=3.10. Could you update the conda-forge for python 3.10? When I install the 'infercnvpy' package, I get the error as follws:

############ Collecting scipy>1.4 (from anndata>=0.7.3->infercnvpy==0.4.4) Using cached https://pypi.tuna.tsinghua.edu.cn/packages/6e/1f/91144ba78dccea567a6466262922786ffc97be1e9b06ed9574ef0edc11e1/scipy-1.11.4.tar.gz (56.3 MB) Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... error error: subprocess-exited-with-error

× Preparing metadata (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [22 lines of output]

• meson setup /tmp/pip-install-skt98hk1/scipy_2dc1df9406a040a59bf5c996222e914b /tmp/pip-install-skt98hk1/scipy_2dc1df9406a040a59bf5c996222e914b/.mesonpy-pznj3o1n -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/tmp/pip-install-skt98hk1/scipy_2dc1df9406a040a59bf5c996222e914b/.mesonpy-pznj3o1n/meson-python-native-file.ini The Meson build system Version: 1.3.1 Source dir: /tmp/pip-install-skt98hk1/scipy_2dc1df9406a040a59bf5c996222e914b Build dir: /tmp/pip-install-skt98hk1/scipy_2dc1df9406a040a59bf5c996222e914b/.mesonpy-pznj3o1n Build type: native build Project name: SciPy Project version: 1.11.4 C compiler for the host machine: cc (gcc 4.8.5 "cc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-39)") C linker for the host machine: cc ld.bfd 2.27-43 C++ compiler for the host machine: c++ (gcc 9.1.0 "c++ (GCC) 9.1.0") C++ linker for the host machine: c++ ld.bfd 2.27-43 Cython compiler for the host machine: cython (cython 0.29.37) Host machine cpu family: x86_64 Host machine cpu: x86_64 Program python found: YES (/public/home/amcgc/anaconda3/envs/pypy/bin/python3.9) Run-time dependency python found: YES 3.9 Program cython found: YES (/tmp/pip-build-env-w854_ilb/overlay/bin/cython)

  ../meson.build:45:4: ERROR: Problem encountered: SciPy requires GCC >= 8.0

  A full log can be found at /tmp/pip-install-skt98hk1/scipy_2dc1df9406a040a59bf5c996222e914b/.mesonpy-pznj3o1n/meson-logs/meson-log.txt [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed

× Encountered error while generating package metadata. ╰─> See above for output.

note: This is an issue with the package mentioned above, not pip. ###############