piskvorky / gensim

Topic Modelling for Humans
https://radimrehurek.com/gensim
GNU Lesser General Public License v2.1
15.53k stars 4.37k forks source link

Installation with Poetry fails on Python 3.12 - `error: ‘PyArray_Descr’ {aka ‘struct _PyArray_Descr’} has no member named ‘subarray’` #3541

Closed juhoinkinen closed 1 month ago

juhoinkinen commented 1 month ago

Problem description

Installation of Gensim version 4.3.2 or current develop branch fails on Python 3.12 when using Poetry - when using pip there is no problem.

Noted this first from a failed run of our CI/CD pipeline, which installs v4.3.2. Two weeks ago it ran successfully.

Steps to reproduce

Success with pip

Run

docker run python:3.12 pip install gensim  # for v4.3.2

or

docker run python:3.12 pip install git+https://github.com/piskvorky/gensim.git@develop

The dependencies for the develop branch by pip are:

gensim 4.3.2.dev0
numpy 1.26.4
scipy 1.14.0
smart-open 7.0.4
wrapt 1.16.0
Fail with Poetry

Using this Dockerfile

FROM python:3.12

RUN pip install --upgrade pip poetry --no-cache-dir

COPY pyproject.toml pyproject.toml

RUN poetry install

and this pyproject.toml

[tool.poetry]
name = "gensim-testing"
version = "0.1.0"
description = ""
authors = ["Your Name <you@example.com>"]

[tool.poetry.dependencies]
python = "^3.12"

# gensim = "4.3.2"
gensim = { git = "https://github.com/piskvorky/gensim.git", branch = "develop" }

[build-system]
requires = ["poetry-core"]
build-backend = "poetry.core.masonry.api"

to build and install current develop branch (or v4.3.2) with the command

docker build -t gensim-build:3.12 .

the result is a failure at the following build step:

running build_ext
building 'gensim.models.word2vec_inner' extension
creating build/temp.linux-x86_64-cpython-312
creating build/temp.linux-x86_64-cpython-312/gensim
creating build/temp.linux-x86_64-cpython-312/gensim/models
gcc -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -I/tmp/tmp2ohmylfq/.venv/include -I/usr/local/include/python3.12 -I/tmp/tmp2ohmylfq/.venv/lib/python3.12/site-packages/numpy/_core/include -c gensim/models/word2vec_inner.c -o build/temp.linux-x86_64-cpython-312/gensim/models/word2vec_inner.o
In file included from /tmp/tmp2ohmylfq/.venv/lib/python3.12/site-packages/numpy/_core/include/numpy/ndarraytypes.h:1909,
                from /tmp/tmp2ohmylfq/.venv/lib/python3.12/site-packages/numpy/_core/include/numpy/ndarrayobject.h:12,
                from /tmp/tmp2ohmylfq/.venv/lib/python3.12/site-packages/numpy/_core/include/numpy/arrayobject.h:5,
                from gensim/models/word2vec_inner.c:771:
/tmp/tmp2ohmylfq/.venv/lib/python3.12/site-packages/numpy/_core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp]
17 | #warning "Using deprecated NumPy API, disable it with " \
    |  ^~~~~~~
In file included from /usr/local/include/python3.12/Python.h:38,
                from gensim/models/word2vec_inner.c:25:
gensim/models/word2vec_inner.c: In function ‘__pyx_f_5numpy_PyDataType_SHAPE’:
gensim/models/word2vec_inner.c:9365:39: error: ‘PyArray_Descr’ {aka ‘struct _PyArray_Descr’} has no member named ‘subarray’
9365 |     __Pyx_INCREF(((PyObject*)__pyx_v_d->subarray->shape));
    |                                       ^~
/usr/local/include/python3.12/pyport.h:24:38: note: in definition of macro ‘_Py_CAST’
24 | #define _Py_CAST(type, expr) ((type)(expr))
    |                                      ^~~~
/usr/local/include/python3.12/object.h:661:35: note: in expansion of macro ‘_PyObject_CAST’
661 | #  define Py_INCREF(op) Py_INCREF(_PyObject_CAST(op))
    |                                   ^~~~~~~~~~~~~~
gensim/models/word2vec_inner.c:1435:27: note: in expansion of macro ‘Py_INCREF’
1435 |   #define __Pyx_INCREF(r) Py_INCREF(r)
    |                           ^~~~~~~~~
gensim/models/word2vec_inner.c:9365:5: note: in expansion of macro ‘__Pyx_INCREF’
9365 |     __Pyx_INCREF(((PyObject*)__pyx_v_d->subarray->shape));
    |     ^~~~~~~~~~~~
gensim/models/word2vec_inner.c:9366:36: error: ‘PyArray_Descr’ {aka ‘struct _PyArray_Descr’} has no member named ‘subarray’
9366 |     __pyx_r = ((PyObject*)__pyx_v_d->subarray->shape);
    |                                    ^~
error: command '/usr/bin/gcc' failed with exit code 1

(I thought this was something to do with the Numpy 2.0 release, but the current develop branch has already pinned Numpy to <2.0. So it seems something else than Numpy is causing this.)

The dependencies by Poetry resolution are the same as by pip.

When using Python 3.11 the installation is successful with Poetry, and the dependencies are the same.

Versions

Python 3.12.4 Poetry 1.8.3

juhoinkinen commented 1 month ago
See full logs from the Poetry run here (note the apparently harmless warnings) [+] Building 485.8s (8/8) FINISHED docker:default => [internal] load build definition from Dockerfile 0.0s => => transferring dockerfile: 163B 0.0s => [internal] load metadata for docker.io/library/python:3.12 0.0s => [internal] load .dockerignore 0.0s => => transferring context: 2B 0.0s => [1/4] FROM docker.io/library/python:3.12 0.2s => [internal] load build context 0.1s => => transferring context: 36B 0.0s => [2/4] RUN pip install --upgrade pip poetry --no-cache-dir 36.7s => [3/4] COPY pyproject.toml pyproject.toml 0.1s => ERROR [4/4] RUN poetry install 448.7s ------ > [4/4] RUN poetry install: 1.091 Creating virtualenv gensim-testing-il7asoJj-py3.12 in /root/.cache/pypoetry/virtualenvs 1.597 Updating dependencies 1.597 Resolving dependencies... 369.7 369.7 Package operations: 5 installs, 0 updates, 0 removals 369.7 369.7 - Installing numpy (1.26.4) 369.7 - Installing wrapt (1.16.0) 385.8 - Installing scipy (1.14.0) 385.8 - Installing smart-open (7.0.4) 422.7 - Installing gensim (4.3.2.dev0 dc5b5c4) 447.5 447.5 ChefBuildError 447.5 447.5 Backend subprocess exited when trying to invoke build_wheel 447.5 447.5 running bdist_wheel 447.5 running build 447.5 running build_py 447.5 creating build 447.5 creating build/lib.linux-x86_64-cpython-312 447.5 creating build/lib.linux-x86_64-cpython-312/gensim 447.5 copying gensim/utils.py -> build/lib.linux-x86_64-cpython-312/gensim 447.5 copying gensim/matutils.py -> build/lib.linux-x86_64-cpython-312/gensim 447.5 copying gensim/nosy.py -> build/lib.linux-x86_64-cpython-312/gensim 447.5 copying gensim/interfaces.py -> build/lib.linux-x86_64-cpython-312/gensim 447.5 copying gensim/downloader.py -> build/lib.linux-x86_64-cpython-312/gensim 447.5 copying gensim/__init__.py -> build/lib.linux-x86_64-cpython-312/gensim 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/segment_wiki.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/glove2word2vec.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/package_info.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/word2vec_standalone.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/word2vec2tensor.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/make_wiki_online_nodebug.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/make_wiki_online.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/make_wikicorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/make_wiki.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/__init__.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 copying gensim/scripts/benchmark.py -> build/lib.linux-x86_64-cpython-312/gensim/scripts 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_lee.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/utils.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_translation_matrix.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_nmf.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_keyedvectors.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_datatype.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_doc2vec.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/simspeed2.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_scripts.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_tfidfmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_parsing.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_normmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_bm25model.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/simspeed.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_poincare.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_direct_confirmation.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_lsimodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_word2vec.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_probability_estimation.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_miislita.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_utils.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_ldamodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_similarities.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_atmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_ensemblelda.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_corpora_dictionary.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_glove2word2vec.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_hdpmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_api.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/svd_error.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_tmdiff.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_text_analysis.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_similarity_metrics.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_rpmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_matutils.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_sharded_corpus.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_indirect_confirmation.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_lda_callback.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_phrases.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_big.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_coherencemodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_corpora_hashdictionary.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_segmentation.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_fasttext.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_corpora.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/basetmtests.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_aggregation.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_logentropy_model.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/__init__.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 copying gensim/test/test_ldaseqmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/test 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/topic_coherence 447.5 copying gensim/topic_coherence/indirect_confirmation_measure.py -> build/lib.linux-x86_64-cpython-312/gensim/topic_coherence 447.5 copying gensim/topic_coherence/direct_confirmation_measure.py -> build/lib.linux-x86_64-cpython-312/gensim/topic_coherence 447.5 copying gensim/topic_coherence/aggregation.py -> build/lib.linux-x86_64-cpython-312/gensim/topic_coherence 447.5 copying gensim/topic_coherence/text_analysis.py -> build/lib.linux-x86_64-cpython-312/gensim/topic_coherence 447.5 copying gensim/topic_coherence/segmentation.py -> build/lib.linux-x86_64-cpython-312/gensim/topic_coherence 447.5 copying gensim/topic_coherence/probability_estimation.py -> build/lib.linux-x86_64-cpython-312/gensim/topic_coherence 447.5 copying gensim/topic_coherence/__init__.py -> build/lib.linux-x86_64-cpython-312/gensim/topic_coherence 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/keyedvectors.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/lsi_worker.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/hdpmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/lda_dispatcher.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/normmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/lsimodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/basemodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/lsi_dispatcher.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/callbacks.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/fasttext.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/rpmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/lda_worker.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/phrases.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/bm25model.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/logentropy_model.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/ensemblelda.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/translation_matrix.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/ldaseqmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/word2vec.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/atmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/poincare.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/tfidfmodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/coherencemodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/nmf.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/doc2vec.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/ldamodel.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/ldamulticore.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/__init__.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/_fasttext_bin.py -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/similarities 447.5 copying gensim/similarities/nmslib.py -> build/lib.linux-x86_64-cpython-312/gensim/similarities 447.5 copying gensim/similarities/docsim.py -> build/lib.linux-x86_64-cpython-312/gensim/similarities 447.5 copying gensim/similarities/levenshtein.py -> build/lib.linux-x86_64-cpython-312/gensim/similarities 447.5 copying gensim/similarities/termsim.py -> build/lib.linux-x86_64-cpython-312/gensim/similarities 447.5 copying gensim/similarities/annoy.py -> build/lib.linux-x86_64-cpython-312/gensim/similarities 447.5 copying gensim/similarities/__init__.py -> build/lib.linux-x86_64-cpython-312/gensim/similarities 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/parsing 447.5 copying gensim/parsing/preprocessing.py -> build/lib.linux-x86_64-cpython-312/gensim/parsing 447.5 copying gensim/parsing/porter.py -> build/lib.linux-x86_64-cpython-312/gensim/parsing 447.5 copying gensim/parsing/__init__.py -> build/lib.linux-x86_64-cpython-312/gensim/parsing 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/svmlightcorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/opinosiscorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/hashdictionary.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/wikicorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/mmcorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/lowcorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/csvcorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/bleicorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/dictionary.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/ucicorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/indexedcorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/sharded_corpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/malletcorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/__init__.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/textcorpus.py -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 running egg_info 447.5 writing gensim.egg-info/PKG-INFO 447.5 writing dependency_links to gensim.egg-info/dependency_links.txt 447.5 writing requirements to gensim.egg-info/requires.txt 447.5 writing top-level names to gensim.egg-info/top_level.txt 447.5 reading manifest file 'gensim.egg-info/SOURCES.txt' 447.5 reading manifest template 'MANIFEST.in' 447.5 adding license file 'COPYING' 447.5 writing manifest file 'gensim.egg-info/SOURCES.txt' 447.5 /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/setuptools/command/build_py.py:215: _Warning: Package 'gensim.test.test_data' is absent from the `packages` configuration. 447.5 !! 447.5 447.5 ******************************************************************************** 447.5 ############################ 447.5 # Package would be ignored # 447.5 ############################ 447.5 Python recognizes 'gensim.test.test_data' as an importable package[^1], 447.5 but it is absent from setuptools' `packages` configuration. 447.5 447.5 This leads to an ambiguous overall configuration. If you want to distribute this 447.5 package, please make sure that 'gensim.test.test_data' is explicitly added 447.5 to the `packages` configuration field. 447.5 447.5 Alternatively, you can also rely on setuptools' discovery methods 447.5 (for example by using `find_namespace_packages(...)`/`find_namespace:` 447.5 instead of `find_packages(...)`/`find:`). 447.5 447.5 You can read more about "package discovery" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 447.5 447.5 If you don't want 'gensim.test.test_data' to be distributed and are 447.5 already explicitly excluding 'gensim.test.test_data' via 447.5 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 447.5 you can try to use `exclude_package_data`, or `include-package-data=False` in 447.5 combination with a more fine grained `package-data` configuration. 447.5 447.5 You can read more about "package data files" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 447.5 447.5 447.5 [^1]: For Python, any directory (with suitable naming) can be imported, 447.5 even if it does not contain any `.py` files. 447.5 On the other hand, currently there is no concept of package data 447.5 directory, all directories are treated like packages. 447.5 ******************************************************************************** 447.5 447.5 !! 447.5 check.warn(importable) 447.5 /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/setuptools/command/build_py.py:215: _Warning: Package 'gensim.test.test_data.DTM' is absent from the `packages` configuration. 447.5 !! 447.5 447.5 ******************************************************************************** 447.5 ############################ 447.5 # Package would be ignored # 447.5 ############################ 447.5 Python recognizes 'gensim.test.test_data.DTM' as an importable package[^1], 447.5 but it is absent from setuptools' `packages` configuration. 447.5 447.5 This leads to an ambiguous overall configuration. If you want to distribute this 447.5 package, please make sure that 'gensim.test.test_data.DTM' is explicitly added 447.5 to the `packages` configuration field. 447.5 447.5 Alternatively, you can also rely on setuptools' discovery methods 447.5 (for example by using `find_namespace_packages(...)`/`find_namespace:` 447.5 instead of `find_packages(...)`/`find:`). 447.5 447.5 You can read more about "package discovery" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 447.5 447.5 If you don't want 'gensim.test.test_data.DTM' to be distributed and are 447.5 already explicitly excluding 'gensim.test.test_data.DTM' via 447.5 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 447.5 you can try to use `exclude_package_data`, or `include-package-data=False` in 447.5 combination with a more fine grained `package-data` configuration. 447.5 447.5 You can read more about "package data files" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 447.5 447.5 447.5 [^1]: For Python, any directory (with suitable naming) can be imported, 447.5 even if it does not contain any `.py` files. 447.5 On the other hand, currently there is no concept of package data 447.5 directory, all directories are treated like packages. 447.5 ******************************************************************************** 447.5 447.5 !! 447.5 check.warn(importable) 447.5 /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/setuptools/command/build_py.py:215: _Warning: Package 'gensim.test.test_data.PathLineSentences' is absent from the `packages` configuration. 447.5 !! 447.5 447.5 ******************************************************************************** 447.5 ############################ 447.5 # Package would be ignored # 447.5 ############################ 447.5 Python recognizes 'gensim.test.test_data.PathLineSentences' as an importable package[^1], 447.5 but it is absent from setuptools' `packages` configuration. 447.5 447.5 This leads to an ambiguous overall configuration. If you want to distribute this 447.5 package, please make sure that 'gensim.test.test_data.PathLineSentences' is explicitly added 447.5 to the `packages` configuration field. 447.5 447.5 Alternatively, you can also rely on setuptools' discovery methods 447.5 (for example by using `find_namespace_packages(...)`/`find_namespace:` 447.5 instead of `find_packages(...)`/`find:`). 447.5 447.5 You can read more about "package discovery" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 447.5 447.5 If you don't want 'gensim.test.test_data.PathLineSentences' to be distributed and are 447.5 already explicitly excluding 'gensim.test.test_data.PathLineSentences' via 447.5 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 447.5 you can try to use `exclude_package_data`, or `include-package-data=False` in 447.5 combination with a more fine grained `package-data` configuration. 447.5 447.5 You can read more about "package data files" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 447.5 447.5 447.5 [^1]: For Python, any directory (with suitable naming) can be imported, 447.5 even if it does not contain any `.py` files. 447.5 On the other hand, currently there is no concept of package data 447.5 directory, all directories are treated like packages. 447.5 ******************************************************************************** 447.5 447.5 !! 447.5 check.warn(importable) 447.5 /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/setuptools/command/build_py.py:215: _Warning: Package 'gensim.test.test_data.old_d2v_models' is absent from the `packages` configuration. 447.5 !! 447.5 447.5 ******************************************************************************** 447.5 ############################ 447.5 # Package would be ignored # 447.5 ############################ 447.5 Python recognizes 'gensim.test.test_data.old_d2v_models' as an importable package[^1], 447.5 but it is absent from setuptools' `packages` configuration. 447.5 447.5 This leads to an ambiguous overall configuration. If you want to distribute this 447.5 package, please make sure that 'gensim.test.test_data.old_d2v_models' is explicitly added 447.5 to the `packages` configuration field. 447.5 447.5 Alternatively, you can also rely on setuptools' discovery methods 447.5 (for example by using `find_namespace_packages(...)`/`find_namespace:` 447.5 instead of `find_packages(...)`/`find:`). 447.5 447.5 You can read more about "package discovery" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 447.5 447.5 If you don't want 'gensim.test.test_data.old_d2v_models' to be distributed and are 447.5 already explicitly excluding 'gensim.test.test_data.old_d2v_models' via 447.5 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 447.5 you can try to use `exclude_package_data`, or `include-package-data=False` in 447.5 combination with a more fine grained `package-data` configuration. 447.5 447.5 You can read more about "package data files" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 447.5 447.5 447.5 [^1]: For Python, any directory (with suitable naming) can be imported, 447.5 even if it does not contain any `.py` files. 447.5 On the other hand, currently there is no concept of package data 447.5 directory, all directories are treated like packages. 447.5 ******************************************************************************** 447.5 447.5 !! 447.5 check.warn(importable) 447.5 /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/setuptools/command/build_py.py:215: _Warning: Package 'gensim.test.test_data.old_w2v_models' is absent from the `packages` configuration. 447.5 !! 447.5 447.5 ******************************************************************************** 447.5 ############################ 447.5 # Package would be ignored # 447.5 ############################ 447.5 Python recognizes 'gensim.test.test_data.old_w2v_models' as an importable package[^1], 447.5 but it is absent from setuptools' `packages` configuration. 447.5 447.5 This leads to an ambiguous overall configuration. If you want to distribute this 447.5 package, please make sure that 'gensim.test.test_data.old_w2v_models' is explicitly added 447.5 to the `packages` configuration field. 447.5 447.5 Alternatively, you can also rely on setuptools' discovery methods 447.5 (for example by using `find_namespace_packages(...)`/`find_namespace:` 447.5 instead of `find_packages(...)`/`find:`). 447.5 447.5 You can read more about "package discovery" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 447.5 447.5 If you don't want 'gensim.test.test_data.old_w2v_models' to be distributed and are 447.5 already explicitly excluding 'gensim.test.test_data.old_w2v_models' via 447.5 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 447.5 you can try to use `exclude_package_data`, or `include-package-data=False` in 447.5 combination with a more fine grained `package-data` configuration. 447.5 447.5 You can read more about "package data files" on setuptools documentation page: 447.5 447.5 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 447.5 447.5 447.5 [^1]: For Python, any directory (with suitable naming) can be imported, 447.5 even if it does not contain any `.py` files. 447.5 On the other hand, currently there is no concept of package data 447.5 directory, all directories are treated like packages. 447.5 ******************************************************************************** 447.5 447.5 !! 447.5 check.warn(importable) 447.5 copying gensim/_matutils.c -> build/lib.linux-x86_64-cpython-312/gensim 447.5 copying gensim/_matutils.pyx -> build/lib.linux-x86_64-cpython-312/gensim 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/EN.1-10.cbow1_wind5_hs0_neg10_size300_smpl1e-05.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/IT.1-10.cbow1_wind5_hs0_neg10_size300_smpl1e-05.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/OPUS_en_it_europarl_train_one2ten.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/alldata-id-10.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/atmodel_3_0_1_model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/atmodel_3_0_1_model.expElogbeta.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/atmodel_3_0_1_model.id2word -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/atmodel_3_0_1_model.state -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/bgwiki-latest-pages-articles-shortened.xml.bz2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/compatible-hash-true.model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/cp852_fasttext.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/crime-and-punishment.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/crime-and-punishment.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/crime-and-punishment.vec -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/d2v-lee-v0.13.0 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/doc2vec_old -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/doc2vec_old_sep -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/doc2vec_old_sep.syn0_lockf.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/doc2vec_old_sep.syn1neg.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/dtm_test.dict -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/dtm_test.mm -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ensemblelda -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/enwiki-latest-pages-articles1.xml-p000000010p000030302-shortened.bz2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/enwiki-table-markup.xml.bz2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/euclidean_vectors.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/fasttext_old -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/fasttext_old_sep -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/fasttext_old_sep.syn0_lockf.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/fasttext_old_sep.syn1neg.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/fb-ngrams.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ft_kv_3.6.0.model.gz -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ft_model_2.3.0 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/head500.noblanks.cor -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/head500.noblanks.cor.bz2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/head500.noblanks.cor_tfidf.model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/head500.noblanks.cor_wordids.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/high_precision.kv.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/high_precision.kv.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/large_tag_doc_10_iter50 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lda_3_0_1_model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lda_3_0_1_model.expElogbeta.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lda_3_0_1_model.id2word -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lda_3_0_1_model.state -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldamodel_python_2_7 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldamodel_python_2_7.expElogbeta.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldamodel_python_2_7.id2word -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldamodel_python_2_7.state -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldamodel_python_3_5 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldamodel_python_3_5.expElogbeta.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldamodel_python_3_5.id2word -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldamodel_python_3_5.state -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldavowpalwabbit.dict.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/ldavowpalwabbit.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lee.cor -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lee_background.cor -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lee_fasttext -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lee_fasttext.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lee_fasttext.vec -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/lee_fasttext_new.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/miIslita.cor -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/mini_newsgroup -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/model-from-gensim-3.8.0.w2v -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/nmf_model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/non_ascii_fasttext.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/old_keyedvectors_320.dat -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/pang_lee_polarity.cor -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/pang_lee_polarity_fasttext.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/pang_lee_polarity_fasttext.vec -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/para2para_text1.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/para2para_text2.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/phraser-3.6.0.model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/phraser-no-common-terms.pkl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/phraser-no-scoring.pkl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/phraser-scoring-str.pkl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/phrases-3.6.0.model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/phrases-no-common-terms.pkl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/phrases-no-scoring.pkl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/phrases-scoring-str.pkl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/poincare_cp852.tsv -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/poincare_hypernyms.tsv -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/poincare_hypernyms_large.tsv -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/poincare_test_3.4.0 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/poincare_utf8.tsv -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/poincare_vectors.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/pre_0_13_2_model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/pre_0_13_2_model.state -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/pretrained.vec -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/questions-words.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/reproduce.dat -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/reproduce.dat.gz -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/similarities0-1.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/simlex999.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/small_tag_doc_5_iter50 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_corpus_ok.mm -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_corpus_small.mm -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_glove.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_mmcorpus_corrupt.mm -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_mmcorpus_no_index.mm -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_mmcorpus_no_index.mm.bz2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_mmcorpus_no_index.mm.gz -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_mmcorpus_overflow.mm -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_mmcorpus_with_index.mm -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/test_mmcorpus_with_index.mm.index -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.blei -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.blei.index -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.blei.vocab -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.low -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.low.index -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.mallet -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.mallet.index -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.mm -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.mm.index -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.svmlight -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.svmlight.index -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.uci -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.uci.index -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.uci.vocab -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/testcorpus.xml.bz2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/tfidf_model.tst -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/tfidf_model.tst.bz2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/tfidf_model_3_2.tst -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/toy-data.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/toy-model-pretrained.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/toy-model.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/toy-model.vec -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/varembed_lee_subcorpus.cor -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/varembed_morfessor.bin -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/varembed_vectors.pkl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/w2v-lee-v0.12.0 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/w2v_keyedvectors_load_test.modeldata -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/w2v_keyedvectors_load_test.vocab -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_3.3 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_old -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_old_sep -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_old_sep.syn0_lockf.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_old_sep.syn1neg.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_c -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_py2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_py3 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_py3_4 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py2.neg_labels.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py2.syn0.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py2.syn0_lockf.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py2.syn1neg.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3.neg_labels.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3.syn0.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3.syn0_lockf.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3.syn1neg.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3_4 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3_4.neg_labels.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3_4.syn0.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3_4.syn0_lockf.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/word2vec_pre_kv_sep_py3_4.syn1neg.npy -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 copying gensim/test/test_data/wordsim353.tsv -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/test/test_data/DTM 447.5 copying gensim/test/test_data/DTM/ldaseq_3_0_1_model -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/DTM 447.5 copying gensim/test/test_data/DTM/sstats_test.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/DTM 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/test/test_data/PathLineSentences 447.5 copying gensim/test/test_data/PathLineSentences/1.txt -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/PathLineSentences 447.5 copying gensim/test/test_data/PathLineSentences/2.txt.bz2 -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/PathLineSentences 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.12.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.12.1.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.12.2.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.12.3.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.12.4.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.13.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.13.1.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.13.2.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.13.3.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_0.13.4.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_1.0.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_1.0.1.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_2.0.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_2.1.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_2.2.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_2.3.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_3.0.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_3.1.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_3.2.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_3.3.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 copying gensim/test/test_data/old_d2v_models/d2v_3.4.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_d2v_models 447.5 creating build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.12.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.12.1.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.12.2.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.12.3.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.12.4.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.13.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.13.1.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.13.2.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.13.3.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_0.13.4.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_1.0.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_1.0.1.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_2.0.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_2.1.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_2.2.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_2.3.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_3.0.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_3.1.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_3.2.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_3.3.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/test/test_data/old_w2v_models/w2v_3.4.0.mdl -> build/lib.linux-x86_64-cpython-312/gensim/test/test_data/old_w2v_models 447.5 copying gensim/models/doc2vec_corpusfile.cpp -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/doc2vec_corpusfile.pyx -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/doc2vec_inner.cpp -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/doc2vec_inner.pxd -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/doc2vec_inner.pyx -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/fast_line_sentence.h -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/fasttext_corpusfile.cpp -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/fasttext_corpusfile.pyx -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/fasttext_inner.c -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/fasttext_inner.pxd -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/fasttext_inner.pyx -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/nmf_pgd.c -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/nmf_pgd.pyx -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/stdint_wrapper.h -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/voidptr.h -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/word2vec_corpusfile.cpp -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/word2vec_corpusfile.pxd -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/word2vec_corpusfile.pyx -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/word2vec_inner.c -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/word2vec_inner.pxd -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/models/word2vec_inner.pyx -> build/lib.linux-x86_64-cpython-312/gensim/models 447.5 copying gensim/similarities/fastss.c -> build/lib.linux-x86_64-cpython-312/gensim/similarities 447.5 copying gensim/corpora/_mmreader.c -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 copying gensim/corpora/_mmreader.pyx -> build/lib.linux-x86_64-cpython-312/gensim/corpora 447.5 running build_ext 447.5 building 'gensim.models.word2vec_inner' extension 447.5 creating build/temp.linux-x86_64-cpython-312 447.5 creating build/temp.linux-x86_64-cpython-312/gensim 447.5 creating build/temp.linux-x86_64-cpython-312/gensim/models 447.5 gcc -fno-strict-overflow -Wsign-compare -DNDEBUG -g -O3 -Wall -fPIC -I/tmp/tmpcsk1p7k4/.venv/include -I/usr/local/include/python3.12 -I/tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/numpy/_core/include -c gensim/models/word2vec_inner.c -o build/temp.linux-x86_64-cpython-312/gensim/models/word2vec_inner.o 447.5 In file included from /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/numpy/_core/include/numpy/ndarraytypes.h:1909, 447.5 from /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/numpy/_core/include/numpy/ndarrayobject.h:12, 447.5 from /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/numpy/_core/include/numpy/arrayobject.h:5, 447.5 from gensim/models/word2vec_inner.c:771: 447.5 /tmp/tmpcsk1p7k4/.venv/lib/python3.12/site-packages/numpy/_core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: #warning "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-Wcpp] 447.5 17 | #warning "Using deprecated NumPy API, disable it with " \ 447.5 | ^~~~~~~ 447.5 In file included from /usr/local/include/python3.12/Python.h:38, 447.5 from gensim/models/word2vec_inner.c:25: 447.5 gensim/models/word2vec_inner.c: In function ‘__pyx_f_5numpy_PyDataType_SHAPE’: 447.5 gensim/models/word2vec_inner.c:9365:39: error: ‘PyArray_Descr’ {aka ‘struct _PyArray_Descr’} has no member named ‘subarray’ 447.5 9365 | __Pyx_INCREF(((PyObject*)__pyx_v_d->subarray->shape)); 447.5 | ^~ 447.5 /usr/local/include/python3.12/pyport.h:24:38: note: in definition of macro ‘_Py_CAST’ 447.5 24 | #define _Py_CAST(type, expr) ((type)(expr)) 447.5 | ^~~~ 447.5 /usr/local/include/python3.12/object.h:661:35: note: in expansion of macro ‘_PyObject_CAST’ 447.5 661 | # define Py_INCREF(op) Py_INCREF(_PyObject_CAST(op)) 447.5 | ^~~~~~~~~~~~~~ 447.5 gensim/models/word2vec_inner.c:1435:27: note: in expansion of macro ‘Py_INCREF’ 447.5 1435 | #define __Pyx_INCREF(r) Py_INCREF(r) 447.5 | ^~~~~~~~~ 447.5 gensim/models/word2vec_inner.c:9365:5: note: in expansion of macro ‘__Pyx_INCREF’ 447.5 9365 | __Pyx_INCREF(((PyObject*)__pyx_v_d->subarray->shape)); 447.5 | ^~~~~~~~~~~~ 447.5 gensim/models/word2vec_inner.c:9366:36: error: ‘PyArray_Descr’ {aka ‘struct _PyArray_Descr’} has no member named ‘subarray’ 447.5 9366 | __pyx_r = ((PyObject*)__pyx_v_d->subarray->shape); 447.5 | ^~ 447.5 error: command '/usr/bin/gcc' failed with exit code 1 447.5 447.5 447.5 at /usr/local/lib/python3.12/site-packages/poetry/installation/chef.py:164 in _prepare 447.5 160│ 447.5 161│ error = ChefBuildError("\n\n".join(message_parts)) 447.5 162│ 447.5 163│ if error is not None: 447.5 → 164│ raise error from None 447.5 165│ 447.5 166│ return path 447.5 167│ 447.5 168│ def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path: ------ Dockerfile:7 -------------------- 5 | COPY pyproject.toml pyproject.toml 6 | 7 | >>> RUN poetry install 8 | -------------------- ERROR: failed to solve: process "/bin/sh -c poetry install" did not complete successfully: exit code: 1
juhoinkinen commented 1 month ago

Scipy 1.14.0 was released last week, but seems it does not affect this: pinning Scipy version to 1.13.0 in the pyproject.toml results in the same error.

juhoinkinen commented 1 month ago

Somehow Numpy 2.0 is the cause for this, as discussed in issue https://github.com/TA-Lib/ta-lib-python/issues/655 and resolved by https://github.com/TA-Lib/ta-lib-python/pull/656.

Maybe the same (temporary?) fix could be used for Gensim too?

juhoinkinen commented 1 month ago

Maybe the same (temporary?) fix could be used for Gensim too?

The fix, that is the constraint numpy <2.0 (along with the scipy version constraint), makes it possible to install and build gensim for Python 3.12 with Poetry; try this in pyproject.toml:

gensim = { git = "https://github.com/juhoinkinen/gensim.git", branch = "develop" }
juhoinkinen commented 1 month ago

The constraint "numpy <2.0" is no more needed after the merge or PR #3538, so I close this. This in pyproject.toml makes Docker build succeed:

gensim = { git = "https://github.com/piskvorky/gensim.git", branch = "develop" }

I guess it's because of the removal of "scipy<=1.13.1" from build dependencies.