search

INWTlab / dbrequests

python package built for easy use of raw SQL within python and pandas projects
MIT License
5 stars 2 forks source link

Installing dependencies via pipenv fails: Package datatable==1.0.0 throws error #56

Open chamaoskurumi opened 3 years ago

chamaoskurumi commented 3 years ago

Problem

me@on_a_linux_machine:~/git_repos/dbrequests$ pipenv update
Creating a virtualenv for this project…
Pipfile: /nethome/gschulz/git_repos/dbrequests/Pipfile
Using /usr/bin/python3.8 (3.8.10) to create virtualenv…
⠼ Creating virtual environment...created virtual environment CPython3.8.10.final.0-64 in 1012ms
  creator CPython3Posix(dest=/nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_, clear=False, global=False)
  seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, via=copy, app_data_dir=/nethome/gschulz/.local/share/virtualenv/seed-app-data/v1.0.1)
  activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator

✔ Successfully created virtual environment! 
Virtualenv location: /nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_
Running $ pipenv lock then $ pipenv sync.
Locking [dev-packages] dependencies…
✔ Success! 
Locking [packages] dependencies…
✔ Success! 
Updated Pipfile.lock (d824fa)!
Installing dependencies from Pipfile.lock (d824fa)…
An error occurred while installing datatable==1.0.0 --hash=sha256:0f50ae778452a37fe7fb1de810888652d5048044bdfd0584699c2f5d550a0fc7 --hash=sha256:2d3fa399273aaa5498c29a304e0558ce8f0bbe836305e3c1f2016029024f42c6 --hash=sha256:2ef6f5712c088c849df299b57927d75695baf5f3ad21f26e9328d111d8128054 --hash=sha256:3a35e562ffcb46c0f02bd9f7d9c89248122748691733cf0f275bccb3cd2b7255 --hash=sha256:4f8760b169a8847e95c5413b65eb3b5e094f049a76fb72096b8dccbac2f4f28a --hash=sha256:59a00a4a928f9b06f881d4f7b5e9025c559c4f65facf903a5d08e6e94d84c31e --hash=sha256:5b0f5cc118d78dafb5fd8b3512afbd798d6954f71ff171ba2d64e75e088fe34c --hash=sha256:6eac42709214a53fe2624b586d66040d053dbcdb94436c96edc3628a79c9e61d --hash=sha256:708b3a236f8b7b09096dd704b204fd429a54c93cdf0472abd4001dd106c738ab --hash=sha256:7427d6b211fccae949a67c76251e503f86deb16e6d308fd3a63afd70f0885f11 --hash=sha256:a3e315019a1bae11e1b4ce84d81e557fb4915b6597033d46821a27e249bfdaeb --hash=sha256:a83e750079591eda72b07a1f53a5683479b06118b41b677a88d959044ebf25d8 --hash=sha256:a9350f8a3539ac984543413f8055cadfa9f3171b6ce415a41b980c9fab614b4a --hash=sha256:ae33b368bcbbcfc7fd75d4a96d8e93e7f6f783f1f447be5215d1fb615da823dc --hash=sha256:b4978d23ec87441e38a3d4044addb55f3c8e19d97219a3907fd6770450dd37e2 --hash=sha256:d407d5f89f77e0b4a1398056eb1e502558e3661010cf913b12e79905604cd230 --hash=sha256:d87725a9285dc3f038244c02e7c71fc06f222f9a48dfc7c322a00f50af50dbc0! Will try again.
  🐍   ▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ 9/9 — 00:00:15
Installing initially failed dependencies…
[pipenv.exceptions.InstallError]:   File "/usr/local/lib/python3.8/dist-packages/pipenv/core.py", line 2604, in do_sync
[pipenv.exceptions.InstallError]:       do_init(
[pipenv.exceptions.InstallError]:   File "/usr/local/lib/python3.8/dist-packages/pipenv/core.py", line 1246, in do_init
[pipenv.exceptions.InstallError]:       do_install_dependencies(
[pipenv.exceptions.InstallError]:   File "/usr/local/lib/python3.8/dist-packages/pipenv/core.py", line 858, in do_install_dependencies
[pipenv.exceptions.InstallError]:       batch_install(
[pipenv.exceptions.InstallError]:   File "/usr/local/lib/python3.8/dist-packages/pipenv/core.py", line 763, in batch_install
[pipenv.exceptions.InstallError]:       _cleanup_procs(procs, not blocking, failed_deps_queue, retry=retry)
[pipenv.exceptions.InstallError]:   File "/usr/local/lib/python3.8/dist-packages/pipenv/core.py", line 681, in _cleanup_procs
[pipenv.exceptions.InstallError]:       raise exceptions.InstallError(c.dep.name, extra=err_lines)
[pipenv.exceptions.InstallError]: ['Collecting datatable==1.0.0', '  Using cached datatable-1.0.0.tar.gz (1.1 MB)', '  Getting requirements to build wheel: started', "  Getting requirements to build wheel: finished with status 'done'", '    Preparing wheel metadata: started', "    Preparing wheel metadata: finished with status 'error'"]
[pipenv.exceptions.InstallError]: ['ERROR: Command errored out with exit status 1:', '     command: /nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/bin/python /nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py prepare_metadata_for_build_wheel /tmp/tmpxwfk1e1v', '         cwd: /tmp/pip-install-92h_yo7o/datatable', '    Complete output (41 lines):', '    \x1b[90mBuilding extension \x1b[1;97m_datatable\x1b[0;90m\x1b[m', "    \x1b[90mBuild directory = 'build/build'\x1b[m", "    \x1b[90mCreated directory 'build/build'\x1b[m", "    \x1b[90mDestination directory = 'src/datatable/lib'\x1b[m", "    \x1b[90mAdded 309 source files from pattern \x1b[1;97msrc/core/**/*.cc\x1b[0;90m: ['src/core/datatablemodule.cc', 'src/core/sort_groups.cc', 'src/core/call_logger.cc', 'src/core/writebuf.cc', 'src/core/stats.cc', 'src/core/sort.cc', 'src/core/groupby.cc', 'src/core/ltype.cc', 'src/core/rowindex_array.cc', 'src/core/wstringcol.cc', 'src/core/buffer.cc', 'src/core/column_from_arrow.cc', 'src/core/column_from_python.cc', 'src/core/rowindex.cc', 'src/core/options.cc', 'src/core/column.cc', 'src/core/sort_insert.cc', 'src/core/stype.cc', 'src/core/mmm.cc', 'src/core/set_funcs.cc', 'src/core/py_buffers.cc', 'src/core/api.cc', 'src/core/datatable.cc', 'src/core/py_encodings.cc', 'src/core/rowindex_slice.cc', 'src/core/encodings.cc', 'src/core/cstring.cc', 'src/core/jay/save_jay.cc', 'src/core/jay/open_jay.cc', 'src/core/write/write_chronicler.cc', 'src/core/write/writing_context.cc', 'src/core/write/write_manager.cc', 'src/core/write/csv_writer.cc', 'src/core/write/value_writer.cc', 'src/core/types/py_type.cc', 'src/core/types/type_string.cc', 'src/core/types/typeimpl_numeric.cc', 'src/core/types/type_object.cc', 'src/core/types/type.cc', 'src/core/types/type_void.cc', 'src/core/types/type_date.cc', 'src/core/types/type_float.cc', 'src/core/types/type_bool.cc', 'src/core/types/type_time.cc', 'src/core/types/typeimpl.cc', 'src/core/types/type_int.cc', 'src/core/types/type_invalid.cc', 'src/core/csv/reader_fread.cc', 'src/core/csv/fread.cc', 'src/core/csv/toa.cc', 'src/core/csv/reader.cc', 'src/core/csv/reader_arff.cc', 'src/core/sort/sorter.cc', 'src/core/str/split_into_nhot.cc', 'src/core/python/dict.cc', 'src/core/python/list.cc', 'src/core/python/tuple.cc', 'src/core/python/args.cc', 'src/core/python/slice.cc', 'src/core/python/xobject.cc', 'src/core/python/date.cc', 'src/core/python/namedtuple.cc', 'src/core/python/iter.cc', 'src/core/python/arg.cc', 'src/core/python/range.cc', 'src/core/python/float.cc', 'src/core/python/pybuffer.cc', 'src/core/python/xargs.cc', 'src/core/python/set.cc', 'src/core/python/bool.cc', 'src/core/python/obj.cc', 'src/core/python/string.cc', 'src/core/python/int.cc', 'src/core/utils/fuzzy_match.cc', 'src/core/utils/alloc.cc', 'src/core/utils/exceptions.cc', 'src/core/utils/temporary_file.cc', 'src/core/utils/file.cc', 'src/core/utils/wcwidth.cc', 'src/core/utils/misc.cc', 'src/core/utils/logger.cc', 'src/core/utils/tests.cc', 'src/core/utils/terminal/terminal.cc', 'src/core/utils/terminal/terminal_stream.cc', 'src/core/utils/terminal/tstring.cc', 'src/core/utils/terminal/tstring_styled.cc', 'src/core/utils/terminal/tstring_impl.cc', 'src/core/utils/terminal/tstring_mixed.cc', 'src/core/utils/terminal/tstring_plain.cc', 'src/core/parallel/string_utils.cc', 'src/core/parallel/parallel_region.cc', 'src/core/parallel/python_lock.cc', 'src/core/parallel/job_idle.cc', 'src/core/parallel/thread_job.cc', 'src/core/parallel/parallel_for_ordered.cc', 'src/core/parallel/parallel_for_dynamic.cc', 'src/core/parallel/api_primitives.cc', 'src/core/parallel/job_shutdown.cc', 'src/core/parallel/thread_worker.cc', 'src/core/parallel/thread_team.cc', 'src/core/parallel/thread_pool.cc', 'src/core/lib/zlib/crc32.cc', 'src/core/lib/zlib/adler32.cc', 'src/core/lib/zlib/trees.cc', 'src/core/lib/zlib/deflate.cc', 'src/core/lib/zlib/zutil.cc', 'src/core/lib/mman/mman.cc', 'src/core/lib/hh/date.cc', 'src/core/expr/head_func.cc', 'src/core/expr/py_join.cc', 'src/core/expr/fexpr_column_asarg.cc', 'src/core/expr/head_reduce.cc', 'src/core/expr/fexpr_slice.cc', 'src/core/expr/fexpr_literal_bool.cc', 'src/core/expr/head_func_isclose.cc', 'src/core/expr/fexpr_dict.cc', 'src/core/expr/namespace.cc', 'src/core/expr/head_reduce_unary.cc', 'src/core/expr/workframe.cc', 'src/core/expr/fexpr_literal_type.cc', 'src/core/expr/fexpr_literal_int.cc', 'src/core/expr/fexpr_literal_none.cc', 'src/core/expr/fexpr_literal_sliceall.cc', 'src/core/expr/fexpr_astype.cc', 'src/core/expr/head_func_binary.cc', 'src/core/expr/head_reduce_nullary.cc', 'src/core/expr/fexpr_func.cc', 'src/core/expr/expr.cc', 'src/core/expr/fexpr_cut.cc', 'src/core/expr/fexpr_list.cc', 'src/core/expr/fexpr_frame.cc', 'src/core/expr/head_reduce_binary.cc', 'src/core/expr/head_func_unary.cc', 'src/core/expr/fexpr_round.cc', 'src/core/expr/fexpr_literal.cc', 'src/core/expr/fexpr_literal_slicestr.cc', 'src/core/expr/fexpr_literal_float.cc', 'src/core/expr/head.cc', 'src/core/expr/fexpr_literal_sliceint.cc', 'src/core/expr/fexpr_literal_string.cc', 'src/core/expr/args_registry.cc', 'src/core/expr/fexpr_func_unary.cc', 'src/core/expr/fexpr_literal_range.cc', 'src/core/expr/py_by.cc', 'src/core/expr/head_func_colset.cc', 'src/core/expr/eval_context.cc', 'src/core/expr/py_update.cc', 'src/core/expr/fexpr_qcut.cc', 'src/core/expr/fexpr_ifelse.cc', 'src/core/expr/fexpr.cc', 'src/core/expr/fexpr_column_asattr.cc', 'src/core/expr/py_sort.cc', 'src/core/expr/head_func_shift.cc', 'src/core/expr/funary/pyfn.cc', 'src/core/expr/funary/basic.cc', 'src/core/expr/funary/exponential.cc', 'src/core/expr/funary/hyperbolic.cc', 'src/core/expr/funary/trigonometric.cc', 'src/core/expr/funary/umaker.cc', 'src/core/expr/funary/special.cc', 'src/core/expr/funary/floating.cc', 'src/core/expr/str/fexpr_len.cc', 'src/core/expr/fbinary/pyfn.cc', 'src/core/expr/fbinary/fexpr__mul__.cc', 'src/core/expr/fbinary/math.cc', 'src/core/expr/fbinary/bitwise.cc', 'src/core/expr/fbinary/fexpr__ge__.cc', 'src/core/expr/fbinary/fexpr__le__.cc', 'src/core/expr/fbinary/bimaker.cc', 'src/core/expr/fbinary/fexpr__pow__.cc', 'src/core/expr/fbinary/fexpr__lt__.cc', 'src/core/expr/fbinary/fexpr__floordiv__.cc', 'src/core/expr/fbinary/fexpr__gt__.cc', 'src/core/expr/fbinary/fexpr__add__.cc', 'src/core/expr/fbinary/fexpr__truediv__.cc', 'src/core/expr/fbinary/fexpr__mod__.cc', 'src/core/expr/fbinary/fexpr__eq__.cc', 'src/core/expr/fbinary/fexpr_binaryop.cc', 'src/core/expr/fbinary/fexpr__compare__.cc', 'src/core/expr/fbinary/fexpr__ne__.cc', 'src/core/expr/fbinary/fexpr__sub__.cc', 'src/core/expr/fnary/rowcount.cc', 'src/core/expr/fnary/rowany.cc', 'src/core/expr/fnary/rowmean.cc', 'src/core/expr/fnary/fnary.cc', 'src/core/expr/fnary/rowall.cc', 'src/core/expr/fnary/rowsd.cc', 'src/core/expr/fnary/rowsum.cc', 'src/core/expr/fnary/rowfirstlast.cc', 'src/core/expr/fnary/rowminmax.cc', 'src/core/expr/time/fexpr_hour_min_sec.cc', 'src/core/expr/time/fexpr_ymdt.cc', 'src/core/expr/time/fexpr_day_of_week.cc', 'src/core/expr/time/fexpr_year_month_day.cc', 'src/core/expr/time/fexpr_ymd.cc', 'src/core/expr/re/fexpr_match.cc', 'src/core/progress/progress_manager.cc', 'src/core/progress/_options.cc', 'src/core/progress/work.cc', 'src/core/progress/progress_bar.cc', 'src/core/tests/test_shared_mutex.cc', 'src/core/tests/test_progress.cc', 'src/core/tests/test_atomic.cc', 'src/core/tests/test_parallel_for.cc', 'src/core/tests/test_barrier.cc', 'src/core/tests/test_parallel_for_ordered.cc', 'src/core/column/sentinel.cc', 'src/core/column/ifelsen.cc', 'src/core/column/pysources.cc', 'src/core/column/cast_to_date32.cc', 'src/core/column/cast_to_string.cc', 'src/core/column/cast_to_time64.cc', 'src/core/column/truncated.cc', 'src/core/column/virtual.cc', 'src/core/column/npmasked.cc', 'src/core/column/date_from_years.cc', 'src/core/column/repeated.cc', 'src/core/column/string_plus.cc', 'src/core/column/cast_object.cc', 'src/core/column/ifelse.cc', 'src/core/column/cast_to_obj.cc', 'src/core/column/cast_date32.cc', 'src/core/column/view.cc', 'src/core/column/cast.cc', 'src/core/column/sentinel_str.cc', 'src/core/column/string_slice.cc', 'src/core/column/arrow_bool.cc', 'src/core/column/range.cc', 'src/core/column/rbound.cc', 'src/core/column/cast_string.cc', 'src/core/column/arrow_str.cc', 'src/core/column/const_na.cc', 'src/core/column/cast_to_bool.cc', 'src/core/column/latent.cc', 'src/core/column/cast_numeric.cc', 'src/core/column/cast_bool.cc', 'src/core/column/date_from_weeks.cc', 'src/core/column/arrow_fw.cc', 'src/core/column/time_scaled.cc', 'src/core/column/sentinel_fw.cc', 'src/core/column/arrow_void.cc', 'src/core/column/column_impl.cc', 'src/core/column/date_from_months.cc', 'src/core/column/const.cc', 'src/core/column/re_match.cc', 'src/core/column/nafilled.cc', 'src/core/read/chunk_coordinates.cc', 'src/core/read/multisource.cc', 'src/core/read/constants.cc', 'src/core/read/input_column.cc', 'src/core/read/output_column.cc', 'src/core/read/parallel_reader.cc', 'src/core/read/parse_context.cc', 'src/core/read/preframe.cc', 'src/core/read/source.cc', 'src/core/read/thread_context.cc', 'src/core/read/py_read_iterator.cc', 'src/core/read/py_fread.cc', 'src/core/read/fread/fread_parallel_reader.cc', 'src/core/read/fread/fread_thread_context.cc', 'src/core/read/parsers/info.cc', 'src/core/read/parsers/parse_time.cc', 'src/core/read/parsers/parse_bool.cc', 'src/core/read/parsers/parse_void.cc', 'src/core/read/parsers/parse_float.cc', 'src/core/read/parsers/parse_date.cc', 'src/core/read/parsers/parse_int.cc', 'src/core/read/parsers/ptype_iterator.cc', 'src/core/read/parsers/parse_string.cc', 'src/core/models/dt_ftrl.cc', 'src/core/models/column_caster.cc', 'src/core/models/py_ftrl.cc', 'src/core/models/dt_linearmodel.cc', 'src/core/models/py_validator.cc', 'src/core/models/py_linearmodel.cc', 'src/core/models/column_hasher.cc', 'src/core/models/dt_linearmodel_base.cc', 'src/core/models/dt_ftrl_base.cc', 'src/core/models/murmurhash.cc', 'src/core/models/utils.cc', 'src/core/models/label_encode.cc', 'src/core/models/aggregate.cc', 'src/core/models/kfold.cc', 'src/core/frame/cbind.cc', 'src/core/frame/replace.cc', 'src/core/frame/__repr__.cc', 'src/core/frame/__getitem__.cc', 'src/core/frame/__iter__.cc', 'src/core/frame/stats.cc', 'src/core/frame/key.cc', 'src/core/frame/repeat.cc', 'src/core/frame/to_csv.cc', 'src/core/frame/join.cc', 'src/core/frame/integrity_check.cc', 'src/core/frame/to_pandas.cc', 'src/core/frame/rbind.cc', 'src/core/frame/__sizeof__.cc', 'src/core/frame/__getbuffer__.cc', 'src/core/frame/py_frame.cc', 'src/core/frame/to_python.cc', 'src/core/frame/names.cc', 'src/core/frame/__init__.cc', 'src/core/frame/to_arrow.cc', 'src/core/frame/to_numpy.cc', 'src/core/frame/repr/repr_options.cc', 'src/core/frame/repr/terminal_widget.cc', 'src/core/frame/repr/widget.cc', 'src/core/frame/repr/html_styles.cc', 'src/core/frame/repr/text_column.cc']\x1b[m", '    \x1b[90mUsing compiler of class xbuild.compiler.Compiler\x1b[m', '    \x1b[90mUsing compiler \x1b[1;97mgcc\x1b[0;90m\x1b[m', "    \x1b[90mAdded include directory 'src/core'\x1b[m", "    \x1b[90mAdded include directory '/usr/include/python3.8'\x1b[m", "    \x1b[90mOutput file name will be \x1b[1;97m'src/datatable/lib/_datatable.cpython-38-x86_64-linux-gnu.so'\x1b[0;90m\x1b[m", '    \x1b[90m==== BUILD ====\x1b[m', '    \x1b[90m[1] Loading previous state from file \x1b[1;97mbuild/build/.xbuild\x1b[0;90m\x1b[m', '        \x1b[90mThe file does not exist\x1b[m', '        \x1b[90mAll source files will be recompiled\x1b[m', '    Traceback (most recent call last):', '      File "/nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py", line 103, in prepare_metadata_for_build_wheel', '        hook = backend.prepare_metadata_for_build_wheel', "    AttributeError: module 'ext' has no attribute 'prepare_metadata_for_build_wheel'", '    ', '    During handling of the above exception, another exception occurred:', '    ', '    Traceback (most recent call last):', '      File "/nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py", line 257, in <module>', '        main()', '      File "/nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py", line 240, in main', "        json_out['return_val'] = hook(**hook_input['kwargs'])", '      File "/nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py", line 107, in prepare_metadata_for_build_wheel', '        return _get_wheel_metadata_from_wheel(backend, metadata_directory,', '      File "/nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py", line 136, in _get_wheel_metadata_from_wheel', '        whl_basename = backend.build_wheel(metadata_directory, config_settings)', '      File "/tmp/pip-install-92h_yo7o/datatable/ci/ext.py", line 587, in build_wheel', '        so_file = build_extension(cmd=("debug" if debug_wheel else "build"),', '      File "/tmp/pip-install-92h_yo7o/datatable/ci/ext.py", line 360, in build_extension', '        ext.build()', '      File "/tmp/pip-install-92h_yo7o/datatable/ci/xbuild/extension.py", line 439, in build', '        self._run_prebuild_triggers()', '      File "/tmp/pip-install-92h_yo7o/datatable/ci/xbuild/extension.py", line 488, in _run_prebuild_triggers', '        fn(self)', '      File "/tmp/pip-install-92h_yo7o/datatable/ci/ext.py", line 369, in generate_documentation', '        import gendoc', "    ModuleNotFoundError: No module named 'gendoc'", '    ----------------------------------------', 'ERROR: Command errored out with exit status 1: /nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/bin/python /nethome/gschulz/.local/share/virtualenvs/dbrequests-h13Hvd4_/lib/python3.8/site-packages/pip/_vendor/pep517/_in_process.py prepare_metadata_for_build_wheel /tmp/tmpxwfk1e1v Check the logs for full command output.']
ERROR: ERROR: Package installation failed...
  ☤  ▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉▉ 0/1 — 00
me@on_a_linux_machine:~/git_repos/dbrequests$ python3 -m pip install datatable==1.0.0
Collecting datatable==1.0.0
  Using cached datatable-1.0.0.tar.gz (1.1 MB)
  Getting requirements to build wheel ... done
    Preparing wheel metadata ... error
    ERROR: Command errored out with exit status 1:
     command: /usr/bin/python3 /tmp/tmpflenq2ay prepare_metadata_for_build_wheel /tmp/tmpef0_p5x1
         cwd: /tmp/pip-install-q4i9mana/datatable
    Complete output (41 lines):
    Building extension _datatable
    Build directory = 'build/build'
    Created directory 'build/build'
    Destination directory = 'src/datatable/lib'
    Added 309 source files from pattern src/core/**/*.cc: ['src/core/datatablemodule.cc', 'src/core/sort_groups.cc', 'src/core/call_logger.cc', 'src/core/writebuf.cc', 'src/core/stats.cc', 'src/core/sort.cc', 'src/core/groupby.cc', 'src/core/ltype.cc', 'src/core/rowindex_array.cc', 'src/core/wstringcol.cc', 'src/core/buffer.cc', 'src/core/column_from_arrow.cc', 'src/core/column_from_python.cc', 'src/core/rowindex.cc', 'src/core/options.cc', 'src/core/column.cc', 'src/core/sort_insert.cc', 'src/core/stype.cc', 'src/core/mmm.cc', 'src/core/set_funcs.cc', 'src/core/py_buffers.cc', 'src/core/api.cc', 'src/core/datatable.cc', 'src/core/py_encodings.cc', 'src/core/rowindex_slice.cc', 'src/core/encodings.cc', 'src/core/cstring.cc', 'src/core/jay/save_jay.cc', 'src/core/jay/open_jay.cc', 'src/core/write/write_chronicler.cc', 'src/core/write/writing_context.cc', 'src/core/write/write_manager.cc', 'src/core/write/csv_writer.cc', 'src/core/write/value_writer.cc', 'src/core/types/py_type.cc', 'src/core/types/type_string.cc', 'src/core/types/typeimpl_numeric.cc', 'src/core/types/type_object.cc', 'src/core/types/type.cc', 'src/core/types/type_void.cc', 'src/core/types/type_date.cc', 'src/core/types/type_float.cc', 'src/core/types/type_bool.cc', 'src/core/types/type_time.cc', 'src/core/types/typeimpl.cc', 'src/core/types/type_int.cc', 'src/core/types/type_invalid.cc', 'src/core/csv/reader_fread.cc', 'src/core/csv/fread.cc', 'src/core/csv/toa.cc', 'src/core/csv/reader.cc', 'src/core/csv/reader_arff.cc', 'src/core/sort/sorter.cc', 'src/core/str/split_into_nhot.cc', 'src/core/python/dict.cc', 'src/core/python/list.cc', 'src/core/python/tuple.cc', 'src/core/python/args.cc', 'src/core/python/slice.cc', 'src/core/python/xobject.cc', 'src/core/python/date.cc', 'src/core/python/namedtuple.cc', 'src/core/python/iter.cc', 'src/core/python/arg.cc', 'src/core/python/range.cc', 'src/core/python/float.cc', 'src/core/python/pybuffer.cc', 'src/core/python/xargs.cc', 'src/core/python/set.cc', 'src/core/python/bool.cc', 'src/core/python/obj.cc', 'src/core/python/string.cc', 'src/core/python/int.cc', 'src/core/utils/fuzzy_match.cc', 'src/core/utils/alloc.cc', 'src/core/utils/exceptions.cc', 'src/core/utils/temporary_file.cc', 'src/core/utils/file.cc', 'src/core/utils/wcwidth.cc', 'src/core/utils/misc.cc', 'src/core/utils/logger.cc', 'src/core/utils/tests.cc', 'src/core/utils/terminal/terminal.cc', 'src/core/utils/terminal/terminal_stream.cc', 'src/core/utils/terminal/tstring.cc', 'src/core/utils/terminal/tstring_styled.cc', 'src/core/utils/terminal/tstring_impl.cc', 'src/core/utils/terminal/tstring_mixed.cc', 'src/core/utils/terminal/tstring_plain.cc', 'src/core/parallel/string_utils.cc', 'src/core/parallel/parallel_region.cc', 'src/core/parallel/python_lock.cc', 'src/core/parallel/job_idle.cc', 'src/core/parallel/thread_job.cc', 'src/core/parallel/parallel_for_ordered.cc', 'src/core/parallel/parallel_for_dynamic.cc', 'src/core/parallel/api_primitives.cc', 'src/core/parallel/job_shutdown.cc', 'src/core/parallel/thread_worker.cc', 'src/core/parallel/thread_team.cc', 'src/core/parallel/thread_pool.cc', 'src/core/lib/zlib/crc32.cc', 'src/core/lib/zlib/adler32.cc', 'src/core/lib/zlib/trees.cc', 'src/core/lib/zlib/deflate.cc', 'src/core/lib/zlib/zutil.cc', 'src/core/lib/mman/mman.cc', 'src/core/lib/hh/date.cc', 'src/core/expr/head_func.cc', 'src/core/expr/py_join.cc', 'src/core/expr/fexpr_column_asarg.cc', 'src/core/expr/head_reduce.cc', 'src/core/expr/fexpr_slice.cc', 'src/core/expr/fexpr_literal_bool.cc', 'src/core/expr/head_func_isclose.cc', 'src/core/expr/fexpr_dict.cc', 'src/core/expr/namespace.cc', 'src/core/expr/head_reduce_unary.cc', 'src/core/expr/workframe.cc', 'src/core/expr/fexpr_literal_type.cc', 'src/core/expr/fexpr_literal_int.cc', 'src/core/expr/fexpr_literal_none.cc', 'src/core/expr/fexpr_literal_sliceall.cc', 'src/core/expr/fexpr_astype.cc', 'src/core/expr/head_func_binary.cc', 'src/core/expr/head_reduce_nullary.cc', 'src/core/expr/fexpr_func.cc', 'src/core/expr/expr.cc', 'src/core/expr/fexpr_cut.cc', 'src/core/expr/fexpr_list.cc', 'src/core/expr/fexpr_frame.cc', 'src/core/expr/head_reduce_binary.cc', 'src/core/expr/head_func_unary.cc', 'src/core/expr/fexpr_round.cc', 'src/core/expr/fexpr_literal.cc', 'src/core/expr/fexpr_literal_slicestr.cc', 'src/core/expr/fexpr_literal_float.cc', 'src/core/expr/head.cc', 'src/core/expr/fexpr_literal_sliceint.cc', 'src/core/expr/fexpr_literal_string.cc', 'src/core/expr/args_registry.cc', 'src/core/expr/fexpr_func_unary.cc', 'src/core/expr/fexpr_literal_range.cc', 'src/core/expr/py_by.cc', 'src/core/expr/head_func_colset.cc', 'src/core/expr/eval_context.cc', 'src/core/expr/py_update.cc', 'src/core/expr/fexpr_qcut.cc', 'src/core/expr/fexpr_ifelse.cc', 'src/core/expr/fexpr.cc', 'src/core/expr/fexpr_column_asattr.cc', 'src/core/expr/py_sort.cc', 'src/core/expr/head_func_shift.cc', 'src/core/expr/funary/pyfn.cc', 'src/core/expr/funary/basic.cc', 'src/core/expr/funary/exponential.cc', 'src/core/expr/funary/hyperbolic.cc', 'src/core/expr/funary/trigonometric.cc', 'src/core/expr/funary/umaker.cc', 'src/core/expr/funary/special.cc', 'src/core/expr/funary/floating.cc', 'src/core/expr/str/fexpr_len.cc', 'src/core/expr/fbinary/pyfn.cc', 'src/core/expr/fbinary/fexpr__mul__.cc', 'src/core/expr/fbinary/math.cc', 'src/core/expr/fbinary/bitwise.cc', 'src/core/expr/fbinary/fexpr__ge__.cc', 'src/core/expr/fbinary/fexpr__le__.cc', 'src/core/expr/fbinary/bimaker.cc', 'src/core/expr/fbinary/fexpr__pow__.cc', 'src/core/expr/fbinary/fexpr__lt__.cc', 'src/core/expr/fbinary/fexpr__floordiv__.cc', 'src/core/expr/fbinary/fexpr__gt__.cc', 'src/core/expr/fbinary/fexpr__add__.cc', 'src/core/expr/fbinary/fexpr__truediv__.cc', 'src/core/expr/fbinary/fexpr__mod__.cc', 'src/core/expr/fbinary/fexpr__eq__.cc', 'src/core/expr/fbinary/fexpr_binaryop.cc', 'src/core/expr/fbinary/fexpr__compare__.cc', 'src/core/expr/fbinary/fexpr__ne__.cc', 'src/core/expr/fbinary/fexpr__sub__.cc', 'src/core/expr/fnary/rowcount.cc', 'src/core/expr/fnary/rowany.cc', 'src/core/expr/fnary/rowmean.cc', 'src/core/expr/fnary/fnary.cc', 'src/core/expr/fnary/rowall.cc', 'src/core/expr/fnary/rowsd.cc', 'src/core/expr/fnary/rowsum.cc', 'src/core/expr/fnary/rowfirstlast.cc', 'src/core/expr/fnary/rowminmax.cc', 'src/core/expr/time/fexpr_hour_min_sec.cc', 'src/core/expr/time/fexpr_ymdt.cc', 'src/core/expr/time/fexpr_day_of_week.cc', 'src/core/expr/time/fexpr_year_month_day.cc', 'src/core/expr/time/fexpr_ymd.cc', 'src/core/expr/re/fexpr_match.cc', 'src/core/progress/progress_manager.cc', 'src/core/progress/_options.cc', 'src/core/progress/work.cc', 'src/core/progress/progress_bar.cc', 'src/core/tests/test_shared_mutex.cc', 'src/core/tests/test_progress.cc', 'src/core/tests/test_atomic.cc', 'src/core/tests/test_parallel_for.cc', 'src/core/tests/test_barrier.cc', 'src/core/tests/test_parallel_for_ordered.cc', 'src/core/column/sentinel.cc', 'src/core/column/ifelsen.cc', 'src/core/column/pysources.cc', 'src/core/column/cast_to_date32.cc', 'src/core/column/cast_to_string.cc', 'src/core/column/cast_to_time64.cc', 'src/core/column/truncated.cc', 'src/core/column/virtual.cc', 'src/core/column/npmasked.cc', 'src/core/column/date_from_years.cc', 'src/core/column/repeated.cc', 'src/core/column/string_plus.cc', 'src/core/column/cast_object.cc', 'src/core/column/ifelse.cc', 'src/core/column/cast_to_obj.cc', 'src/core/column/cast_date32.cc', 'src/core/column/view.cc', 'src/core/column/cast.cc', 'src/core/column/sentinel_str.cc', 'src/core/column/string_slice.cc', 'src/core/column/arrow_bool.cc', 'src/core/column/range.cc', 'src/core/column/rbound.cc', 'src/core/column/cast_string.cc', 'src/core/column/arrow_str.cc', 'src/core/column/const_na.cc', 'src/core/column/cast_to_bool.cc', 'src/core/column/latent.cc', 'src/core/column/cast_numeric.cc', 'src/core/column/cast_bool.cc', 'src/core/column/date_from_weeks.cc', 'src/core/column/arrow_fw.cc', 'src/core/column/time_scaled.cc', 'src/core/column/sentinel_fw.cc', 'src/core/column/arrow_void.cc', 'src/core/column/column_impl.cc', 'src/core/column/date_from_months.cc', 'src/core/column/const.cc', 'src/core/column/re_match.cc', 'src/core/column/nafilled.cc', 'src/core/read/chunk_coordinates.cc', 'src/core/read/multisource.cc', 'src/core/read/constants.cc', 'src/core/read/input_column.cc', 'src/core/read/output_column.cc', 'src/core/read/parallel_reader.cc', 'src/core/read/parse_context.cc', 'src/core/read/preframe.cc', 'src/core/read/source.cc', 'src/core/read/thread_context.cc', 'src/core/read/py_read_iterator.cc', 'src/core/read/py_fread.cc', 'src/core/read/fread/fread_parallel_reader.cc', 'src/core/read/fread/fread_thread_context.cc', 'src/core/read/parsers/info.cc', 'src/core/read/parsers/parse_time.cc', 'src/core/read/parsers/parse_bool.cc', 'src/core/read/parsers/parse_void.cc', 'src/core/read/parsers/parse_float.cc', 'src/core/read/parsers/parse_date.cc', 'src/core/read/parsers/parse_int.cc', 'src/core/read/parsers/ptype_iterator.cc', 'src/core/read/parsers/parse_string.cc', 'src/core/models/dt_ftrl.cc', 'src/core/models/column_caster.cc', 'src/core/models/py_ftrl.cc', 'src/core/models/dt_linearmodel.cc', 'src/core/models/py_validator.cc', 'src/core/models/py_linearmodel.cc', 'src/core/models/column_hasher.cc', 'src/core/models/dt_linearmodel_base.cc', 'src/core/models/dt_ftrl_base.cc', 'src/core/models/murmurhash.cc', 'src/core/models/utils.cc', 'src/core/models/label_encode.cc', 'src/core/models/aggregate.cc', 'src/core/models/kfold.cc', 'src/core/frame/cbind.cc', 'src/core/frame/replace.cc', 'src/core/frame/__repr__.cc', 'src/core/frame/__getitem__.cc', 'src/core/frame/__iter__.cc', 'src/core/frame/stats.cc', 'src/core/frame/key.cc', 'src/core/frame/repeat.cc', 'src/core/frame/to_csv.cc', 'src/core/frame/join.cc', 'src/core/frame/integrity_check.cc', 'src/core/frame/to_pandas.cc', 'src/core/frame/rbind.cc', 'src/core/frame/__sizeof__.cc', 'src/core/frame/__getbuffer__.cc', 'src/core/frame/py_frame.cc', 'src/core/frame/to_python.cc', 'src/core/frame/names.cc', 'src/core/frame/__init__.cc', 'src/core/frame/to_arrow.cc', 'src/core/frame/to_numpy.cc', 'src/core/frame/repr/repr_options.cc', 'src/core/frame/repr/terminal_widget.cc', 'src/core/frame/repr/widget.cc', 'src/core/frame/repr/html_styles.cc', 'src/core/frame/repr/text_column.cc']
    Using compiler of class xbuild.compiler.Compiler
    Using compiler gcc
    Added include directory 'src/core'
    Added include directory '/usr/include/python3.8'
    Output file name will be 'src/datatable/lib/_datatable.cpython-38-x86_64-linux-gnu.so'
    ==== BUILD ====
    [1] Loading previous state from file build/build/.xbuild
        The file does not exist
        All source files will be recompiled
    Traceback (most recent call last):
      File "/tmp/tmpflenq2ay", line 126, in prepare_metadata_for_build_wheel
        hook = backend.prepare_metadata_for_build_wheel
    AttributeError: module 'ext' has no attribute 'prepare_metadata_for_build_wheel'

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
      File "/tmp/tmpflenq2ay", line 280, in <module>
        main()
      File "/tmp/tmpflenq2ay", line 263, in main
        json_out['return_val'] = hook(**hook_input['kwargs'])
      File "/tmp/tmpflenq2ay", line 130, in prepare_metadata_for_build_wheel
        return _get_wheel_metadata_from_wheel(backend, metadata_directory,
      File "/tmp/tmpflenq2ay", line 159, in _get_wheel_metadata_from_wheel
        whl_basename = backend.build_wheel(metadata_directory, config_settings)
      File "/tmp/pip-install-q4i9mana/datatable/ci/ext.py", line 587, in build_wheel
        so_file = build_extension(cmd=("debug" if debug_wheel else "build"),
      File "/tmp/pip-install-q4i9mana/datatable/ci/ext.py", line 360, in build_extension
        ext.build()
      File "/tmp/pip-install-q4i9mana/datatable/ci/xbuild/extension.py", line 439, in build
        self._run_prebuild_triggers()
      File "/tmp/pip-install-q4i9mana/datatable/ci/xbuild/extension.py", line 488, in _run_prebuild_triggers
        fn(self)
      File "/tmp/pip-install-q4i9mana/datatable/ci/ext.py", line 369, in generate_documentation
        import gendoc
    ModuleNotFoundError: No module named 'gendoc'
    ----------------------------------------
ERROR: Command errored out with exit status 1: /usr/bin/python3 /tmp/tmpflenq2ay prepare_metadata_for_build_wheel /tmp/tmpef0_p5x1 Check the logs for full command output.
wahani commented 3 years ago

I can reproduce this error on my system and can easily fix it inside a container build. This exact error is reported at the datatable repo: https://github.com/h2oai/datatable/issues/3071 and I can confirm that I can install the package with pip3, after upgrading. Also I can install datatable in version 1.0.0 with Python 3.8 or 3.9 with pipenv using the following image:

FROM python:3.9.5

RUN pip3 install --upgrade pip \
    && pip3 install pipenv \
    && pipenv install

and Pipfile

[packages]
datatable = "*"

However running pipenv on my local machine results in the same error. Removing the pipenv, upgrading pip3 has no effect. I assume there are different versions picked up by pipenv. But I still have to figure out why.

chamaoskurumi commented 3 years ago

I assume there are different versions picked up by pipenv.

That sounds likely. I thought maybe pipenv install --python=3.8 might fix it, but it doesn't :cry:

wahani commented 3 years ago

I think untill we see a change in https://github.com/pypa/pipenv/tree/master/pipenv/patched/notpip to a more recent version, pipenv will not be able to install datatable in version 1.0.0. Also in the Dockerimage I was unable to install it properly. But the reason for this is pipenv, not dbrequests or datatable. Outside the virtualenvironment the installation works just fine.