search

h2oai / db-benchmark

reproducible benchmark of database-like ops
https://h2oai.github.io/db-benchmark
Mozilla Public License 2.0
323 stars 85 forks source link

dask failing #92

Closed jangorecki closed 5 years ago

jangorecki commented 5 years ago 
import dask.dataframe as dd
Traceback (most recent call last):
  File "/home/jan/git/db-benchmark/dask/py-dask/lib/python3.6/site-packages/dask/dataframe/__init__.py", line 15, in <module>
    from .io import (
  File "/home/jan/git/db-benchmark/dask/py-dask/lib/python3.6/site-packages/dask/dataframe/io/__init__.py", line 15, in <module>
    from .csv import read_csv, to_csv, read_table, read_fwf
  File "/home/jan/git/db-benchmark/dask/py-dask/lib/python3.6/site-packages/dask/dataframe/io/csv.py", line 22, in <module>
    from ...bytes import read_bytes, open_files
  File "/home/jan/git/db-benchmark/dask/py-dask/lib/python3.6/site-packages/dask/bytes/__init__.py", line 10, in <module>
    "fsspec is required to use any file-system functionality."
ImportError: fsspec is required to use any file-system functionality. Please install using
conda install -c conda-forge 'fsspec>=0.3.3'
or
pip install 'fsspec>=0.3.3'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/jan/git/db-benchmark/dask/py-dask/lib/python3.6/site-packages/dask/dataframe/__init__.py", line 57, in <module>
    raise ImportError(str(e) + "\n\n" + msg)
ImportError: fsspec is required to use any file-system functionality. Please install using
conda install -c conda-forge 'fsspec>=0.3.3'
or
pip install 'fsspec>=0.3.3'

Dask dataframe requirements are not installed.

Please either conda or pip install as follows:

  conda install dask                     # either conda install
  pip install dask[dataframe] --upgrade  # or pip install

maybe due to conda that has been installed to run cudf, or a dependency has changed and was not automatically installed during upgrade?

jangorecki commented 5 years ago

installing fsspec did resolve problem, dask is again on benchplot

rojour commented 4 years ago

I am also facing the same issue. I am able to install dask[complete] in both python 2.7 and 3.5.5

When running dask.dataframe from python 2.7 there are no issues, but when running from python 3.5.5 I get that fsspec needs to be installed (and I am sure that it is there).

Am I missing something here?

isnbh0 commented 4 years ago

I am also facing the same issue. I am able to install dask[complete] in both python 2.7 and 3.5.5

When running dask.dataframe from python 2.7 there are no issues, but when running from python 3.5.5 I get that fsspec needs to be installed (and I am sure that it is there).

Am I missing something here?

I had the same problem.

In my case it was solved by:

  1. installing the bz2 library (sudo apt-get install libbz2-dev for my Ubuntu 16.04)
  2. reinstalling python3

Hope that helps...