h2oai / h2o4gpu

H2Oai GPU Edition
Apache License 2.0
460 stars 95 forks source link

No module named 'h2o4gpu.utils.murmurhash' #654

Closed nasica88 closed 6 years ago

nasica88 commented 6 years ago

Environment (for bugs)

Description

$ pip list | grep h2o h2o4gpu 0.1.0

$ python Python 3.6.2 |Anaconda custom (64-bit)| (default, Sep 15 2017, 20:38:23) [GCC 4.8.4] on linux Type "help", "copyright", "credits" or "license" for more information.

import h2o4gpu Traceback (most recent call last): File "", line 1, in File "/root/anaconda3/lib/python3.6/site-packages/h2o4gpu/init.py", line 11, in from .solvers.pogs import Pogs File "/root/anaconda3/lib/python3.6/site-packages/h2o4gpu/solvers/init.py", line 8, in from ..solvers.elastic_net import ElasticNetH2O File "/root/anaconda3/lib/python3.6/site-packages/h2o4gpu/solvers/elastic_net.py", line 14, in from h2o4gpu.linear_model import coordinate_descent as sk File "/root/anaconda3/lib/python3.6/site-packages/h2o4gpu/linear_model/init.py", line 12, in from .base import LinearRegressionSklearn File "/root/anaconda3/lib/python3.6/site-packages/h2o4gpu/linear_model/base.py", line 28, in from ..base import BaseEstimator, ClassifierMixin, RegressorMixin File "/root/anaconda3/lib/python3.6/site-packages/h2o4gpu/base.py", line 12, in from .utils.fixes import signature File "/root/anaconda3/lib/python3.6/site-packages/h2o4gpu/utils/init.py", line 10, in from .murmurhash import murmurhash3_32 ModuleNotFoundError: No module named 'h2o4gpu.utils.murmurhash'

I tried installing spacy, during which murmurhash is also installed, but it did not help.

$ pip list | grep murmur murmurhash 0.28.0

$ pip list | grep spacy spacy 2.0.12

nasica88 commented 6 years ago

I tried installing h2o4gpu-0.2.0.9999 from https://s3.amazonaws.com/h2o-release/h2o4gpu/releases/bleeding-edge/ai/h2o/h2o4gpu/0.2-cuda92/h2o4gpu-0.2.0.9999-cp36-cp36m-linux_x86_64.whl, but since my platform is ppc64le, it doesn't work.

$ pip install ./h2o4gpu-0.2.0.9999-cp36-cp36m-linux_x86_64.whl h2o4gpu-0.2.0.9999-cp36-cp36m-linux_x86_64.whl is not a supported wheel on this platform.

How can I build h2o4gpu wheel file from source ?

I tried 'make fullinstall' but it ends up with following error. At first, Cython==0.27.3 was the requirement, but I took the liberty of changing it to 0.28.4 since 0.27.3 is not available on ppc64le. I still get "No matching distribution found for Cython" error.

$ make fullinstall Collecting Cython==0.28.4 (from -r requirements.txt (line 17)) Using cached https://files.pythonhosted.org/packages/d2/12/8ef44cede251b93322e8503fd6e1b25a0249fa498bebec191a5a06adbe51/Cython-0.28.4.tar.gz Collecting h2o==3.18.0.10 (from -r requirements.txt (line 19)) Using cached https://files.pythonhosted.org/packages/25/35/de0609b03a1168726a86b43e178c9d857ca5272828e8f025255c0426be4b/h2o-3.18.0.10.tar.gz Collecting pandas==0.22.0 (from -r requirements.txt (line 20)) Using cached https://files.pythonhosted.org/packages/08/01/803834bc8a4e708aedebb133095a88a4dad9f45bbaf5ad777d2bea543c7e/pandas-0.22.0.tar.gz Could not find a version that satisfies the requirement Cython (from versions: ) No matching distribution found for Cython make: *** [deps_install] Error 1

nasica88 commented 6 years ago

I built the required version of Cython (0.27.3) from source and retried make fullinstall, but it ends up with the same error.

$ git clone --recursive https://github.com/cython/cython.git && cd cython

$ git checkout tags/0.27.3

$ python setup.py install

$ pip list | grep Cython Cython 0.27.3

$ cd /home/data/h2o4gpu && make fullinstall ... Using cached https://files.pythonhosted.org/packages/25/35/de0609b03a1168726a86b43e178c9d857ca5272828e8f025255c0426be4b/h2o-3.18.0.10.tar.gz Collecting pandas==0.22.0 (from -r requirements.txt (line 20)) Using cached https://files.pythonhosted.org/packages/08/01/803834bc8a4e708aedebb133095a88a4dad9f45bbaf5ad777d2bea543c7e/pandas-0.22.0.tar.gz Could not find a version that satisfies the requirement Cython (from versions: ) No matching distribution found for Cython make: *** [deps_install] Error 1

nasica88 commented 6 years ago

I could bypass this trouble by editing the following files. In these files, I set all cython entries with "Cython==0.27.3".

./scikit-learn/build_tools/appveyor/requirements.txt ./src/interface_py/requirements_buildonly.txt ./xgboost/requirements_buildonly.txt