apple / turicreate

Turi Create simplifies the development of custom machine learning models.
BSD 3-Clause "New" or "Revised" License
11.2k stars 1.14k forks source link

AttributeError: module 'mxnet' has no attribute '__version__' #2197

Closed MaximBazarov closed 5 years ago

MaximBazarov commented 5 years ago

Facing this issue using Google Colab

# Install libraries - you might need to restart the runtime after doing this
!pip install turicreate==5.6
# The wrong version of mxnet will be installed
!pip uninstall -y mxnet
# Install CUDA10-compatible version of mxnet
!pip install mxnet-cu100

import turicreate as tc
tc.config.set_num_gpus(-1)

print('### Labeling images')
images = tc.load_images('2images')
images['labels'] = images['path'].element_slice(8,-4)

print('### one_shot_object_detector creation...')
model = tc.one_shot_object_detector.create(images, 'labels')

print('### one_shot_object_detector evaluation...')
model.evaluate(data)

print('### exporting Model ')
# Export to Core ML
model.export_coreml('grn.mlmodel')

Error:

---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-8-15dc8702d986> in <module>()
     10 images['labels'] = images['path'].element_slice(8,-4)
     11 
---> 12 model = tc.one_shot_object_detector.create(images, 'labels')
     13 
     14 model.evaluate(data)

3 frames
/usr/local/lib/python3.6/dist-packages/turicreate/toolkits/_mxnet/__init__.py in __getattribute__(self, attr)
     18             import mxnet
     19 
---> 20             version_tuple = tuple(int(x) for x in mxnet.__version__.split('.') if x.isdigit())
     21             lowest_version = (0, 11, 0)
     22             not_yet_supported_version = (1, 2, 0)

AttributeError: module 'mxnet' has no attribute '__version__'

pip freeze:

absl-py==0.7.1
alabaster==0.7.12
albumentations==0.1.12
altair==3.1.0
astor==0.8.0
astropy==3.0.5
atari-py==0.1.15
atomicwrites==1.3.0
attrs==19.1.0
audioread==2.1.8
autograd==1.2
Babel==2.7.0
backcall==0.1.0
backports.tempfile==1.0
backports.weakref==1.0.post1
beautifulsoup4==4.6.3
bleach==3.1.0
blis==0.2.4
bokeh==1.0.4
boto==2.49.0
boto3==1.9.189
botocore==1.12.189
Bottleneck==1.2.1
branca==0.3.1
bs4==0.0.1
bz2file==0.98
cachetools==3.1.1
certifi==2019.6.16
cffi==1.12.3
chainer==5.4.0
chardet==3.0.4
Click==7.0
cloudpickle==0.6.1
cmake==3.12.0
colorlover==0.3.0
community==1.0.0b1
contextlib2==0.5.5
convertdate==2.1.3
coremltools==2.1.0
coverage==3.7.1
coveralls==0.5
crcmod==1.7
cufflinks==0.14.6
cupy-cuda100==5.4.0
cvxopt==1.2.3
cvxpy==1.0.15
cycler==0.10.0
cymem==2.0.2
Cython==0.29.12
daft==0.0.4
dask==1.1.5
dataclasses==0.6
datascience==0.10.6
decorator==4.4.0
defusedxml==0.6.0
descartes==1.1.0
dill==0.3.0
distributed==1.25.3
Django==2.2.3
dlib==19.16.0
dm-sonnet==1.34
docopt==0.6.2
docutils==0.14
dopamine-rl==1.0.5
easydict==1.9
ecos==2.0.7.post1
editdistance==0.5.3
en-core-web-sm==2.1.0
entrypoints==0.3
ephem==3.7.6.0
et-xmlfile==1.0.1
fa2==0.3.5
fancyimpute==0.4.3
fastai==1.0.55
fastcache==1.1.0
fastdtw==0.3.2
fastprogress==0.1.21
fastrlock==0.4
fbprophet==0.5
feather-format==0.4.0
featuretools==0.4.1
filelock==3.0.12
fix-yahoo-finance==0.0.22
Flask==1.1.1
folium==0.8.3
fsspec==0.3.2
future==0.16.0
gast==0.2.2
GDAL==2.2.2
gdown==3.6.4
gensim==3.6.0
geographiclib==1.49
geopy==1.17.0
gevent==1.4.0
gin-config==0.2.0
glob2==0.7
google==2.0.2
google-api-core==1.13.0
google-api-python-client==1.7.9
google-auth==1.4.2
google-auth-httplib2==0.0.3
google-auth-oauthlib==0.4.0
google-cloud-bigquery==1.14.0
google-cloud-core==1.0.2
google-cloud-datastore==1.8.0
google-cloud-language==1.2.0
google-cloud-storage==1.16.1
google-cloud-translate==1.5.0
google-colab==1.0.0
google-pasta==0.1.7
google-resumable-media==0.3.2
googleapis-common-protos==1.6.0
googledrivedownloader==0.4
graph-nets==1.0.4
graphviz==0.8.1
greenlet==0.4.15
grpcio==1.15.0
gspread==3.0.1
gspread-dataframe==3.0.2
gunicorn==19.9.0
gym==0.10.11
h5py==2.8.0
HeapDict==1.0.0
holidays==0.9.10
html5lib==1.0.1
httpimport==0.5.16
httplib2==0.11.3
humanize==0.5.1
hyperopt==0.1.2
ideep4py==2.0.0.post3
idna==2.6
image==1.5.27
imageio==2.4.1
imagesize==1.1.0
imbalanced-learn==0.4.3
imblearn==0.0
imgaug==0.2.9
importlib-metadata==0.19
imutils==0.5.2
inflect==2.1.0
intel-openmp==2019.0
intervaltree==2.1.0
ipykernel==4.6.1
ipython==5.5.0
ipython-genutils==0.2.0
ipython-sql==0.3.9
ipywidgets==7.5.0
itsdangerous==1.1.0
jdcal==1.4.1
jedi==0.14.1
jieba==0.39
Jinja2==2.10.1
jmespath==0.9.4
joblib==0.13.2
jpeg4py==0.1.4
jsonschema==2.6.0
jupyter==1.0.0
jupyter-client==5.3.1
jupyter-console==6.0.0
jupyter-core==4.5.0
kaggle==1.5.4
kapre==0.1.3.1
Keras==2.2.4
Keras-Applications==1.0.8
Keras-Preprocessing==1.1.0
keras-vis==0.4.1
kiwisolver==1.1.0
knnimpute==0.1.0
librosa==0.6.3
lightgbm==2.2.3
llvmlite==0.29.0
lmdb==0.96
lucid==0.3.8
lunardate==0.2.0
lxml==4.2.6
magenta==0.3.19
Markdown==3.1.1
MarkupSafe==1.1.1
matplotlib==3.0.3
matplotlib-venn==0.11.5
mesh-tensorflow==0.0.5
mido==1.2.6
mir-eval==0.5
missingno==0.4.2
mistune==0.8.4
mizani==0.5.4
mkl==2019.0
mlxtend==0.14.0
more-itertools==7.1.0
moviepy==0.2.3.5
mpi4py==3.0.2
mpmath==1.1.0
msgpack==0.5.6
multiprocess==0.70.8
multitasking==0.0.9
murmurhash==1.0.2
music21==5.5.0
mxnet-cu100==1.4.0.post0
mxnet-cu80==1.1.0
mxnet-cu90==1.1.0
natsort==5.5.0
nbconvert==5.5.0
nbformat==4.4.0
networkx==2.3
nibabel==2.3.3
nltk==3.2.5
nose==1.3.7
notebook==5.2.2
np-utils==0.5.10.0
numba==0.40.1
numexpr==2.6.9
numpy==1.13.3
nvidia-ml-py3==7.352.0
oauth2client==4.1.3
oauthlib==3.0.2
okgrade==0.4.3
olefile==0.46
opencv-contrib-python==3.4.3.18
opencv-python==3.4.5.20
openpyxl==2.5.9
osqp==0.5.0
packaging==19.0
palettable==3.2.0
pandas==0.24.2
pandas-datareader==0.7.0
pandas-gbq==0.4.1
pandas-profiling==1.4.1
pandocfilters==1.4.2
parso==0.5.1
pathlib==1.0.1
patsy==0.5.1
pexpect==4.7.0
pickleshare==0.7.5
Pillow==4.3.0
pip-tools==3.9.0
plac==0.9.6
plotly==3.6.1
plotnine==0.5.1
pluggy==0.7.1
portpicker==1.2.0
prefetch-generator==1.0.1
preshed==2.0.1
pretty-midi==0.2.8
prettytable==0.7.2
progressbar2==3.38.0
prometheus-client==0.7.1
promise==2.2.1
prompt-toolkit==1.0.16
protobuf==3.7.1
psutil==5.4.8
psycopg2==2.7.6.1
ptyprocess==0.6.0
py==1.8.0
pyarrow==0.14.0
pyasn1==0.4.5
pyasn1-modules==0.2.5
pycocotools==2.0.0
pycparser==2.19
pydot==1.3.0
pydot-ng==2.0.0
pydotplus==2.0.2
pyemd==0.5.1
pyglet==1.4.1
Pygments==2.1.3
pygobject==3.26.1
pymc3==3.7
pymongo==3.8.0
pymystem3==0.2.0
PyOpenGL==3.1.0
pyparsing==2.4.0
pyrsistent==0.15.4
pysndfile==1.3.3
PySocks==1.7.0
pystan==2.19.0.0
pytest==3.6.4
python-apt==1.6.4
python-chess==0.23.11
python-dateutil==2.5.3
python-louvain==0.13
python-rtmidi==1.3.0
python-slugify==3.0.2
python-utils==2.3.0
pytz==2018.9
PyWavelets==1.0.3
PyYAML==3.13
pyzmq==17.0.0
qtconsole==4.5.2
requests==2.21.0
requests-oauthlib==1.2.0
resampy==0.2.1
retrying==1.3.3
rpy2==2.9.5
rsa==4.0
s3fs==0.3.0
s3transfer==0.2.1
scikit-image==0.15.0
scikit-learn==0.21.2
scipy==1.3.0
screen-resolution-extra==0.0.0
scs==2.1.1.post2
seaborn==0.9.0
semantic-version==2.6.0
Send2Trash==1.5.0
setuptools-git==1.2
Shapely==1.6.4.post2
simplegeneric==0.8.1
six==1.12.0
skafos==0.2.1
sklearn==0.0
sklearn-pandas==1.8.0
smart-open==1.8.4
snowballstemmer==1.9.0
sortedcontainers==2.1.0
spacy==2.1.6
Sphinx==1.8.5
sphinxcontrib-websupport==1.1.2
SQLAlchemy==1.3.5
sqlparse==0.3.0
srsly==0.0.7
stable-baselines==2.2.1
statsmodels==0.10.0
sympy==1.1.1
tables==3.4.4
tabulate==0.8.3
tblib==1.4.0
tensor2tensor==1.11.0
tensorboard==1.14.0
tensorboardcolab==0.0.22
tensorflow==1.14.0
tensorflow-estimator==1.14.0
tensorflow-hub==0.5.0
tensorflow-metadata==0.14.0
tensorflow-probability==0.7.0
termcolor==1.1.0
terminado==0.8.2
testpath==0.4.2
text-unidecode==1.2
textblob==0.15.3
textgenrnn==1.4.1
tfds-nightly==1.0.2.dev201907170105
tflearn==0.3.2
Theano==1.0.4
thinc==7.0.8
toolz==0.10.0
torch==1.1.0
torchsummary==1.5.1
torchtext==0.3.1
torchvision==0.3.0
tornado==4.5.3
tqdm==4.28.1
traitlets==4.3.2
turicreate==5.6
tweepy==3.6.0
typing==3.7.4
tzlocal==1.5.1
umap-learn==0.3.9
uritemplate==3.0.0
urllib3==1.22
vega-datasets==0.7.0
wasabi==0.2.2
wcwidth==0.1.7
webencodings==0.5.1
Werkzeug==0.15.5
widgetsnbextension==3.5.0
wordcloud==1.5.0
wrapt==1.11.2
xarray==0.11.3
xgboost==0.90
xkit==0.0.0
xlrd==1.1.0
xlwt==1.3.0
yellowbrick==0.9.1
zict==1.0.0
zipp==0.5.2
zmq==0.0.0
TobyRoseman commented 5 years ago

TuriCreate does not support CUDA 10. TuriCreate currently uses MXNet for its deep learning. The latest version of MXNet which works with TuriCreate is 1.1.0. The first version of MXNet to support CUDA 10 is 1.3.1.

Do you need CUDA 10? Or would CUDA 9 work? We support CUDA 9.

It looks like you have several different CUDA version of MXNet installed:

mxnet-cu100==1.4.0.post0
mxnet-cu80==1.1.0
mxnet-cu90==1.1.0

You should only have one of these packages installed.

I would try CUDA 9 and uninstall the other version. Run pip uninstall mxnet-cu100 mxnet-cu90 and see if that works.

MaximBazarov commented 5 years ago

@TobyRoseman thanks for the hints!

I basically want to make it work on GPU, doesn't really matter what CUDA would be used along the way.

https://colab.research.google.com/drive/1GaJLOhdrN-OG8zsL4vgo-wBcqJh6CPYv here's. it the whole notebook

TobyRoseman commented 5 years ago

@MaximBazarov - you may only be able to use a specific version of CUDA with Google Colab. Did you try what I suggested (uninstalling mxnet-cu100 and mxnet-cu90)? Did it work?

MaximBazarov commented 5 years ago

@TobyRoseman yes it worked till some point, there's a workaround to install CUDA 8 into the Google Colab:

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2016 NVIDIA Corporation
Built on Tue_Jan_10_13:22:03_CST_2017
Cuda compilation tools, release 8.0, V8.0.61

but at some point it crashes with out of memory

Installing collected packages: mxnet-cu80
Successfully installed mxnet-cu80-1.1.0
Augmenting input images using 951 background images.
+------------------+--------------+------------------+
| Images Augmented | Elapsed Time | Percent Complete |
+------------------+--------------+------------------+
| 0                | 5.84s        | 0%               |
| 1                | 5.84s        | 0%               |
| 2                | 5.85s        | 0%               |
| 3                | 5.86s        | 0%               |
| 4                | 5.87s        | 0%               |
| 5                | 5.89s        | 0.25%            |
| 10               | 5.98s        | 0.5%             |
| 50               | 6.98s        | 2.5%             |
| 100              | 7.86s        | 5.25%            |
| 500              | 16.99s       | 26.25%           |
| 1000             | 32.47s       | 52.5%            |
| 1500             | 43.40s       | 78.75%           |
| 1901             | 51.44s       | 99.75%           |
+------------------+--------------+------------------+
Using 'image' as feature column
Using 'label' as annotations column
--> crash *
TobyRoseman commented 5 years ago

We're tracking the out of memory error here: #2038.

Since the original issues is resolved, I'm going to close this issue.