heavyai / mapd-ml-demo

Extract, PreProcess, and Analyze big data on GPUs
21 stars 6 forks source link

libarrow.so.0: cannot open shared object file: No such file or directory #12

Open a-ghorbani opened 6 years ago

a-ghorbani commented 6 years ago

After removing the cache and building the image from the latest commit I get the following error when calling con.select_ipc_gpu(query,device_id=0)

---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
<ipython-input-7-8cee91aaf124> in <module>()
      6 
      7 # implicit tdf to pygdf
----> 8 df_train= con.select_ipc_gpu(query,device_id=0)
      9 df_test= con.select_ipc_gpu(query_test,device_id=0)
     10 

/opt/conda/Miniconda3/envs/mapd_ml_examples/lib/python3.6/site-packages/pymapd/connection.py in select_ipc_gpu(self, operation, parameters, device_id, first_n)
    266         tdf = self._client.sql_execute_gdf(
    267             self._session, operation, device_id=device_id, first_n=first_n)
--> 268         return _parse_tdf_gpu(tdf)
    269 
    270     def select_ipc(self, operation, parameters=None, first_n=-1):

/opt/conda/Miniconda3/envs/mapd_ml_examples/lib/python3.6/site-packages/pymapd/_parsers.py in _parse_tdf_gpu(tdf)
    158     from numba.cuda.cudadrv import drvapi
    159 
--> 160     from .shm import load_buffer
    161 
    162     ipc_handle = drvapi.cu_ipc_mem_handle(*tdf.df_handle)

ImportError: libarrow.so.0: cannot open shared object file: No such file or directory
wamsiv commented 6 years ago

looks like its coming out of _parsers.py: load_buffer

from .shm import load_buffer
ImportError: libarrow_python.so.0: cannot open shared object file: No such file or directory

I see PR open for adding arrow 0.10.0 support in pymapd https://github.com/mapd/pymapd/issues/84 might be related to pygdf on arrow 0.10.0 and pymapd still supports only 0.7.1