[BUG-REPORT] vaex install via pip --prefix causing issues

[aakashsoni]

Description I'm trying to install vaex via pip with --prefix option and I see the contents of lib and lib64 different which is causing vaex import issues. Tried the same without --prefix option and I see the contents of lib and lib64 folder same and import is also working fine.

Installing via pip lib and lib64

(soni_venv) soni@xxxx:~/test $ ls lib/python3.6/site-packages/vaex
__init__.py benchmark.py dataset_mmap.py execution.py grids.py kld.py parallelize.py server/ tasks.py
__main__.py cache.py dataset_utils.py export.py groupby.py legacy.py promise.py settings.py test/
__pycache__/ column.py datasets.py expression.py hash.py meta/ registry.py shift.py utils.py
_version.py convert.py datatype.py expresso.py hdf5/ meta.py rolling.py stat.py vaexfast.cpython-36m-x86_64-linux-gnu.so*
agg.py core/ datatype_test.py ext/ image.py misc/ samp.py strings.py version.py
array_types.py cpu.py delayed.py file/ itertools.py misc_cmdline.py schema.py struct.py viz/
arrow/ dataframe.py docstrings.py formatting.py join.py ml/ scopes.py superagg.cpython-36m-x86_64-linux-gnu.so*
astro/ dataset.py encoding.py functions.py json.py multiprocessing.py selections.py superstrings.cpython-36m-x86_64-linux-gnu.so*
asyncio.py dataset_misc.py events.py geo.py jupyter/ multithreading.py serialize.py superutils.cpython-36m-x86_64-linux-gnu.so*

(soni_venv) soni@xxxx:~/test $ ls lib64/python3.6/site-packages/vaex
__init__.py benchmark.py dataset_mmap.py execution.py grids.py kld.py parallelize.py server/ tasks.py
__main__.py cache.py dataset_utils.py export.py groupby.py legacy.py promise.py settings.py test/
__pycache__/ column.py datasets.py expression.py hash.py meta/ registry.py shift.py utils.py
_version.py convert.py datatype.py expresso.py hdf5/ meta.py rolling.py stat.py vaexfast.cpython-36m-x86_64-linux-gnu.so*
agg.py core/ datatype_test.py ext/ image.py misc/ samp.py strings.py version.py
array_types.py cpu.py delayed.py file/ itertools.py misc_cmdline.py schema.py struct.py viz/
arrow/ dataframe.py docstrings.py formatting.py join.py ml/ scopes.py superagg.cpython-36m-x86_64-linux-gnu.so*
astro/ dataset.py encoding.py functions.py json.py multiprocessing.py selections.py superstrings.cpython-36m-x86_64-linux-gnu.so*
asyncio.py dataset_misc.py events.py geo.py jupyter/ multithreading.py serialize.py superutils.cpython-36m-x86_64-linux-gnu.so*
asoni02@fxdeva14:~/asoni_check $

Installing via pip with --prefix option lib and lib64

(soni_venv2) soni@xxxx:~/test2 $ ls lib/python3.6/site-packages/vaex
astro/ hdf5/ jupyter/ meta/ ml/ server/ viz/

(soni_venv2) soni@xxxx:~/test2 $ ls lib64/python3.6/site-packages/vaex
__init__.py asyncio.py dataframe.py datatype_test.py expression.py grids.py kld.py parallelize.py selections.py superagg.cpython-36m-x86_64-linux-gnu.so* version.py
__main__.py benchmark.py dataset.py delayed.py expresso.py groupby.py legacy.py promise.py serialize.py superstrings.cpython-36m-x86_64-linux-gnu.so*
__pycache__/ cache.py dataset_misc.py docstrings.py ext/ hash.py meta.py registry.py settings.py superutils.cpython-36m-x86_64-linux-gnu.so*
_version.py column.py dataset_mmap.py encoding.py file/ image.py misc/ rolling.py shift.py tasks.py
agg.py convert.py dataset_utils.py events.py formatting.py itertools.py misc_cmdline.py samp.py stat.py test/
array_types.py core/ datasets.py execution.py functions.py join.py multiprocessing.py schema.py strings.py utils.py
arrow/ cpu.py datatype.py export.py geo.py json.py multithreading.py scopes.py struct.py vaexfast.cpython-36m-x86_64-linux-gnu.so*

Import issue

ERROR:MainThread:vaex:issue loading plot
ModuleNotFoundError: No module named 'vaex.viz'

ERROR:MainThread:vaex:issue loading astro
ModuleNotFoundError: No module named 'vaex.astro'

Software information

• Vaex 4.5.0
• Vaex was installed via: pip (with --prefix option)
• OS: Red Hat Enterprise Linux Server release 6.10 (Santiago)

Steps to reproduce $ pip install vaex --prefix

[maartenbreddels]

Hi,

thanks for the report. Strange behaviour, this is a pip issue though, and not something we can fix. You can try different versions of pip maybe. I'll close this issue since it is not vaex related (I think), but feel free to report here if you found a way to solve this.

Regards,

Maarten

[uranusjr]

Edit: sorry, commented on the wrong repo.

[myloe00]

I try to fix it by create a soft-link like this:

ln -s /usr/local/lib/python3.8/site-packages/vaex/astro /usr/local/lib64/python3.8/site-packages/vaex/astro

And then error is gone. Whether there are other issues that need to be continued to be observed.

[arunpersaud]

I had similar issues (see #960) and adding the links worked for me too! Thanks for posting.