vaexio / vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
https://vaex.io
MIT License
8.31k stars 591 forks source link

conda install can not skip vaex-astro #696

Closed And0k closed 3 years ago

And0k commented 4 years ago

According to documentation "if you don’t need astronomy related parts (vaex-astro) ... , you can leave out those packages", but this not helps:

>conda install -c conda-forge vaex-core vaex-viz vaex-jupyter vaex-arrow vaex-ui vaex-hdf5 vaex-ml
Collecting package metadata (current_repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: x:\y

  added / updated specs:
    - vaex-arrow
    - vaex-core
    - vaex-hdf5
    - vaex-jupyter
    - vaex-ml
    - vaex-ui
    - vaex-viz

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    aplus-0.11.0               |             py_1           6 KB  conda-forge
    c-ares-1.15.0              |    h2fa13f4_1001         1.0 MB  conda-forge
    cachetools-3.1.1           |             py_0          11 KB  conda-forge
    parquet-cpp-1.5.1          |                2           3 KB  conda-forge
    pyopengl-3.1.5             |             py_0         854 KB  conda-forge
    s3fs-0.2.2                 |             py_0          20 KB  conda-forge
    vaex-astro-0.6.1           |             py_1          12 KB  conda-forge
    vaex-server-0.2.1          |             py_0           4 KB  conda-forge
    vaex-ui-0.3.0              |             py_0         270 KB  conda-forge
    ------------------------------------------------------------
                                           Total:         2.2 MB

The following NEW packages will be INSTALLED:

  abseil-cpp         conda-forge/win-64::abseil-cpp-20200225.2-h33f27b4_0
  aplus              conda-forge/noarch::aplus-0.11.0-py_1
  arrow-cpp          conda-forge/win-64::arrow-cpp-0.16.0-py37hdac5e3f_4
  astropy            conda-forge/win-64::astropy-4.0.1.post1-py37h8055547_0
  aws-sdk-cpp        conda-forge/win-64::aws-sdk-cpp-1.7.164-vc14h867dc94_1
  bqplot             conda-forge/noarch::bqplot-0.12.6-pyh8c360ce_0
  branca             conda-forge/noarch::branca-0.3.1-py_0
  brotli             conda-forge/win-64::brotli-1.0.7-he025d50_1001
  c-ares             conda-forge/win-64::c-ares-1.15.0-h2fa13f4_1001
  cachetools         conda-forge/noarch::cachetools-3.1.1-py_0
  gflags             conda-forge/win-64::gflags-2.2.2-he025d50_1002
  glog               conda-forge/win-64::glog-0.4.0-h0174b99_3
  grpc-cpp           conda-forge/win-64::grpc-cpp-1.28.1-h7c6d948_2
  imageio            conda-forge/noarch::imageio-2.8.0-py_0
  ipydatawidgets     conda-forge/noarch::ipydatawidgets-4.0.1-py_0
  ipyleaflet         conda-forge/noarch::ipyleaflet-0.12.4-pyh9f0ad1d_0
  ipympl             conda-forge/noarch::ipympl-0.5.6-pyh9f0ad1d_1
  ipyscales          conda-forge/noarch::ipyscales-0.4.0-py_1
  ipyvolume          conda-forge/noarch::ipyvolume-0.6.0a4-pyh9f0ad1d_0
  ipyvue             conda-forge/noarch::ipyvue-1.3.2-pyh9f0ad1d_0
  ipyvuetify         conda-forge/noarch::ipyvuetify-1.3.0-pyh8c360ce_0
  ipywebrtc          conda-forge/win-64::ipywebrtc-0.5.0-py37_0
  libprotobuf        conda-forge/win-64::libprotobuf-3.11.4-h1a1b453_0
  llvmlite           conda-forge/win-64::llvmlite-0.31.0-py37hc8dfbb8_1
  networkx           conda-forge/noarch::networkx-2.4-py_1
  numba              conda-forge/win-64::numba-0.48.0-py37he350917_0
  parquet-cpp        conda-forge/noarch::parquet-cpp-1.5.1-2
  progressbar2       conda-forge/noarch::progressbar2-3.51.0-pyh9f0ad1d_0
  pyarrow            conda-forge/win-64::pyarrow-0.16.0-py37h8702343_2
  pyopengl           conda-forge/noarch::pyopengl-3.1.5-py_0
  pythreejs          conda-forge/noarch::pythreejs-2.2.0-pyh8c360ce_0
  s3fs               conda-forge/noarch::s3fs-0.2.2-py_0
  scikit-image       conda-forge/win-64::scikit-image-0.16.2-py37he350917_0
  snappy             conda-forge/win-64::snappy-1.1.8-he025d50_1
  thrift-cpp         conda-forge/win-64::thrift-cpp-0.13.0-h1907cbf_2
  traittypes         conda-forge/noarch::traittypes-0.2.1-py_1
  vaex-arrow         conda-forge/noarch::vaex-arrow-0.4.2-py_0
  vaex-astro         conda-forge/noarch::vaex-astro-0.6.1-py_1
  vaex-core          conda-forge/win-64::vaex-core-1.5.0-py37he350917_0
  vaex-hdf5          conda-forge/noarch::vaex-hdf5-0.5.6-py_0
  vaex-jupyter       conda-forge/noarch::vaex-jupyter-0.4.1-py_0
  vaex-ml            conda-forge/noarch::vaex-ml-0.8.0-py_0
  vaex-server        conda-forge/noarch::vaex-server-0.2.1-py_0
  vaex-ui            conda-forge/noarch::vaex-ui-0.3.0-py_0
  vaex-viz           conda-forge/noarch::vaex-viz-0.3.8-py_1

Proceed ([y]/n)?

I'm also not interested in astropy. How to reduce the number of packages?

JovanVeljanoski commented 4 years ago

Hi,

Yeah, we are working on this. Currently vaex-core depends on astropy which is why it is getting installed. We are considering removing it in future releases.

In your case vaex-ui is what is causing the installation of vaex-astro. I do not think you really need vaex-ui, unless you are planning to use the qt based UI interface, which is a bit dated now I guess.

P.S.: vaex-astro is quite lightweight compared to the rest.. but I get it why you would not like to have it.

maartenbreddels commented 4 years ago

Yes, the reason for this is that we depend on astropy for unit conversion (a hidden gem in vaex). But I think we should make that dependency optional, it's a large dependency for vaex-core.

JovanVeljanoski commented 3 years ago

This dependency is now made optional. Please reopen if you have any more concerns on this topic.