Open mayjack0312 opened 1 year ago
hi @mayjack0312
If you build BigDL using make-dist.sh
, you can find the compiled BigDL distribution in BigDL/scala/assembly/target/bigdl-assembly-spark*-*-dist-all
Please export BIGDL_CLASSPATH=${BIGDL_HOME}/jars/*
and export PYTHONPATH=${BIGDL_HOME}/python/bigdl-spark_${SPARK_VERSION}-${BIGDL_VERSION}-python-api.zip:${BIGDL_HOME}/conf/spark-bigdl.conf:${SPARK_HOME}/python/lib/pyspark.zip:${SPARK_HOME}/python/lib/py4j-*.zip
By the way, it will be easy to use BigDL with pip install bigdl
for the python user. You can find more information about BigDL user guide https://bigdl.readthedocs.io/en/latest/doc/UserGuide/index.html
hi @mayjack0312 If you build BigDL using
make-dist.sh
, you can find the compiled BigDL distribution inBigDL/scala/assembly/target/bigdl-assembly-spark*-*-dist-all
Pleaseexport BIGDL_CLASSPATH=${BIGDL_HOME}/jars/*
andexport PYTHONPATH=${BIGDL_HOME}/python/bigdl-spark_${SPARK_VERSION}-${BIGDL_VERSION}-python-api.zip:${BIGDL_HOME}/conf/spark-bigdl.conf:${SPARK_HOME}/python/lib/pyspark.zip:${SPARK_HOME}/python/lib/py4j-*.zip
By the way, it will be easy to use BigDL with
pip install bigdl
for the python user. You can find more information about BigDL user guide https://bigdl.readthedocs.io/en/latest/doc/UserGuide/index.html
Thank you for your patience ❤ But now I report the following error after running the python command.
hi @mayjack0312 If you build BigDL using
make-dist.sh
, you can find the compiled BigDL distribution inBigDL/scala/assembly/target/bigdl-assembly-spark*-*-dist-all
Pleaseexport BIGDL_CLASSPATH=${BIGDL_HOME}/jars/*
andexport PYTHONPATH=${BIGDL_HOME}/python/bigdl-spark_${SPARK_VERSION}-${BIGDL_VERSION}-python-api.zip:${BIGDL_HOME}/conf/spark-bigdl.conf:${SPARK_HOME}/python/lib/pyspark.zip:${SPARK_HOME}/python/lib/py4j-*.zip
By the way, it will be easy to use BigDL withpip install bigdl
for the python user. You can find more information about BigDL user guide https://bigdl.readthedocs.io/en/latest/doc/UserGuide/index.htmlThank you for your patience ❤ But now I report the following error after running the python command.
Could you check */python3.7/site-packages/bigdl/share/lib
, are there two jars under this folder?
Please clean up the conda environment and reinstall.
centos system python installation bigdl prompt error In addition, I use Git clone to directly install bash make-dist.sh. How should I use it after the installation is complete?