import koalas return cannot import name 'ignore_unicode_prefix' from 'pyspark.rdd'

nadanasser commented 3 years ago

I installed Spark, Koalas on miniconda3, then when I do

import databricks.koalas as ks

it return error as attached

one more thing when I type pyspark in terminal I got

/home/user/miniconda3/bin/pyspark: line 24: /root/spark/bin/load-spark-env.sh: Permission denied /home/user/miniconda3/bin/pyspark: line 77: /root/spark/bin/spark-submit: Permission denied /home/user/miniconda3/bin/pyspark: line 77: exec: /root/spark/bin/spark-submit: cannot execute: Permission denied

I do not know what I missed, appreciate your support

I am using Ubuntu 18.04.4 python 3.7.7 conda 4.10.1

HyukjinKwon commented 3 years ago

Looks like pyspark is not properly in the Python path. do you have other pyspark installed?

itholic commented 2 years ago

Close because the reporter has not responded for a while, and it doesn't look like Koalas' bug.

Please reopen at any time if there is any something to discuss!

databricks / koalas

import koalas return cannot import name 'ignore_unicode_prefix' from 'pyspark.rdd' #2165