Hi!
I succesfully built the jar package, but I can't import lib as from pyspark_iforest.ml.iforest import *. Should I add something? I found this and tried:
adding jar to Spark config conf = SparkConf() conf.set('spark.jars', '/content/spark-2.4.8-bin-hadoop2.7/jars/spark-iforest-2.4.0.jar')
adding to Path variables os.environ['PYSPARK_SUBMIT_ARGS'] = '--jars /content/spark-2.4.8-bin-hadoop2.7/jars/spark-iforest-2.4.0.jar pyspark-shell'
But nothing helps
BTW. What version of Pyspark should we use?
You can replicate it here google colab Thank you!
Hi! I succesfully built the jar package, but I can't import lib as from pyspark_iforest.ml.iforest import *. Should I add something? I found this and tried:
conf = SparkConf() conf.set('spark.jars', '/content/spark-2.4.8-bin-hadoop2.7/jars/spark-iforest-2.4.0.jar')os.environ['PYSPARK_SUBMIT_ARGS'] = '--jars /content/spark-2.4.8-bin-hadoop2.7/jars/spark-iforest-2.4.0.jar pyspark-shell'But nothing helpsBTW. What version of Pyspark should we use? You can replicate it here google colab Thank you!