search

databricks / spark-deep-learning

Deep Learning Pipelines for Apache Spark
https://databricks.github.io/spark-deep-learning
Apache License 2.0
1.99k stars 494 forks source link

ClassNotFoundException: com.databricks.sparkdl.python.PythonInterface #144

Open arfantn opened 6 years ago

arfantn commented 6 years ago

Hi,

when using sparkdl v0.3.0 with spark v2.2.0 by pyspark when fitting the pipeline with image training data as follows:

featurizer = DeepImageFeaturizer(inputCol="image", outputCol="features", modelName="InceptionV3") lr = LogisticRegression(maxIter=20, regParam=0.05, elasticNetParam=0.3, labelCol="label") p = Pipeline(stages=[featurizer, lr]) p_model = p.fit(train_df)

I got the following exception:

Py4JJavaError: An error occurred while calling o689.loadClass. : java.lang.ClassNotFoundException: com.databricks.sparkdl.python.PythonInterface

Any suggestions?