Open hilmar05 opened 11 months ago
I managed to get it to work by changing to a ML cluster. Not sure why a normal cluster did not work.
thanks for the update @hilmar05 If you don't mind I'll keep this open until we find out why the base runtime failed. (everything is packaged internally inside the library, so no third-party dependency is needed.) We'll investigate this further
Is there an existing issue for this?
Who can help?
No response
What are you working on?
I am trying to get spark-nlp to work on Databricks using an example from the documentation.
Current Behavior
Expected Behavior
Code should run without any errors.
Steps To Reproduce
Spark NLP version and Apache Spark
Spark NLP version: 5.1.2 Spark version: 3.4.1
Databricks Runtime Version: 13.3 LTS (includes Apache Spark 3.4.1, Scala 2.12)
Type of Spark Application
Python Application
Java Version
No response
Java Home Directory
No response
Setup and installation
I iinstalled the libraries below directly on the cluster.
spark-nlp==5.1.2 com.johnsnowlabs.nlp:spark-nlp_2.12:5.1.2
Operating System and Version
No response
Link to your project (if available)
No response
Additional Information
No response