Closed Xabitsuki closed 1 year ago
I think this says you don't actually have the Spark XML library installed. Use --packages
when you submit, as shown in the README
Hi, thanks for your answer, tried submitting a job passing the jar using --jars of spark-submit but it did not work...
Hi I am trying to use spark-xml to parse a column in a dataframe that contains a string of xml. Following on the read me, I tried to use
to this very simple data frame:
I get
Setup:
Pyspark / Spark 2.4.7 Scala 2.11.12 com.databricks:spark-xml_2.11:0.13.0
Sparksession:
I create the spark session using SparkConf to enter all these config params.