Closed irajhedayati closed 1 year ago
After upgrading to 0.16.0 from 0.14.0, my tests started failing.
0.16.0
0.14.0
Here is the output of the unit test
== Results == !== Correct Answer - 4 == == Spark Answer - 4 == struct<id:string> struct<id:string> ![A] [ B] ![B] [ D ] ![C] [A] ![D] [C ]
Here is how I read the file
context.spark.read .format("com.databricks.spark.xml") .option("mode", "FAILFAST") .option("inferSchema", true) .option("rootTag", "feed") .option("rowTag", "entry") .option("treatEmptyValuesAsNulls", true) .option("ignoreNamespace", true) .option("ignoreSurroundingSpaces", true) .load("/path/to/file.xml")
and this is the input file
<?xml version="1.0" encoding="UTF-8"?> <feed> <entry> <id>A</id> </entry> <entry> <id> B</id> </entry> <entry> <id>C </id> </entry> <entry> <id> D </id> </entry> </feed>
Yeah, hm, I see what happened. I'll open a PR for this shortly.
After upgrading to
0.16.0
from0.14.0
, my tests started failing.Here is the output of the unit test
Here is how I read the file
and this is the input file