Would we be able to add a "nullValue" option to the writeToTemp method?
Here is some more info on the nullValue:
nullValue – sets the string representation of a null value. If None is set, it uses the default value, empty string. Since 2.0.1, this nullValue param applies to all supported types including the string type.
Would we be able to add a "nullValue" option to the writeToTemp method?
Here is some more info on the nullValue: nullValue – sets the string representation of a null value. If None is set, it uses the default value, empty string. Since 2.0.1, this nullValue param applies to all supported types including the string type.
https://spark.apache.org/docs/2.1.0/api/python/pyspark.sql.html?highlight=drop
Thanks, Karthik