Closed ttnghia closed 1 month ago
Add a config spark.rapids.sql.json.read.datetime.enabled with default to false to disable date/timestamp types when parsing JSON due to compatibility reason, as our GPU implementation cannot match 100% output with Apache Spark for these types.
spark.rapids.sql.json.read.datetime.enabled
false
build
ttnghia
commented
1 month ago
Add a config
spark.rapids.sql.json.read.datetime.enabledwith default tofalseto disable date/timestamp types when parsing JSON due to compatibility reason, as our GPU implementation cannot match 100% output with Apache Spark for these types.