Rationalize logging of record, exception in error cases

databricks / spark-xml

XML data source for Spark SQL and DataFrames

Apache License 2.0

500 stars 226 forks source link

Rationalize logging of record, exception in error cases #595

Closed srowen closed 2 years ago

srowen commented 2 years ago

Original issue at https://github.com/databricks/spark-xml/issues/593 but was somehow deleted?

The ideas here are to:

Not put the data in the exception message, but stick to logs, to maybe avoid data leakage to caller
Standardize and rationalize how these are logged

Mike-Robert-CHC commented 2 years ago

@srowen Thank you for working with me on this issue. #593 is now closed and available for viewing -- GitHub replied to my ticket and said their spam detecting system sometimes flags user accounts for manual review, which occurred in my case. I will close PR #594.