Fix hdfs_fs.csv being broken if there are filenames in HDFS with commas

cloudera-labs / toolkits

Apache License 2.0

13 stars 20 forks source link

Fix hdfs_fs.csv being broken if there are filenames in HDFS with commas #32

Closed aonishuk closed 11 months ago

aonishuk commented 11 months ago

There is a bug in hdfs client which creates broken CSV files via 'hdfs oiv', if filenames in hdfs contain commas. This change checks if generated hdfs_fs.csv is valid. If it's not attempts to fix it.