saurfang / spark-sas7bdat

Splittable SAS (.sas7bdat) Input Format for Hadoop and Spark SQL
http://spark-packages.org/package/saurfang/spark-sas7bdat
Apache License 2.0
89 stars 40 forks source link

Add support for reading SAS column label metadata. #42

Closed thesuperzapper closed 5 years ago

thesuperzapper commented 5 years ago

This is a minor change which allows the reader to correctly extract the SAS column labels as column comments.

This is useful for parquet-files/hive-tables, as spark transparently passes through this metadata.

saurfang commented 5 years ago

@thesuperzapper thanks for the contribution!