springml / spark-sftp

Spark connector for SFTP
Apache License 2.0
100 stars 98 forks source link

GZip Support #5

Closed nkittsteiner closed 7 years ago

nkittsteiner commented 7 years ago

Is it possible to handle .gz compressed files as input for dataframes?

springml commented 7 years ago

Yes it is possible to provide compressed files as input as the underlying spark library takes of it