Add Capability to Configure the File Encoding for CSV Files

springml / spark-sftp

Spark connector for SFTP

Apache License 2.0

100 stars 98 forks source link

Add Capability to Configure the File Encoding for CSV Files #84

Open raffael-dzikowski opened 3 years ago

raffael-dzikowski commented 3 years ago

This PR proposes to make the file encoding for the CSV file type configurable. The default encoding is set to UTF-8, which corresponds to the default setting on Spark side.

We also provide a unit test to cover the new functionality.