springml / spark-sftp

Spark connector for SFTP
Apache License 2.0
100 stars 98 forks source link

Add support to text files for read/write #32

Closed bagopalan closed 5 years ago

bagopalan commented 6 years ago

Currently we have support for json,avro,parquet and csv. By this we will have support for text files.

We want to use spark-sftp in our following Gimel project. https://github.com/paypal/gimel

Gimel provides unified Data API to access data from any storage like HDFS, GS, Alluxio, Hbase, Aerospike, BigQuery, Druid, Elastic, Teradata, Oracle, MySQL, etc.