delimiter can't applied

springml / spark-sftp

Spark connector for SFTP

Apache License 2.0

100 stars 99 forks source link

delimiter can't applied #14

Closed LEEHYUNGKYU closed 7 years ago

LEEHYUNGKYU commented 7 years ago

rdd.write .format("com.springml.spark.sftp") .option("host", "10.192.236.236") .option("username", "centos") .option("fileType", "csv") .option("delimiter", ";") .option("inferSchema", "true") .option("pem", "/home/hyungkyu/.ssh/mars.pem") .save("/home/centos/test.cb")

I wrote this code and run. it works. but delimiter is not applied.

springml commented 7 years ago

@LEEHYUNGKYU Custom delimiter fix is not yet into maven repository. If you need to use it, please build spark-sftp and include it via --jars option

springml commented 7 years ago

@LEEHYUNGKYU New version of spark-sftp connector is pushed to maven repository. If you still face any issues please reopen this issue