search

springml / spark-sftp

Spark connector for SFTP
Apache License 2.0
100 stars 98 forks source link

fix springml#58 Remove the hard dependency to HDFS #72

Open PierreAlexMaury opened 4 years ago

PierreAlexMaury commented 4 years ago

Modify the condition to evaluate the case we are NOT on local FS. Doing this way it's wasb(s) or s3 compatible if the cluster is based on this kind of distributed filesystem