search

springml / spark-sftp

Spark connector for SFTP
Apache License 2.0
100 stars 98 forks source link

No such file error #76

Open giobaro opened 4 years ago

giobaro commented 4 years ago

I have a working sftp docker installation. When I try to read a file with this command

df = spark.read.format("com.springml.spark.sftp").option("host", "xxxx").option("username", "sftpuser").option("password", "xxx").option("fileType", "csv").option("header","true").load("/home/sftpuser/upload/test.csv")

I receive this error Py4JJavaError: An error occurred while calling o438.load. : 2: No such file

I verified that file test1.csv is the /home/sftpuser/upload Can you help me in solving this issue?

abhi9cr7 commented 4 years ago

I have the same issue. Tried every possible way for the location. But it keeps returning "No Such File" error.