search

springml / spark-sftp

Spark connector for SFTP
Apache License 2.0
100 stars 98 forks source link

NoSuchMethodError while sending file to ftp location #87

Open mrugankatdure opened 2 years ago

mrugankatdure commented 2 years ago

Getting ,

Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)Lscala/collection/mutable/ArrayOps;

CODE:

val rDD = sparkContext.parallelize(data)
val df = sparkSession.createDataFrame(rDD)
df.printSchema()

val ftpDf = df.write.format("com.springml.spark.sftp")
  .option("host","server name")
  .option("username","*****")
  .option("password","*******")
  .option("fileType","csv")
  .option("delimeter","|")
  .option("quote", "\u0000")
  .option("nullValue",null)
  .save("/somelocation/mrugank/sample.csv")