search

springml / spark-sftp

Spark connector for SFTP
Apache License 2.0
100 stars 98 forks source link

Support for Spark 2.3.0 quote, escape and multiLine for CSV #55

Closed alapinsk closed 5 years ago

alapinsk commented 5 years ago

Spark 2.3.0 CSV support for custom options

  1. quote
  2. escape

  3. multiLine

    Spark 2.3.0 API documentation https://spark.apache.org/docs/2.3.0/api/java/index.html?org/apache/spark/sql/DataFrameReader.html

mi7flat5 commented 5 years ago

any idea when or if this will get merged?

samuel-pt commented 5 years ago

@mi7flat5 We've merged it. Thanks for your PR