search

memsql / singlestore-spark-connector

A connector for SingleStore and Spark
Apache License 2.0
160 stars 54 forks source link

SaveMode configuration not honoured while saving data using DataFrameReader API #19

Closed shashankgowdal closed 4 years ago

shashankgowdal commented 8 years ago

All the following code appends the data to the table. It doesn't seem to honour the save mode specified

dataframe.write.format("com.memsql.spark.connector").mode(SaveMode.ErrorIfExists).save("test.tablename")
dataframe.write.format("com.memsql.spark.connector").mode(SaveMode.Overwrite).save("test.tablename")
dataframe.write.format("com.memsql.spark.connector").mode(SaveMode.Append).save("test.tablename")
yatsykve commented 5 years ago

any updates about this issue?

carlsverre commented 4 years ago

save mode is now 100% supported with JDBC semantics in the new 3.0.0-beta version of the connector (coming soon) https://github.com/memsql/memsql-spark-connector/tree/3.0.0-beta