search

memsql / singlestore-spark-connector

A connector for SingleStore and Spark
Apache License 2.0
160 stars 54 forks source link

Spark MemSQL Connector looses connection after idle time #21

Closed mauropirrone closed 4 years ago

mauropirrone commented 8 years ago

Example:

val df = memsqlContext.read.format("com.memsql.spark.connector").load("db.table")

5 minutes idle time...

val df = memsqlContext.read.format("com.memsql.spark.connector").load("db.table") ...fails

Doing the same using the standard spark jdbc dataframe api, it works.

carlsverre commented 4 years ago

No longer an issue since we removed the connection pooling part of the code in the 3.0.0-beta