JDBC errors within the Future callback for load/unload are not caught (and the executors are still waiting for DataStreams)

ActianCorp / spark-vector

Repository for the Spark-Vector connector

Apache License 2.0

20 stars 9 forks source link

JDBC errors within the Future callback for load/unload are not caught (and the executors are still waiting for DataStreams) #30

Closed cbarca closed 8 years ago

cbarca commented 8 years ago

Catch the errors within the scala.concurent.Future that we use for the sql load/unload statements and rollback the current transactions to unblock our spark executors from waiting for the DataStreams.