search

vertica / spark-connector

This component acts as a bridge between Spark and Vertica, allowing the user to either retrieve data from Vertica for processing in Spark, or store processed data from Spark into Vertica.
Apache License 2.0
20 stars 23 forks source link

[REFACTOR] Remove JDBC reference from executor code #403

Open Aryex opened 2 years ago

Aryex commented 2 years ago

Descriptions

Executors are not expected to use jdbc connections. However, we currently are passing JdbcLayerInterface references to them. This creates a few issues:

  1. 398 was caused by this and more bugs may come up in the future.

  2. It is also misleading since executors should not need to make any jdbc connections at all.

Thus, we should refactor the code to remove jdbc references from being passed down to executors, keeping it clean and avoiding future bugs.

jeremyprime commented 2 years ago

See also #324 for a related bug on this issue (and #314 before that, which was resolved).

alexey-temnikov commented 1 year ago

Downgraded to Normal priority since there is no functional or performance impact.