feat: support checkpointing on structured streams

neo4j / neo4j-spark-connector

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

https://neo4j.com/developer/spark/

Apache License 2.0

313 stars 112 forks source link

Closed ali-ince closed 2 months ago

ali-ince commented 2 months ago

This PR updates structured streaming parts of the connector so that it relies to offsets checkpointed rather than following it's own logic.

Fixes #579.