azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark
Apache License 2.0
80 stars 26 forks source link

PostgreSQL writer #93

Open mojodna opened 5 years ago

mojodna commented 5 years ago

Current implemented for streaming sources as a foreachWriter, but would be more general if it were actually a sink.

Sources of inspiration:

mojodna commented 5 years ago

Also see https://docs.databricks.com/spark/latest/data-sources/sql-databases.html#write-data-to-jdbc

mojodna commented 5 years ago

If only getInsertStatement could be overridden...