apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.89k stars 4.27k forks source link

[yaml] add mysql, oracle, postgres and sql server providers #33124

Open Polber opened 1 week ago

Polber commented 1 week ago

PR adds standalone SchemaTransform Providers for the specific implementations of JDBC (MySQL, PostgreSQL, Oracle and SQL Server).

This was already simulated in the Beam YAML framework, but by implementing concrete providers, other SDKs can take advantage of the pre-packaged drivers (Python and Go SDKs). This also allows for specific doc generation specific to an implementation.

More detailed docs were also added.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels Python tests Java tests Go tests

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

Polber commented 1 week ago

R: @robertwb

Polber commented 1 week ago

R: @damccorm

github-actions[bot] commented 1 week ago

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment assign set of reviewers