apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.76k stars 4.21k forks source link

Python SDK should support SQL connector like JDBC IO #18286

Closed kennknowles closed 1 year ago

kennknowles commented 2 years ago

It would be great if SQL support could be added to Python SDK similar to JDBC IO in Java SDK.

May be SQLAlchemy Core could be used to support multiple databases and dialects to provide unified API analogous to JDBC?

Imported from Jira BEAM-2097. Original Jira may contain additional context. Reported by: rajas.abhyankar.

Abacn commented 1 year ago

did by xlang sql transform