apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.78k stars 4.21k forks source link

Writing string to pubsub on Python SDK #20735

Open damccorm opened 2 years ago

damccorm commented 2 years ago

Can you please add writing strings to pubsub on batch job like it is now available in streaming, please. https://beam.apache.org/releases/pydoc/2.2.0/apache_beam.io.gcp.pubsub.html

Imported from Jira BEAM-11923. Original Jira may contain additional context. Reported by: ArturJ.

aaltay commented 1 month ago

@damccorm @liferoad - for your consideration: An issue came in the context of YAML where it was noted that pubsub IO in python does not work in batch mode (unlike java). This seems to be a gap in the python connector. It is not urgent, but it may be higher priority than P3.