Add Runner API pipeline and jobInfo in SamzaRunner configs

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.

https://beam.apache.org/

Apache License 2.0

7.81k stars 4.23k forks source link

Add Runner API pipeline and jobInfo in SamzaRunner configs #21628

Open damccorm opened 2 years ago

damccorm commented 2 years ago

Add 2 new fields

beamPipelinProto as the RunnerAPI pipeline
beamJobInfo as the JobInfo

They must be passed into the samza app in order to begin the samza container in portable mode

Imported from Jira BEAM-14379. Original Jira may contain additional context. Reported by: dchen.

damccorm commented 2 years ago

Unable to assign user @dxichen. If able, self-assign, otherwise tag @damccorm so that he can assign you. Because of GitHub's spam prevention system, your activity is required to enable assignment in this repo.