[Feature Request]: [Streaming Engine Worker] Use more asynchronous processing for auxiliary streaming engine worker processing.

[m-trieu]

What would you like to happen?

Right now we block worker startup on some RPCs (i.e reporting worker startup to dataflow backend). Do not block on this and see if we can make this task as well as possibly others asynchronous.

cc @arunpandianp @scwhittle

Issue Priority

Priority: 3 (nice-to-have improvement)

Issue Components

• [ ] Component: Python SDK
• [ ] Component: Java SDK
• [ ] Component: Go SDK
• [ ] Component: Typescript SDK
• [ ] Component: IO connector
• [ ] Component: Beam YAML
• [ ] Component: Beam examples
• [ ] Component: Beam playground
• [ ] Component: Beam katas
• [ ] Component: Website
• [ ] Component: Spark Runner
• [ ] Component: Flink Runner
• [ ] Component: Samza Runner
• [ ] Component: Twister2 Runner
• [ ] Component: Hazelcast Jet Runner
• [X] Component: Google Cloud Dataflow Runner

[m-trieu]

can assign to me