laysakura / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
5 stars 7 forks source link

chore: worker cleanup and prep for extension #35

Closed sjvanrossum closed 1 year ago

sjvanrossum commented 1 year ago

Cleaned up the worker code a bit in preparation of adding logging and status services and the data channel manager. Worker instantiation didn't bubble the result up to the caller and instead just panicked, that's fixed and new has been renamed to try_new to communicate that change. I also removed anything async from Worker instantiation, connections are lazily constructed now. I'm hoping this makes everything a bit more friendly to read.

laysakura commented 1 year ago

Great job!