search

ray-project / ray_beam_runner

Ray-based Apache Beam runner
Apache License 2.0
42 stars 12 forks source link

Support the runner-requested-split path for SDF #22

Open pabloem opened 2 years ago

pabloem commented 2 years ago

This does not include adding dynamic splitting of work - instead, this only means setting up the data/request path with a pre-provided split manager like in FnApiRunnerTest.

pabloem commented 2 years ago

I'll take on this issue as well.

valiantljk commented 2 years ago

@pabloem you can assign to me

pabloem commented 2 years ago

@valiantljk I will get some pointers to look at this : )