ArroyoSystems / arroyo

Distributed stream processing engine in Rust
https://arroyo.dev
Apache License 2.0
3.82k stars 223 forks source link

Df restructure extensions #548

Closed jacksonrnewhouse closed 9 months ago

jacksonrnewhouse commented 9 months ago

This standardizes how we convert our LogicalPlan::Extensions into the pipeline graph. I've added a new trait, ArroyoExtension, which returns the outgoing ArroyoSchema for the node and, given the input ArroyoSchemas, the corresponding LogicalNode and LogicalEdges. I've also moved all of the extensions into their own files under the extension module.