datahq / dataflows

DataFlows is a simple, intuitive lightweight framework for building data processing flows in python.
https://dataflows.org
MIT License
194 stars 39 forks source link

Runtime execution contract documentation #64

Open micimize opened 5 years ago

micimize commented 5 years ago

From what I can tell, when a flow is processed, each row goes through the entire pipeline before the next is processed (for the most part). Also as discussed in gitter, resources are only available after the package.pkg has been yielded (in a package level processor).