search

nodestream-proj / nodestream

A Declarative framework for Building, Maintaining, and Analyzing Graph Data
https://nodestream-proj.github.io/docs/
Apache License 2.0
36 stars 10 forks source link

Refactoring the Pipeline Runtime #304

Closed zprobst closed 2 weeks ago

zprobst commented 3 months ago

NOTE: The target branch for this is 0.13.

This change introduces a better seperation of responsibility between the different aspects of the pipeline runtime. For instance, there are now specialized input and output classes that handle waiting for streaming data between steps as opposed to jamming things into the step context.

This allows steps access to the context so that they can individually emit messages through context.

Closes #187

codecov[bot] commented 3 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 97.89%. Comparing base (8dfb14b) to head (3301d04). Report is 10 commits behind head on 0.13.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## 0.13 #304 +/- ## ========================================== - Coverage 97.93% 97.89% -0.04% ========================================== Files 144 145 +1 Lines 5122 5128 +6 ========================================== + Hits 5016 5020 +4 - Misses 106 108 +2 ``` | [Flag](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | Coverage Δ | | |---|---|---| | [3.10-macos-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.87% <100.00%> (-0.04%)` | :arrow_down: | | [3.10-ubuntu-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.85% <99.52%> (-0.06%)` | :arrow_down: | | [3.10-windows-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.81% <99.52%> (-0.06%)` | :arrow_down: | | [3.11-macos-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.87% <100.00%> (-0.04%)` | :arrow_down: | | [3.11-ubuntu-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.85% <99.52%> (-0.06%)` | :arrow_down: | | [3.11-windows-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.81% <99.52%> (-0.06%)` | :arrow_down: | | [3.12-macos-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.87% <100.00%> (-0.04%)` | :arrow_down: | | [3.12-ubuntu-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.85% <99.52%> (-0.06%)` | :arrow_down: | | [3.12-windows-latest](https://app.codecov.io/gh/nodestream-proj/nodestream/pull/304/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj) | `97.81% <99.52%> (-0.06%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=nodestream-proj#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

zprobst commented 3 weeks ago

Coverage drop due to removal of covered lines.