launchflow / buildflow

BuildFlow, is an open source framework for building large scale systems using Python. All you need to do is describe where your input is coming from and where your output should be written, and BuildFlow handles the rest. No configuration outside of the code is required.
https://docs.launchflow.com/buildflow
Apache License 2.0
193 stars 7 forks source link

first draft of gcs file stream source #223

Closed boetro closed 1 year ago

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 86.80% and project coverage change: +2.25% :tada:

Comparison is base (e7ab17f) 74.82% compared to head (0d148fd) 77.07%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #223 +/- ## ========================================== + Coverage 74.82% 77.07% +2.25% ========================================== Files 83 91 +8 Lines 3027 3346 +319 ========================================== + Hits 2265 2579 +314 - Misses 762 767 +5 ``` | [Files Changed](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow) | Coverage Δ | | |---|---|---| | [...ntime/actors/pipeline\_pattern/pull\_process\_push.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvYXBwL3J1bnRpbWUvYWN0b3JzL3BpcGVsaW5lX3BhdHRlcm4vcHVsbF9wcm9jZXNzX3B1c2gucHk=) | `21.37% <0.00%> (-0.46%)` | :arrow_down: | | [buildflow/core/io/gcp/bigquery.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vZ2NwL2JpZ3F1ZXJ5LnB5) | `73.33% <ø> (ø)` | | | [buildflow/core/io/gcp/storage\_test.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vZ2NwL3N0b3JhZ2VfdGVzdC5weQ==) | `94.44% <ø> (ø)` | | | [...low/core/io/gcp/strategies/composite\_strategies.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vZ2NwL3N0cmF0ZWdpZXMvY29tcG9zaXRlX3N0cmF0ZWdpZXMucHk=) | `52.27% <44.82%> (ø)` | | | [...ldflow/core/io/local/strategies/file\_strategies.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vbG9jYWwvc3RyYXRlZ2llcy9maWxlX3N0cmF0ZWdpZXMucHk=) | `91.42% <66.66%> (-2.52%)` | :arrow_down: | | [buildflow/core/types/gcp\_types.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvdHlwZXMvZ2NwX3R5cGVzLnB5) | `84.00% <69.23%> (-16.00%)` | :arrow_down: | | [buildflow/core/types/local\_types.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvdHlwZXMvbG9jYWxfdHlwZXMucHk=) | `76.47% <73.33%> (-23.53%)` | :arrow_down: | | [buildflow/core/io/local/file.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vbG9jYWwvZmlsZS5weQ==) | `82.60% <75.00%> (-4.90%)` | :arrow_down: | | [buildflow/core/io/gcp/pubsub.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vZ2NwL3B1YnN1Yi5weQ==) | `86.00% <81.81%> (+18.55%)` | :arrow_up: | | [buildflow/core/io/gcp/composite.py](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow#diff-YnVpbGRmbG93L2NvcmUvaW8vZ2NwL2NvbXBvc2l0ZS5weQ==) | `92.85% <89.47%> (ø)` | | | ... and [15 more](https://app.codecov.io/gh/launchflow/buildflow/pull/223?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow) | | ... and [3 files with indirect coverage changes](https://app.codecov.io/gh/launchflow/buildflow/pull/223/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=launchflow)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.