zazuko / barnard59

An intuitive and flexible RDF pipeline solution designed to simplify and automate ETL processes for efficient data management.
26 stars 2 forks source link

refactor: generator writing to graph store #284

Closed tpluscode closed 6 months ago

tpluscode commented 6 months ago

We can preserve the behaviour of no request being sent easily by replacing the stream transform with an async generator.

changeset-bot[bot] commented 6 months ago

⚠️ No Changeset found

Latest commit: 86576d588c2c60403e56a46681f7cf9be094862a

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

codecov[bot] commented 6 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 84.93%. Comparing base (b02b00c) to head (86576d5).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## sparql-v3 #284 +/- ## ============================================= - Coverage 84.94% 84.93% -0.02% ============================================= Files 172 172 Lines 6861 6869 +8 Branches 102 102 ============================================= + Hits 5828 5834 +6 - Misses 1031 1033 +2 Partials 2 2 ``` | [Flag](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | Coverage Δ | | |---|---|---| | [barnard59](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `81.20% <ø> (ø)` | | | [barnard59-base](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `47.97% <ø> (ø)` | | | [barnard59-core](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `90.92% <ø> (ø)` | | | [barnard59-csvw](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `80.21% <ø> (ø)` | | | [barnard59-cube](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `96.39% <ø> (ø)` | | | [barnard59-formats](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `32.63% <ø> (ø)` | | | [barnard59-ftp](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `85.38% <ø> (ø)` | | | [barnard59-graph-store](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `94.11% <100.00%> (-1.06%)` | :arrow_down: | | [barnard59-http](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `87.50% <ø> (ø)` | | | [barnard59-rdf](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `94.95% <ø> (ø)` | | | [barnard59-s3](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `100.00% <ø> (ø)` | | | [barnard59-shacl](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `52.17% <ø> (ø)` | | | [barnard59-sparql](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `94.93% <ø> (ø)` | | | [barnard59-validation](https://app.codecov.io/gh/zazuko/barnard59/pull/284/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `97.53% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.