zazuko / barnard59

An intuitive and flexible RDF pipeline solution designed to simplify and automate ETL processes for efficient data management.
26 stars 2 forks source link

fix: properly merge quads in batch #274

Closed giacomociti closed 9 months ago

changeset-bot[bot] commented 9 months ago

🦋 Changeset detected

Latest commit: a08d8ebeaf0c42c688c1949335d74b6435842ed2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package | Name | Type | | -------------- | ----- | | barnard59-cube | Patch |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

giacomociti commented 9 months ago

flatten would nullify batch, causing validation of a single observation at a time

Rdataflow commented 9 months ago

@giacomociti curious: can you spawn these batches to multicore?

codecov[bot] commented 9 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (f56b89f) 85.16% compared to head (a08d8eb) 85.18%. Report is 2 commits behind head on master.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #274 +/- ## ========================================== + Coverage 85.16% 85.18% +0.01% ========================================== Files 170 171 +1 Lines 6797 6804 +7 Branches 102 102 ========================================== + Hits 5789 5796 +7 Misses 1006 1006 Partials 2 2 ``` | [Flag](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | Coverage Δ | | |---|---|---| | [barnard59](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `81.20% <ø> (ø)` | | | [barnard59-base](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `47.97% <ø> (ø)` | | | [barnard59-core](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `90.92% <ø> (ø)` | | | [barnard59-csvw](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `80.21% <ø> (ø)` | | | [barnard59-cube](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `96.39% <100.00%> (+0.03%)` | :arrow_up: | | [barnard59-formats](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `32.63% <ø> (ø)` | | | [barnard59-ftp](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `85.38% <ø> (ø)` | | | [barnard59-graph-store](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `95.67% <ø> (ø)` | | | [barnard59-http](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `87.50% <ø> (ø)` | | | [barnard59-rdf](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `94.95% <ø> (ø)` | | | [barnard59-s3](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `100.00% <ø> (ø)` | | | [barnard59-shacl](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `54.92% <ø> (ø)` | | | [barnard59-sparql](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `91.11% <ø> (ø)` | | | [barnard59-validation](https://app.codecov.io/gh/zazuko/barnard59/pull/274/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko) | `97.53% <ø> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zazuko#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.