The-Academic-Observatory / academic-observatory-workflows

Telescopes, Workflows and Data Services for the Academic Observatory
https://academic-observatory-workflows.readthedocs.io
Apache License 2.0
16 stars 1 forks source link

Optimise OpenAlex table loading #205

Closed jdddog closed 9 months ago

jdddog commented 9 months ago

Optimised OpenAlex table loading and retention in several ways:

Also:

codecov[bot] commented 9 months ago

Codecov Report

Attention: 23 lines in your changes are missing coverage. Please review.

Comparison is base (440f10c) 94.13% compared to head (41ed0f6) 93.80%.

Files Patch % Lines
...ervatory_workflows/workflows/openalex_telescope.py 68.05% 11 Missing and 12 partials :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #205 +/- ## ========================================== - Coverage 94.13% 93.80% -0.34% ========================================== Files 23 23 Lines 5648 5681 +33 Branches 783 797 +14 ========================================== + Hits 5317 5329 +12 - Misses 194 204 +10 - Partials 137 148 +11 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.