The-Academic-Observatory / academic-observatory-workflows

Telescopes, Workflows and Data Services for the Academic Observatory
https://academic-observatory-workflows.readthedocs.io
Apache License 2.0
16 stars 0 forks source link

Refactor Airflow DAGs to use Airflow Taskflow API #216

Closed jdddog closed 2 months ago

jdddog commented 4 months ago

This PR ports the Academic Observatory workflows to the Apache Airflow TaskFlow API.

Removed: Crossref Events, Open Citations, Geonames and Web of Science as they are either broken or unused.

codecov[bot] commented 2 months ago

Codecov Report

Attention: Patch coverage is 92.76789% with 191 lines in your changes are missing coverage. Please review.

Project coverage is 95.00%. Comparing base (c41fb89) to head (08e9624).

Files Patch % Lines
...workflows/openalex_telescope/openalex_telescope.py 86.27% 23 Missing and 19 partials :warning:
...ory_workflows/pubmed_telescope/pubmed_telescope.py 89.05% 21 Missing and 15 partials :warning:
...atory_workflows/orcid_telescope/orcid_telescope.py 89.34% 15 Missing and 11 partials :warning:
...rkflows/unpaywall_telescope/unpaywall_telescope.py 91.37% 8 Missing and 12 partials :warning:
...ows/oa_dashboard_workflow/oa_dashboard_workflow.py 90.76% 8 Missing and 9 partials :warning:
...servatory_workflows/ror_telescope/ror_telescope.py 88.79% 8 Missing and 5 partials :warning:
...ef_fundref_telescope/crossref_fundref_telescope.py 91.26% 6 Missing and 5 partials :warning:
...ory_workflows/scopus_telescope/scopus_telescope.py 89.65% 5 Missing and 4 partials :warning:
...observatory_workflows/doi_workflow/doi_workflow.py 96.48% 3 Missing and 4 partials :warning:
..._metadata_telescope/crossref_metadata_telescope.py 96.77% 2 Missing and 2 partials :warning:
... and 3 more
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #216 +/- ## ========================================== + Coverage 90.55% 95.00% +4.44% ========================================== Files 21 36 +15 Lines 5177 8285 +3108 Branches 749 1134 +385 ========================================== + Hits 4688 7871 +3183 + Misses 355 269 -86 - Partials 134 145 +11 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.