The-Academic-Observatory / oaebu-workflows

Telescopes, Workflows and Data Services for the 'Book Analytics Dashboard Project (2022-2025)', building upon the project 'Developing a Pilot Data Trust for Open Access eBook Usage (2020-2022)'
https://documentation.book-analytics.org/
Apache License 2.0
5 stars 0 forks source link

BAD-276: Fulcrum Telescope Development #113

Closed keegansmith21 closed 1 year ago

keegansmith21 commented 2 years ago

Fulcrum Telescope

Similar to the Thoth Telescope (#119), Fulcrum forgoes the use of the telescope templates in favor of a more modular approach.

The telescope can be compared to the oapen_irus_uk telescope as it hits the same API (using a different platform number - 235). However, because no sensitive IP information is used, it is much simpler to operate.

The telescope workflow runs once a month for every publisher that makes use of the Fulcrum platform. Each run will download its respective month's data, transform it and add it to a partitioned table in BigQuery.

Currently, only University of Michigan is using Fulcrum

codecov[bot] commented 2 years ago

Codecov Report

Patch coverage: 87.82% and project coverage change: -0.39 :warning:

Comparison is base (00c336c) 94.87% compared to head (91dc867) 94.49%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #113 +/- ## =========================================== - Coverage 94.87% 94.49% -0.39% =========================================== Files 23 24 +1 Lines 2734 2890 +156 Branches 360 380 +20 =========================================== + Hits 2594 2731 +137 - Misses 65 73 +8 - Partials 75 86 +11 ``` | [Impacted Files](https://codecov.io/gh/The-Academic-Observatory/oaebu-workflows/pull/113?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory) | Coverage Δ | | |---|---|---| | [oaebu\_workflows/workflows/fulcrum\_telescope.py](https://codecov.io/gh/The-Academic-Observatory/oaebu-workflows/pull/113?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory#diff-b2FlYnVfd29ya2Zsb3dzL3dvcmtmbG93cy9mdWxjcnVtX3RlbGVzY29wZS5weQ==) | `87.07% <87.07%> (ø)` | | | [oaebu\_workflows/api\_type\_ids.py](https://codecov.io/gh/The-Academic-Observatory/oaebu-workflows/pull/113?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory#diff-b2FlYnVfd29ya2Zsb3dzL2FwaV90eXBlX2lkcy5weQ==) | `100.00% <100.00%> (ø)` | | | [oaebu\_workflows/identifiers.py](https://codecov.io/gh/The-Academic-Observatory/oaebu-workflows/pull/113?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory#diff-b2FlYnVfd29ya2Zsb3dzL2lkZW50aWZpZXJzLnB5) | `100.00% <100.00%> (ø)` | | | [oaebu\_workflows/seed/dataset\_info.py](https://codecov.io/gh/The-Academic-Observatory/oaebu-workflows/pull/113?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory#diff-b2FlYnVfd29ya2Zsb3dzL3NlZWQvZGF0YXNldF9pbmZvLnB5) | `100.00% <100.00%> (ø)` | | | [oaebu\_workflows/seed/dataset\_type\_info.py](https://codecov.io/gh/The-Academic-Observatory/oaebu-workflows/pull/113?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory#diff-b2FlYnVfd29ya2Zsb3dzL3NlZWQvZGF0YXNldF90eXBlX2luZm8ucHk=) | `100.00% <100.00%> (ø)` | | | [oaebu\_workflows/seed/workflow\_info.py](https://codecov.io/gh/The-Academic-Observatory/oaebu-workflows/pull/113?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory#diff-b2FlYnVfd29ya2Zsb3dzL3NlZWQvd29ya2Zsb3dfaW5mby5weQ==) | `100.00% <100.00%> (ø)` | | | [oaebu\_workflows/seed/workflow\_type\_info.py](https://codecov.io/gh/The-Academic-Observatory/oaebu-workflows/pull/113?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory#diff-b2FlYnVfd29ya2Zsb3dzL3NlZWQvd29ya2Zsb3dfdHlwZV9pbmZvLnB5) | `100.00% <100.00%> (ø)` | | Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory). Have a feature suggestion? [Share it here.](https://app.codecov.io/gh/feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The-Academic-Observatory)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.