search

The-Academic-Observatory / oaebu-workflows

Telescopes, Workflows and Data Services for the 'Book Analytics Dashboard Project (2022-2025)', building upon the project 'Developing a Pilot Data Trust for Open Access eBook Usage (2020-2022)'
https://documentation.book-analytics.org/
Apache License 2.0
5 stars 0 forks source link

INF-540: Updated JSTOR telescope to ignore new fields in the schema #111

Closed keegansmith21 closed 2 years ago

keegansmith21 commented 2 years ago

The JSTOR telescope has run into issues with new data. The data cannot be loaded into the table as there are now new fields. We would prefer new fields to be ignored by default so that this doesn't happen.

codecov[bot] commented 2 years ago

Codecov Report

Merging #111 (77ceaca) into develop (d41184e) will not change coverage. The diff coverage is n/a.

@@           Coverage Diff            @@
##           develop     #111   +/-   ##
========================================
  Coverage    95.25%   95.25%           
========================================
  Files           23       23           
  Lines         2359     2359           
  Branches       302      302           
========================================
  Hits          2247     2247           
  Misses          55       55           
  Partials        57       57
Impacted Files Coverage Δ
oaebu_workflows/workflows/jstor_telescope.py 90.51% <ø> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.