The-Academic-Observatory / academic-observatory-workflows

Telescopes, Workflows and Data Services for the Academic Observatory
https://academic-observatory-workflows.readthedocs.io
Apache License 2.0
16 stars 0 forks source link

Update: Fix OpenAlex schema and add missing fields #204

Closed alexmassen-hane closed 7 months ago

alexmassen-hane commented 7 months ago

This PR is to fix the works table schema so that it can be ingested into BigQuery successfully. While I was debugging the failed import, I found a number of fields that we were missing in our schema. Most of the missing fields were under the locations and sources dehydrated objects and I have included them into this PR.

Please review and edit as necessary.

codecov[bot] commented 7 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (a00ce0e) 94.10% compared to head (664aa40) 94.10%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #204 +/- ## ======================================= Coverage 94.10% 94.10% ======================================= Files 23 23 Lines 5646 5646 Branches 783 783 ======================================= Hits 5313 5313 Misses 194 194 Partials 139 139 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.