subugoe / hoad

Deprecated: Please check https://github.com/subugoe/hoaddash
https://github.com/subugoe/hoaddash
GNU Affero General Public License v3.0
15 stars 4 forks source link

fix missing SAGE data #197

Closed maxheld83 closed 4 years ago

maxheld83 commented 4 years ago

@jhoeffler just reported this on teams:

Und jetzt auch das neue. Habt Ihr SAGE rausgenommen, weil da so viele Informationen fehlten?

maxheld83 commented 4 years ago

@jhoeffler sorry also cannot reproduce this issue -- the data should be exactly the same as previously.

A possible difference is that the old dashboard (soon to be deprecated in #58) already has the 2020 update, but https://subugoe.github.io/hoad/ does not. But I did not otherwise edit the data sources.

AFAIK, there is only one SAGE journal on https://subugoe.shinyapps.io/hybridoa/, "Peacebuilding ..." something, so I am guessing this is new in the 2020 update.

I'll check back here once I've merged the 2020 update in #172

jhoeffler commented 4 years ago

The refactored dashboard version at https://subugoe.github.io/hoad/articles/interactive.html is based on data from around end of 2019, that’s why SAGE publications cannot be selected, there was still no open access license data for it in the CrossRef database.

The version available at https://subugoe.shinyapps.io/hybridoa/ seems to be based on data from update_jan_feb_20, when there was still very little data on SAGE open access licenses in the CrossRef database.

Just replacing hybrid_publications.csv in the refactored dashboard version with the jan_feb_20 update stored at https://github.com/subugoe/hoad/blob/update_jan_feb_20/data/hybrid_publications.csv?raw=true does not work (Max mentioned he could not reproduce the dashboard with that data version) as the columns domain and suffix are missing that are needed for the dashboard. Adding just empty columns for them allows to run the dashboard but with an error.

Updating the dashboard with the April 2020 data available at https://github.com/subugoe/hoad/blob/2020_update/data/hybrid_publications.csv?raw=true shows more SAGE journals as licenses indicating open access also for previous years were deposited to CrossRef only after February 2020.

The issue that SAGE has not contributed sufficient license data to CrossRef is nothing we can really resolve from our side, we can just observe how this develops and compare it to data we get frm elsewhere like OAPC and Unpaywall.

njahn82 commented 4 years ago

https://subugoe.shinyapps.io/hybridoa/ was deployed using this release: https://github.com/subugoe/hoad/releases/tag/v0.2

https://najkoja.shinyapps.io/hybridoa/ shows the current state of the 2020_update branch.

On Tue, 2 Jun 2020 at 14:53, jhoeffler notifications@github.com wrote:

The refactored dashboard version at https://subugoe.github.io/hoad/articles/interactive.html is based on data from around end of 2019, that’s why SAGE publications cannot be selected, there was still no open access license data for it in the CrossRef database.

The version available at https://subugoe.shinyapps.io/hybridoa/ seems to be based on data from update_jan_feb_20, when there was still very little data on SAGE open access licenses in the CrossRef database.

Just replacing hybrid_publications.csv in the refactored dashboard version with the jan_feb_20 update stored at https://github.com/subugoe/hoad/blob/update_jan_feb_20/data/hybrid_publications.csv?raw=true does not work (Max mentioned he could not reproduce the dashboard with that data version) as the columns domain and suffix are missing that are needed for the dashboard. Adding just empty columns for them allows to run the dashboard but with an error.

Updating the dashboard with the April 2020 data available at https://github.com/subugoe/hoad/blob/2020_update/data/hybrid_publications.csv?raw=true shows more SAGE journals as licenses indicating open access also for previous years were deposited to CrossRef only after February 2020.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/subugoe/hoad/issues/197#issuecomment-637522587, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAM7YRXKAVTTH2WIBPBQFK3RUTY5LANCNFSM4NOHIGKA .

maxheld83 commented 4 years ago

I'll revisit this once I've merged the 2020 data #172

njahn82 commented 4 years ago

I don't think this is needed, there's just a confusion about the different data versions.

maxheld83 commented 4 years ago

thanks! As expected, with #172 merged in , the issue is resolved in https://github.com/subugoe/hoad/commit/a10518e1f4ad7064750b900accc3636ad477cd9a.

Can confirm that SAGE is now also on http://subugoe.github.io/hoad/.