A data processing pipeline that schedules and runs content harvesters, normalizes their data, and outputs that normalized data to a variety of output streams. This is part of the SHARE project, and will be used to create a free and open dataset of research (meta)data. Data collected can be explored at https://osf.io/share/, and viewed at https://osf.io/api/v1/share/search/. Developer docs can be viewed at https://osf.io/wur56/wiki
Django env variable is overwritten in the OSF and causes local scrapi errors when running scrapi and the OSF one after another... might be a better way to fix this, but this seems to be how the OSF sets the variable.
Coverage increased (+0.1%) to 93.557% when pulling 05aa224c200e3bbf44ba89e707996f1292bfa4b0 on erinspace:feature/django_settings into 05282578751f52e3c955d0b190c5628dd221389a on CenterForOpenScience:develop.
Django env variable is overwritten in the OSF and causes local scrapi errors when running scrapi and the OSF one after another... might be a better way to fix this, but this seems to be how the OSF sets the variable.