GitHub has a usual repo size limit of 5GB and we're already at +3GB even before adding all the other journals we would like in the future. So I think a more scalable solution (and better also for open science) would be to manually store all the data on an OSF project, and then find a way to read the data directly from OSF in the automatic GitHub workflow, download the new data locally, and then merge the data. This way, (1) the repo size remains small and (2) the data is available in a conventional way (OSF) for others who wish to explore or investigate the data.
@psforscher I recommend that you subscribe to all new activity on this repo so you can see when I open new issues without me having to tag you :P (if you want)
GitHub has a usual repo size limit of 5GB and we're already at +3GB even before adding all the other journals we would like in the future. So I think a more scalable solution (and better also for open science) would be to manually store all the data on an OSF project, and then find a way to read the data directly from OSF in the automatic GitHub workflow, download the new data locally, and then merge the data. This way, (1) the repo size remains small and (2) the data is available in a conventional way (OSF) for others who wish to explore or investigate the data.