[SHARE-1035] Update NSF harvester to look back farther

CenterForOpenScience / SHARE

SHARE is building a free, open, data set about research and scholarly activities across their life cycle.

http://share-research.readthedocs.io/en/latest/index.html

Apache License 2.0

100 stars 58 forks source link

[SHARE-1035] Update NSF harvester to look back farther #767

Closed aaxelb closed 6 years ago

aaxelb commented 6 years ago

Update the NSF harvester -- when harvesting today's data, looks several days back, too. Records appear to be posted on the next business day, so harvesting on Monday means we have to filter to Friday's data. Assuming the same is true over long holiday weekends, just harvest 5 days back.

Also set datestamp on the harvested datums.

coveralls commented 6 years ago

Coverage decreased (-0.02%) to 79.102% when pulling bb5492da72e14870371662d18510c9a45e6c7ec3 on aaxelb:share-1035--nsf-delay into 6ae7692ccabf0f09c1396f262475493a78482810 on CenterForOpenScience:develop.