Execute the harvest - Githubissues

stream-project / WP4R

Work Package 4 (Leitung:Infai)

1 stars 0 forks source link

Execute the harvest #11

Closed TBoonX closed 3 years ago

TBoonX commented 4 years ago

In order to test the first phase the data should be harvested.

[ ] Select datasets which should be harvested
[x] execute the harvest
[x] done for NOMAD
[x] done for DSMS

TBoonX commented 3 years ago

Atm we have no preselection or filter for datasets. The harvest was done for NOMAD yesterday evening. It seems that the API is working on the current NOMAD data and thus I stopped the harvest after around 21700 datasets. Also we need to improve some details of the mapping, see #30

TBoonX commented 3 years ago

I will close this issue because DSMS has only a few datasets and the beta version of NOMAD which we are using atm has also just a few. We will harvest more when the data repositories made progress and also in the other milestones.