search

NIAID-Data-Ecosystem / nde-crawlers

Harvesting infrastructure to collect and standardize dataset and computational tool metadata
Apache License 2.0
0 stars 0 forks source link

Create Dataverse crawler #64

Open flaneuse opened 1 year ago

flaneuse commented 1 year ago
  1. Use Dataverse API to harvest the metadata in schema.org JSON-LD.
  2. Can use @ juliamullen's COVID-19 parser as inspiration, just without the queries
  3. Add in caching.