search

materials-data-facility / connect_server

The MDF Connect Server is the hosted ETL flow to deeply index datasets into the MDF and connected services.
https://www.materialsdatafacility.org/
Apache License 2.0
4 stars 3 forks source link

Move Data Retrieval Code to New Repository #20

Open WardLT opened 5 years ago

WardLT commented 5 years ago

As we modify the codes that publish data from certain repositories, should we move it to their own repositories? They provide great examples for how to use MDF Connect, and are kind of hidden here.

I'm willing to do this. Does anyone object?

jgaff commented 5 years ago

As discussed offline: I think it's a good idea to update the harvesters that can still be useful to us (MDR, for example) and move them to the docs/examples dir in the connect_client repo. Having practical, functional examples of dataset submission is a great idea, and I think having those examples close to the client will aid discovery.

WardLT commented 5 years ago

I'm adding a list of databases that we should build indexers for, which is very incomplete at the moment: