neontribe / Linked_Development

Linked Development
1 stars 1 forks source link

Refactor crawler #47

Closed practicalparticipation closed 11 years ago

practicalparticipation commented 11 years ago

I've updated the eldis and r4d crawlers to fetch the additional data that is needed for the API to work effectively.

The eldis scripts have moved into a subdirector of tools, so I have tried to update references elsewhere in the system to these scripts so that the first load and cron jobs run them from their new locations.

I've not tested this on a set-up from scratch - so next time the patch is applied and an ISO built these changes will need testing.

Running these updated scripts manually should get us a store with the required data in for testing the API.