search

YourDataStories / harvesters

Harvesters acquire data from open data sources and the social Web.
GNU General Public License v3.0
1 stars 1 forks source link

Updates for OC Harvester #29

Closed vafopoulos closed 7 years ago

vafopoulos commented 7 years ago

It would be useful also here https://github.com/YourDataStories/harvesters/tree/master/Pilot2/OpenCorporatesHarvester to have a README file to state how it works and the underlying workflows. Also a first indication of performance statistics

Polymathronic commented 7 years ago

It's merely a script that fetches a list of URLs from the OC website. The processing time is <1s per URL. I provided simple instructions (the rest should be rather straight-forward).