search

mgalas / OpenDataHub

Master repository for all the open source projects driven by UDL
GNU General Public License v3.0
3 stars 4 forks source link

CRON + Python script to automate weekly harvesting sessions #9

Open mgalas opened 7 years ago

mgalas commented 7 years ago

Configure CRON to run a Python script that spawn individual daemon processes to harvest data-sources on a weekly basis - data sources are defined in (https://github.com/mgalas/Landscape4Data/issues/5)

metaljovi commented 7 years ago

already make a CRON script to begin harvesting for a given interval. For the background process, I use supervisor not daemon since it is easier to integrate with CKAN