mr-niels-christensen / environment-scotland-dot-rural

Apache License 2.0
0 stars 1 forks source link

Avoid blocking harvest with task that times out #57

Closed mr-niels-christensen closed 9 years ago

mr-niels-christensen commented 9 years ago

Sometimes a task (typically 2008 papers from UofA) may run longer than 10 minutes. This causes the tasks to be killed and retried later. The current version always tries the same task again on the next invocation, which is not good, because other tasks do not get scheduled if the problem continues.