bbcarchdev / anansi

A Linked Open Data Web crawler
https://bbcarchdev.github.io/anansi/
Apache License 2.0
0 stars 0 forks source link

Allow partitioning of the cluster based upon newness #66

Open nevali opened 8 years ago

nevali commented 8 years ago

Subsequent to #65, it would be desirable to allow an administrator to dedicate a partition of a cluster to refreshing existing resources while the remainder is used to fetch new resources (or vice versa)