This PR adds the concept of crawlID to URLFrontier.
This gives it multi-tenancy as a Frontier instance will be able to handle multiple crawls, identified by a crawlID. A given URL is associated with a given crawl and any operation on a URL does not affect the same URL in other crawls.
This PR modifies the API and the implementation of the service is not compatible versions <= 1.0
This PR adds the concept of crawlID to URLFrontier.
This gives it multi-tenancy as a Frontier instance will be able to handle multiple crawls, identified by a crawlID. A given URL is associated with a given crawl and any operation on a URL does not affect the same URL in other crawls.
This PR modifies the API and the implementation of the service is not compatible versions <= 1.0