search

crawler-commons / url-frontier

API definition, resources and reference implementation of URL Frontiers
Apache License 2.0
44 stars 11 forks source link

Batch write operations #64

Closed jnioche closed 2 years ago

jnioche commented 2 years ago

This will limit the risk of having discrepancies between the status and the schedule tables e.g. when the service is being stopped or crashes.