search

crawler-commons / url-frontier

API definition, resources and reference implementation of URL Frontiers
Apache License 2.0
44 stars 11 forks source link

Use multiple threads for putting URLs #65

Closed jnioche closed 1 year ago

jnioche commented 1 year ago

See discussion in #63 Results in up to 54% performance improvement