crawler-commons / url-frontier

API definition, resources and reference implementation of URL Frontiers
Apache License 2.0
44 stars 11 forks source link

Ability to set URL limit for specific domain #91

Closed zaibacu closed 1 month ago

zaibacu commented 1 month ago

Implementation of Feature request: https://github.com/crawler-commons/url-frontier/issues/90

jnioche commented 1 month ago

thanks @zaibacu