We have been using AIL framework for some time now.
Is there a possibility to clear or delete the queue of the crawler?
If not, this would be a great feature!
After a while, my queue ends up being very big. Sometimes filled with non-existing onion domains.
Hi all,
We have been using AIL framework for some time now. Is there a possibility to clear or delete the queue of the crawler? If not, this would be a great feature!
After a while, my queue ends up being very big. Sometimes filled with non-existing onion domains.
Thanks in advance!