Hi @Terrtia ,
regarding the possibility to also configure crawlers to connect via http proxy. How does the ail-framework know which crawlers on which port can be used for non-TOR connections? Does it need a special configuration in /ail-framework/configs/core.cfg under ```
[Crawler]
activate_crawler = True
crawler_depth_limit = 1
...
Hi @Terrtia , regarding the possibility to also configure crawlers to connect via http proxy. How does the ail-framework know which crawlers on which port can be used for non-TOR connections? Does it need a special configuration in
/ail-framework/configs/core.cfg
under ``` [Crawler] activate_crawler = True crawler_depth_limit = 1 ...