Question: How are non-TOR crawlers used in ail-framework

ail-project / ail-splash-manager

Deprecated: AIL crawler has been upgraded to https://github.com/ail-project/lacus

GNU General Public License v3.0

4 stars 2 forks source link

Question: How are non-TOR crawlers used in ail-framework #2

Closed certrik closed 1 year ago

certrik commented 4 years ago

Hi @Terrtia , regarding the possibility to also configure crawlers to connect via http proxy. How does the ail-framework know which crawlers on which port can be used for non-TOR connections? Does it need a special configuration in /ail-framework/configs/core.cfg under ``` [Crawler] activate_crawler = True crawler_depth_limit = 1 ...

Terrtia commented 1 year ago

AIL crawler has been upgraded to Lacus Lacus use the default address IP or a proxy if provided in the UI.