Open certrik opened 4 years ago
Maybe the shared configuration of the proxies from new ail splash manager for the next version of AIL could be used with pystemon. Can I ask which version of pystemon do you use (from which repo)?
Hi @adulau Using v3.2 from /ail-project/ail-framework .
Sorry I meant the pystemon version and from which repo.
Ah sorry. The latest version from https://github.com/cvandeplas/pystemon . Which works quite nicely. Only problem is setting the proxy.
Would be great if it was possible to configure a proxy for pystemon on system level via e.g.
http_proxy=http://proxy.domain.tld:8080
andhttps_proxy=http://proxy.domain.tld:8080
. Because even if using the most current repo of pystemon where you can define a list of proxies to use in the pystemon config it doesnt seem to work very well. If configuring a proxy systemwide the splash crawler fails. So probably it is possible to have some variable read from thecore.cfg
and put in front of the feeder launcher script inLAUNCH.sh
. A proxy could be neccesary if using pastebin pro account tied to a special external IP. Would be a great and useful addtion, also for companies where pastesites are blocked and are allowed using a certain proxy.