search

arriven / db1000n

MIT License
1.18k stars 208 forks source link

Pass an URL to a proxy list using `proxy-path` flag #487

Closed Kashkovsky closed 2 years ago

Kashkovsky commented 2 years ago

Fixes #475

Type of change

How Has This Been Tested?

./db1000n -proxy-path https://raw.githubusercontent.com/porthole-ascend-cinnamon/proxy_scraper/main/proxies.txt
arriven commented 2 years ago

This particular approach is almost the same as downloading that proxylist, reformatting it with simple commandline and passing it directly into the command. Current approach re-downloads the proxylist each time the job is restarted (right now it's only when the config is updated but still)

What would be better is to provide template functions like split_lines and join_list (naming can be different, it's just first names that came to my head after 30 seconds of thinking) that would remove the need to escape those sequences