search

thp / urlwatch

Watch (parts of) webpages and get notified when something changes via e-mail, on your phone or via other means. Highly configurable.
https://thp.io/2008/urlwatch/
Other
2.82k stars 352 forks source link

Run Jobs In Parallel? #648

Closed elliottback closed 2 years ago

elliottback commented 3 years ago

From the log output when running with --verbose, it seems that the jobs in my configuration (a bunch of URL jobs) all run sequentially. It would be nice to schedule them in parallel, as it takes around 60s for a cycle.

thp commented 2 years ago

It's already running the jobs in parallel (up to 10 workers). There are some cases (e.g. navigate jobs i think) that cannot run in parallel (yet).

elliottback commented 2 years ago

Thanks! It would be nice to stick this into the documentation or config, if not there already. Apologies if I missed it.