search

dgtlmoon / changedetection.io

The best and simplest free open source web page change detection, website watcher, restock monitor and notification service. Restock Monitor, change detection. Designed for simplicity - Simply monitor which websites had a text change for free. Free Open source web page change detection, Website defacement monitoring, Price change notification
https://changedetection.io
Apache License 2.0
16.69k stars 924 forks source link

[feature] Increase number of browser steps for more complicated websites #2057

Open D4Ci0 opened 8 months ago

D4Ci0 commented 8 months ago

Hi,

is there any possibility to increase the number of browser steps for a search? Currently maxed out at 10 steps.

dgtlmoon commented 8 months ago

https://github.com/dgtlmoon/changedetection.io/blob/3d1e1025d2eea3085c6247d6b88905ffe7b84a40/docker-compose.yml#L52

right here for now

D4Ci0 commented 8 months ago

https://github.com/dgtlmoon/changedetection.io/blob/3d1e1025d2eea3085c6247d6b88905ffe7b84a40/docker-compose.yml#L52

right here for now

Thanks for the reply. I added this variable to the docker container and selected a value of 20. Still, in the Changedetection.io UI I can only select up to 10 browser steps.

Somehow this did not help, see:

max_steps

with: FETCH_WORKERS=20

dgtlmoon commented 8 months ago

aaah my mistake, sorry misunderstood your request

s1lverkin commented 7 months ago

Are there any plans to implement that? :)

quarkw commented 5 months ago

Someone has a fork that bumps the limit from 10 -> 30

https://github.com/CSDTs/changedetection.io/commit/69b9bc7b906763530a27288c8610a40b744a62c7

An acceptable PR would probably require something in the UI to be able to add more steps, but maybe this commit is acceptable enough of a stop-gap

5punk commented 1 month ago

Are there plans to update this limit for more complex flows? It doesn't have to be pretty or even enabled via UI (if a config import can help bypass that limit, that'd work)