thp / urlwatch

Watch (parts of) webpages and get notified when something changes via e-mail, on your phone or via other means. Highly configurable.
https://thp.io/2008/urlwatch/
Other
2.81k stars 352 forks source link

Best practice for a bunch of keywords for several urls #770

Open Hans-Maulwurf opened 10 months ago

Hans-Maulwurf commented 10 months ago

Hello, I need some hints, how to realize my workflow. I want to check multiple sites (shops) for changes when searching keywords (products). In general, I would use an array of keywords and loop through it and make requests to each site/shop with placeholders in the url for the searched keyword. Something like [shop1.com?search={{product}}, shop2.com?productsearch={{product}}] and [productname1, productname2]

In my workflow-idea, I want to maintain these two objects, maybe in seperate files, and then led urlmagic do it's magic. Is it possible to do this with hooks? Is a hook able to edit the url before doing the real request? Or is a hook able to edit the list of urls that watches urlwatch?

thp commented 10 months ago

The best way would be to use some template language outside of urlwatch and then let it generate the urls.yaml file from that template. This sounds like a very involved workflow that's probably best served with outside tooling on top of urlwatch.