EdJoPaTo / website-stalker

Track changes on websites via git
GNU Lesser General Public License v2.1
59 stars 6 forks source link

Detect Redirects and hint better / new urls to reduce traffic #21

Closed EdJoPaTo closed 3 years ago

EdJoPaTo commented 3 years ago

Is your feature request related to a problem? Please describe.

Websites switch domains or rearrange stuff. Sometimes its just edjopato.de/post → edjopato.de/post/ This redirect happens every time the content is grabbed which results in unneccesary traffic.

Describe the solution you'd like

The website-stalker should print out warnings which url should be improved (add / at the end for example).