search

c4software / python-sitemap

Mini website crawler to make sitemap from a website.
GNU General Public License v3.0
362 stars 110 forks source link

Endless loop fix #34

Closed ghost closed 7 years ago

ghost commented 7 years ago

Command python3 ~/sitemap/python-sitemap-master/main.py --domain https://www.forum.2globalnomads.info --image --output sitemap.xml --verbose

c4software commented 7 years ago

Its due to sid, you have to « drop » : 

python3 main.py --domain https://www.forum.2globalnomads.info --image --verbose --drop "sid=[a-z0-9]{32}"