exclude special pages from crawling

b13 / warmup

Warms up some TYPO3 caches via CLI

GNU General Public License v2.0

11 stars 6 forks source link

exclude special pages from crawling #2

Closed tgaertner closed 4 years ago

tgaertner commented 4 years ago

exclude folders, shortcuts, mountpoints, aso.

bmack commented 4 years ago

We have a lot of projects with multiple doktypes, which would crash. I would recommend switching to a exclude list. exclude spacers, shortcuts, external URLs, mountpoints, folders etc. - everything else is allowed.

Could you update your patch accordingly?

tgaertner commented 4 years ago

Hopefully I covered everything important.