prevent any query string URLs being crawled

elementor / static-html-output

Static HTML Output Plugin for WordPress

https://statichtmloutput.com

The Unlicense

124 stars 33 forks source link

prevent any query string URLs being crawled #100

Closed leonstafford closed 4 years ago

leonstafford commented 4 years ago

ie (Pending /?wp_block=untitled-reusable-block Note: initial_crawl_list) as discovered by @thegulshankumar

leonstafford commented 4 years ago

[ ] add extra assertions to HTML and CSS processor integration tests for the DetectedURLs they return for each test page

leonstafford commented 4 years ago

note the initial_crawl_list this was included in initial crawl list, HTML/CSS processors already do some checking/stripping of query strings when discovering URLs to crawl, so just need to adjust this in the generateInitialCrawlList area