Output referrer to help diagnose crawl errors

cloudfour / lighthouse-parade

A Node.js command line tool that crawls a domain and gathers lighthouse performance data for every page.

MIT License

362 stars 14 forks source link

Output referrer to help diagnose crawl errors #126

Closed exortech closed 1 year ago

exortech commented 1 year ago

Simplecrawler does find and attempt to crawl a lot of invalid uris - especially in script tags. However, it does occasionally find useful broken links. The current output of lighthouse-parade makes it difficult to determine which page contains the broken link. Including the referrer (the page where the broken link was discovered) makes it much easier to identify where the broken link is.

emilienbidet commented 1 year ago

Maybe linked to #131

calebeby commented 1 year ago

Closing since https://github.com/cloudfour/lighthouse-parade/pull/128 was merged