WebCrawler: Handle redirects manually - Githubissues

enonic / app-explorer

Other

1 stars 3 forks source link

WebCrawler: Handle redirects manually #915

Open ComLock opened 8 months ago

ComLock commented 8 months ago

[ ] Set followRedirects to false
[ ] Keep a list of visited redirects
[ ] Avoid revisiting redirects
[ ] Don't follow redirects outside domain, or inside excluded paths
[ ] Store document on final url