spatie / crawler

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.
https://freek.dev/308-building-a-crawler-in-php
MIT License
2.51k stars 357 forks source link

Follow all redirects, including HTML meta and Javascript #422

Closed rzb closed 2 years ago

rzb commented 2 years ago

I need to report the whole redirect chain (HTTP, meta refresh and javascript) in the same order that a human user would experience. I see that you use a headless browser to execute js, so is it something this package can do?