spatie / crawler

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.
https://freek.dev/308-building-a-crawler-in-php
MIT License
2.51k stars 357 forks source link

Laravel and Vapor #377

Closed Andrew-Hike closed 2 years ago

Andrew-Hike commented 2 years ago

Laravel Vapor uses alpine linux. which does not natively support pupeteer/browsershot

Please update the DOCUMENTATION for this package with either instructions to install pupeteer, or let people know that if you set enableJavascript() when initiating a crawl that laravel/vapor:php80 docker images will not work correctly, as alpine-linux does not have a stable chromium release that will work.

if you do enableJavacript()

You'll either get an error, or BrowserShot will return true and only crawl a single page.

JUST update DOCUMENTATION, to let peple know so they dont have to waste 2/3 days to find out nothing can fix this issue with laravel Vapor () its vapors fault for having an ali[pine based Docker image)

freekmurze commented 2 years ago

Feel free to send a PR to the docs.