search

spatie / crawler

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.
https://freek.dev/308-building-a-crawler-in-php
MIT License
2.51k stars 357 forks source link

Browsershot timeout unhandled #387

Closed MichaelNino closed 2 years ago

MichaelNino commented 2 years ago

Is there a configuration option to ignore timeouts, increase timeout or to allow crawler to continue from PHP?

Error Output:
================
TimeoutError: Navigation timeout of 30000 ms exceeded
    at C:\Users\launc\Projects\StructuredDataCrawler\server\node_modules\puppeteer\lib\cjs\puppeteer\common\LifecycleWatcher.js:106:111

  at C:\Users\launc\Projects\StructuredDataCrawler\server\vendor\spatie\browsershot\src\Browsershot.php:813
    809▕         if ($process->getExitCode() === 2) {
    810▕             throw new ElementNotFound($this->additionalOptions['selector']);
    811▕         }
    812▕
  ➜ 813▕         throw new ProcessFailedException($process);
    814▕     }
    815▕
    816▕     protected function getFullCommand(array $command)
    817▕     {
spatie-bot commented 2 years ago

Dear contributor,

because this issue seems to be inactive for quite some time now, I've automatically closed it. If you feel this issue deserves some attention from my human colleagues feel free to reopen it.