crwlrsoft / crawler

Library for Rapid (Web) Crawler and Scraper Development
https://www.crwlr.software/packages/crawler
MIT License
312 stars 11 forks source link

Allow further headless chrome configuration #144

Closed otsch closed 1 month ago

otsch commented 1 month ago

New methods HeadlessBrowserLoaderHelper::setTimeout() and HeadlessBrowserLoaderHelper::waitForNavigationEvent() to allow defining the timeout for the headless chrome in milliseconds (default 30000 = 30 seconds) and the navigation event (load (default), DOMContentLoaded, firstMeaningfulPaint, networkIdle, etc.) to wait for when loading a URL.