FriendsOfPHP / Goutte

Goutte, a simple PHP Web Scraper
MIT License
9.26k stars 1.01k forks source link

How to crawl the dynamic pages like single page applications #350

Open ardnor opened 6 years ago

ardnor commented 6 years ago

Hello, how to get the dynamic page which uses angular and another related javascript frameworks.

Thanks,

Ronard

hexus commented 6 years ago

Goutte isn't built for this. You'd need a browser environment in order to run the JavaScript, which Goutte definitely doesn't do; it simply retrieves and processes HTML.

gtjamesa commented 6 years ago

Maybe give https://github.com/jonnnnyw/php-phantomjs a try, it's a headless webkit browser