AngleSharp / AngleSharp.Js

:angel: Extends AngleSharp with a .NET-based JavaScript engine.
https://anglesharp.github.io
MIT License
105 stars 23 forks source link

Executing JavaScript? #62

Closed derekantrican closed 4 years ago

derekantrican commented 5 years ago

Just a question - I can't seem to find any recent information on this so I'm just going to ask here. Please let me know if there is a better place for my question.

Is it possible to execute JavaScript on a page? For my use case, I am parsing data from urls like this: https://www.mountainproject.com/search?q=y-crack . That search page provides a "snippet" of the results and you need to click "See all 67 routes" in order to view all of them (and sometimes also click the "Load More" button on the bottom of the next page).

Both of these buttons trigger JavaScript to load in the other results. Is it possible to trigger these with AngleSharp so that all the results can be scrapped?

FlorianRappl commented 5 years ago

Not sure I can follow - what have you tried so far?

There are multiple questions on this on StackOverflow and a recent one in this repo, see #60. Does that help?