skrapeit / skrape.it

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
https://docs.skrape.it
MIT License
813 stars 59 forks source link

How to set jsExecution = true for BrowserFetcher #235

Closed sampatsharma143 closed 10 months ago

sampatsharma143 commented 1 year ago

I am using scrapeit in a android app , and i want to scrape a CSR website , but after using the BrowserFetcher i am not able to get the html content it's just javascript urls , after checking the code i find out that i will have to set the jsExecution = true but i am not able to do that . please share an example of this

christian-draeger commented 12 months ago

should work as described here: https://github.com/skrapeit/skrape.it#scrape-a-client-side-rendered-page using version 1.3.0-alpha.1