skrapeit / skrape.it

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
https://docs.skrape.it
MIT License
815 stars 61 forks source link

[FEATURE] client implementation improvements #105

Open christian-draeger opened 4 years ago

christian-draeger commented 4 years ago

Try to optimise the existing implementations of custom clients. Maybe distinguish between client-global configurations (sslRelaxed, proxy) and per-request information (url, http verb, etc.). This way, we don't have to spin up a new client per each request.