search

philippta / flyscrape

Flyscrape is a command-line web scraping tool designed for those without advanced programming skills.
https://flyscrape.com
Mozilla Public License 2.0
1.04k stars 31 forks source link

Browser rendering #46

Closed philippta closed 7 months ago

philippta commented 8 months ago

Support browser rendering using the go-rod package. It supports automatic download of chromium. The local browser installation should be left untouched as it would have bad UC implications (having to close it in order to open the debugging port). HTTP downloads should not go though browser rendering. The cookies module will give the isolated chromium instance access to active user sessions. This would even work if the user only ever used Firefox or edge (and chrome ofc).

Browser rendering can be enabled via the config:

export const config = {
  browser: true,
  headless: false, // default: true
}