search

philippta / flyscrape

Flyscrape is a command-line web scraping tool designed for those without advanced programming skills.
https://flyscrape.com
Mozilla Public License 2.0
1.02k stars 29 forks source link

Authentication? #4

Closed rothgar closed 10 months ago

rothgar commented 10 months ago

I may have missed it, but is there a way to query a URL with auth cookies or credentials?

philippta commented 10 months ago

There is an example demonstrating how you can login to a website before the scraping starts. It will store any cookie returned by the website for subsequent requests.

examples/hackernews_login.js

Setting a Bearer Token or HTTP Basic Auth is not yet supported.