damoeb / rss-proxy

RSS-proxy allows you to do create an RSS or ATOM feed of almost any website, just by analyzing just the static HTML structure.
https://rssproxy.migor.org
1.72k stars 109 forks source link

support for browserless? #51

Open Colin-XKL opened 1 year ago

Colin-XKL commented 1 year ago

Suggestion: There's a popular headless browser project Browserless, it is very simple to use, maintaining independent puppeteer docker image maybe painful sometime, browserless is a good choice : )

Puppeteer allows you to specify a remote location for chrome via the browserWSEndpoint option. Setting this for browserless is a single line of code change.

Before

const browser = await puppeteer.launch();

After

const browser = await puppeteer.connect({ browserWSEndpoint: 'ws://localhost:3000' });

Docker Image home page

damoeb commented 1 year ago

The problem with prerendering (=browserless) are timeouts. One option would be to pass markup from browserless in the request, but then it would need to be via post and not get, which makes is less accessible. It could add a browserless option to feedless though