search

hoarder-app / hoarder

A self-hostable bookmark-everything app (links, notes and images) with AI-based automatic tagging and full text search
https://hoarder.app
GNU Affero General Public License v3.0
6.74k stars 245 forks source link

Cloudflare Captchas #344

Closed MRDGH2821 closed 3 months ago

MRDGH2821 commented 3 months ago

Ihave few URLs which use cloudflare captchas This makes the bookmark preview filled with captchas & AI tags being secruity related instead of the actual link. image

Links using Cloudflare's Captcha system: https://www.random.org/ https://tineye.com/

kamtschatka commented 3 months ago

This is definitely not an issue Hoarder will tackle. The whole point of this captcha is to prevent scraping. There is even a project that tries to prevent it: https://github.com/FlareSolverr/FlareSolverr And they are always struggling to make it work (currently broken AFAIK)

huyz commented 3 months ago

Wouldn't https://github.com/hoarder-app/hoarder/issues/172 tackle this issue?

MohamedBassem commented 3 months ago

Yeah, "crawling" a captcha protected website will most likely never work. The solution would be to capture the html from the extension directly as suggested in #172.

MohamedBassem commented 3 months ago

I'll close this in favor of #172