Issues Crawling Youtube Shorts link because of cookies consent banner.

hoarder-app / hoarder

A self-hostable bookmark-everything app (links, notes and images) with AI-based automatic tagging and full text search

GNU Affero General Public License v3.0

6.34k stars 226 forks source link

Describe the Bug

The crawler is unable to properly scrape YouTube Shorts links due to the cookie consent banner that appears for EU/EEA users. This banner blocks access to the content and prevents successful crawling of Shorts videos.

Steps to Reproduce

Cookie consent popup appears when accessing YouTube Shorts links
Crawler cannot bypass or handle the consent banner
Content behind the banner is inaccessible
Crawling returns inaccurate metadata

Expected Behaviour

Tag Generation based on the youtube title

Screenshots or Additional Context

Device Details

No response

Exact Hoarder Version

v19