bluesky-social / social-app

The Bluesky Social application for Web, iOS, and Android
https://bsky.app
MIT License
8.02k stars 1.04k forks source link

External link embeds don’t seem to handle unsuccessful responses when crawling #2572

Open mikeyclarke opened 7 months ago

mikeyclarke commented 7 months ago

Describe the bug

Screenshot 2024-01-18 at 09 06 00

It looks like the crawler that visits links in posts to collect information to generate link previews doesn’t check that the response is successful (or at least isn’t a 503) and so ends up using the error title.

I see this from time-to-time and as far as I can see it hasn’t been reported before. Example post. To the best of my recollection I’ve only ever seen this with Amazon links and it’s always a 503.

Expected behavior

The crawler should abort and retry later.

pfrazee commented 7 months ago

Lol that's bad, got it thanks