bluesky-social / social-app

The Bluesky Social application for Web, iOS, and Android
https://bsky.app
MIT License
11.07k stars 1.4k forks source link

Display of Chinese characters in link card #1148

Open mschwendener opened 1 year ago

mschwendener commented 1 year ago

Describe the bug

In the link card, Chinese characters turn into random symbols

To Reproduce

https://bsky.app/profile/yilinwriter.bsky.social/post/3k4kioo3z2j2q

Expected behavior

Readable display

Came across this by coincidence

alimony commented 1 year ago

It's something about the cardyb service and charsets, I think. Here's the fetch for the above post:

https://cardyb.bsky.app/v1/extract?url=http://www.mingpaocanada.com/van/htm/News/20230809/vas1h_r.htm

The page uses charset "big5-hkscs".

Here are two other fetches for sites with Chinese characters:

https://cardyb.bsky.app/v1/extract?url=https://world.taobao.com/ (uses utf8) https://cardyb.bsky.app/v1/extract?url=https://www.thepaper.cn/ (uses utf8)

pfrazee commented 1 year ago

@Jacob2161 looks like this is a cardyb issue