K1rakishou / Kuroba-Experimental

Free and open source image board browser
GNU General Public License v3.0
686 stars 40 forks source link

desuarchive.org media/thumbnail not loading due to separate domain/cloudflare #1072

Open asl97 opened 6 months ago

asl97 commented 6 months ago

desuarchive uses a seperate domain for user generated content which has their own cloudflare.

on browser, one would have to open a thumbnail or media before it would load on the site.

PS: on firefox, the site might seem like the thumbnail loading are broken, but it's just the ''enchanced tracking protection" blocking the thumbnail from loading.

Logs are flooding with error like the following

ThumbnailView: onResponseError() error: Url 'https://desu-usergeneratedcontent.xyz/desu/thumb/1691/87/16918769461852s.jpg' cannot be opened without going through Cloudflare checks first!
NormalFileCacheV2Thread-2]: Unknown exception, class = FirewallDetectedException, message = Url 'https://desu-usergeneratedcontent.xyz/desu/image/1691/87/16918769461852.jpg' cannot be opened without going through Cloudflare checks first!
E/(17:50:20.351) KurobaEx-fdroid | FileCacheV2: com.github.k1rakishou.common.FirewallDetectedException: Url 'https://desu-usergeneratedcontent.xyz/desu/image/1691/87/16918769461852.jpg' cannot be opened without going through Cloudflare checks first!

The cloudflare check refreshes quite frequently for the media domain (desu-usergeneratedcontent.xyz) on browser.


To clarify, thumbnails, images, videos are all not loading in app.

asl97 commented 6 months ago

enchancement? don't you mean bug?

I would think seeing the media isn't just a feature, instead the media not loading is a bug, since they load fine with sites other than desuarchive.

Screenshot_2024-05-09-05-34-51-327_com github k1rakishou chan fdroid Screenshot_2024-05-09-05-35-16-291_com github k1rakishou chan fdroid Screenshot_2024-05-09-05-35-21-312_com github k1rakishou chan fdroid-edit

K1rakishou commented 5 months ago

@asl97 What country are you from? I don't have any CloudFlare checks so I can't test it and can't implement it. I need to know your country so that I can try again with a VPN to trigger the CloudFlare checks.

asl97 commented 5 months ago

@K1rakishou It is mentioned in my profile, Singapore

Singapore has/had transparent proxy issue where a whole bunch of residential users connection goes through a proxy, result in sharing a small group of ip addresses which leads to some issue on some sites, the last time I encounter such an issue was years ago though.

Business which uses business plans might not be subjected to the same proxy issue so using a VPN hosted in Singapore might not trigger the checks.

https://forums.hardwarezone.com.sg/threads/transparent-proxy-questions-with-fibre.4913446/

If your VPN doesn't trigger the CloudFlare checks, you can probably try tor via something like orbot, tor has never fail to trigger a CloudFlare check on websites that uses CloudFlare, even if is painfully slow and a little finicky to get working.