search

minotar / imgd

Minotar is a global avatar service that pulls your head off of your Minecraft.net skin, and allows it for use on several thousand sites.
https://minotar.net/
The Unlicense
203 stars 62 forks source link

Loading skin not work #202

Closed Incluuu closed 3 years ago

Incluuu commented 3 years ago

Hi, loading skin not work: https://minotar.net/avatar/player

Error 503 Backend fetch failed Backend fetch failed

Guru Meditation: XID: 485342

Varnish cache server

devinorman7 commented 3 years ago

Having the same issue

narwhql commented 3 years ago

Same

ableitung commented 3 years ago

Looks like it works now but all avatars are steves. Server might be down.

LukeHandle commented 3 years ago

Hi all, it looks like one of the cache Redis services crashed, but didn't fully stop (which would have triggered a restart of it).

This caused the imgd backend services to start failing, timing out and exhausting their file limits and failing heath checks, thus the Varnish 503 is returned immediately.

It's certainly weird this is the first time we've seen this issue, and the Redis has been running fine for year+.

We merged new code into the repo yesterday - but none of that was deployed yesterday. It had been live since August 2018, so I can't seem them as directly linked.

The crashed Redis cache means the we are now having to re-populate a lot of the Session Profile data and that will now trigger us to see lots of Steve skins until things settle down. I'll keep an eye on things in the meantime.

LukeHandle commented 3 years ago

To confirm, error rates have dropped back down to normal levels. Existing badly cached skins will remain Steve for the moment though