badges / shields

Concise, consistent, and legible badges in SVG and raster format
https://shields.io
Creative Commons Zero v1.0 Universal
23.41k stars 5.49k forks source link

Sudden change in server availability #665

Closed tonious closed 8 years ago

tonious commented 8 years ago
screen shot 2016-03-04 at 2 12 18 pm screen shot 2016-03-04 at 2 12 33 pm

According to pingdom, shields.io badge availability has drastically changed yesterday. Is there anything that can be done to bring stability back to what it was?

satazor commented 8 years ago

@tonious I'm experiencing this for 2 months now.. I hope this changes or I will be forced to change my badges :(

image

espadrine commented 8 years ago

Servers restarted. Sorry!

satazor commented 8 years ago

@espadrine the restart solved the problem temporarily, but the issue is happening again..

espadrine commented 8 years ago

A server had ran out of disk capacity because bower cache used 5Go. I killed the cache. I am still seeing timeouts from vendors; not sure why yet.

satazor commented 8 years ago

@espadrine did you took any measure to delete the bower cache often? Maybe a crontab that runs once a day? This would ensure that would never happen again.

satazor commented 8 years ago

Update: I'm seeing this now image

espadrine commented 8 years ago

OVH has just flagged the incoming traffic as a DDoS after I restarted the server. It should take 15min to go back to normal.

satazor commented 8 years ago

This will only solve the issue temporarly. What can be done to make this more stable?

espadrine commented 8 years ago

For starters, this event was definitely not ongoing for 2 months. What badge do you have issues with? Some vendors, such as Travis or GitHub, regularly block shields.io's IPs because the load is too large.

Beyond that, I am the only one that's doing the servers' sysadmin. What happens in my sleep cannot be fixed unless someone living at the opposite side of the earth wants to perform sysadmin for no pay.

satazor commented 8 years ago

I'm having issues with travis and coveralls badges. I understand the highload and we could implement strategies to throttle requests to thirdparty but it would require a restructure of how things are done technically. What I'm trying to say is that if we don't do nothing, shields.io will become useless.

tonious commented 8 years ago
screen shot 2016-03-05 at 9 04 47 pm

Looks like things have returned to normal.