mdamien / chrome-extensions-archive

:pager: Archive all the chrome extensions (until Feb 4. 2019)
https://crx.dam.io
MIT License
386 stars 70 forks source link

Monitor data ingestion #19

Open mdamien opened 8 years ago

mdamien commented 8 years ago

import can sometimes stall for random reasons (ssl handshake never timeout, stuck in some infinite loop, everything is crashing and the world is burning).

I should monitor that a full cycle is done everyday (download extensions + update website).

PS: timeout the stuff too, https://stackoverflow.com/questions/2281850/timeout-function-if-it-takes-too-long-to-finish