search

diux-dev / cluster

train on AWS
75 stars 15 forks source link

do logging onto EFS instead of EBS #29

Closed yaroslavvb closed 6 years ago

yaroslavvb commented 6 years ago

EFS provides 50-100MB/second at lowest tier, so should be enough for most logging.

Step 1: duplicate recording all important stuff to both EBS/EFS. Make sure timing didn't change Step 2: remove most EBS logging. This makes "snapshotting" a bit more useful since you are not carrying unneded logs around

cc @bearpelican

bearpelican commented 6 years ago

Fixed - https://github.com/diux-dev/cluster/pull/69