Digital-Defiance / nlp-metaformer

An ablation study on the transformer network for Natural Language Processing
3 stars 0 forks source link

reduce container init time #20

Closed RuiFilipeCampos closed 8 months ago

RuiFilipeCampos commented 8 months ago
RuiFilipeCampos commented 8 months ago

https://eu-south-1.console.aws.amazon.com/imagebuilder/home?region=eu-south-1#/images/arn:aws:imagebuilder:eu-south-1:572089465582:image%2Fcreate-image%2F1.0.0%2F1/details/workflow

RuiFilipeCampos commented 8 months ago

ami-00e9a577171a99277 - waiting for availability

RuiFilipeCampos commented 8 months ago

2 minute saving only, I'm redoing the AMI so that it caches the images in their entirety

RuiFilipeCampos commented 8 months ago

the final bottleneck seems to be the creation of the containers

cannot optimize unless I change the configuration strategy

will have to stop after this AMI and schedule this task to be done when implementing the next experiment

RuiFilipeCampos commented 8 months ago

ami-0d95b58c016382e64 - waiting for availability

RuiFilipeCampos commented 8 months ago

I think 1m30s of container init is acceptable, there was a redis version mismatch, so those 30s might get cut too

I'm closing this