search

reanahub / reana

REANA: Reusable research data analysis platform
https://docs.reana.io
MIT License
127 stars 54 forks source link

kubernetes: assess performance impact of container creation and image pulling #247

Closed diegodelemos closed 4 years ago

diegodelemos commented 4 years ago

During the coming workshop, we will have around 30~ people using REANA. Potentially, in the afternoon session, each person will have different docker image to run.

This will trigger multiple Docker pulls and delay container creation. We should make sure this is not a problem regarding CPU (container creation) or network (image pulling).

tiborsimko commented 4 years ago

See also a somewhat related issue about allowing users to manipulate their image pulling policy https://github.com/reanahub/reana/issues/248

diegodelemos commented 4 years ago

Tested 30 BSM workflows, with top concurrent pod usage about ~260, no problems found, closing.