antoinefalisse
commented
5 months ago @sashasimkin and @suhlrich could you take a look at this? I added the boto3 scripts and adjusted a couple of things.
- I am not sure this is what we want here. I understand that if the number of trials is under a certain threshold (like the number of on-prem workers times a number of trials per worker) then we want to remove the scale-in protection. I think this is what this will do, is that what you had in mind?
- I don't think this will ever be triggered, except if we don't use on-prem workers (and we want this to work). But the idea here is to remove the scale-in protection if the instance hasn't processed a trial for more than x minutes and if there aren't trials being recorded.
This closes #113 .
TODO AWS CLI 1) Get machine ID 2) send shutdown message
turn off backend machine after 5 mins of no trial and there is nothing recording