search

awslabs / service-workbench-on-aws

A platform that provides researchers with one-click access to collaborative workspace environments operating across teams, universities, and datasets while enabling university IT stakeholders to manage, monitor, and control spending, apply security best practices, and comply with corporate governance.
Apache License 2.0
178 stars 119 forks source link

[Feature] Support EMR workspace type auto-stop functionality #700

Open aGutierrezSacristan opened 2 years ago

aGutierrezSacristan commented 2 years ago

Describe the bug When creating a EMR workspace, if not stopping it manually, it is not auto-stop.

To Reproduce Steps to reproduce the behavior:

  1. Go to 'workspaces'
  2. Click on 'create research workspace'
  3. Select 'EMR-v1'
  4. Select any configuration
  5. Start the workspace

The workspace will not be stopped automatically, needs to be stopped manually.

Expected behavior That as in the SageMaker workspaces types, the EMR auto-stop idle-time.

Versions (please complete the following information):

jol-ster commented 2 years ago

Thank you for the feedback - the Auto Stop function currently only applies to the Sagemaker and RStudio workspace types

For Sagemaker:
When the workspace type is configured, there is an "AutoStopIdleTimeInMinutes" setting that the administrator can set that drives the Auto Stop interval

For RStudio: The RStudio Auto Stop setting is baked into the AMI. By default it is set to 1 hour, if the user wants to change this they can do so in the main/solution/machine-images/config/infra/files/rstudio/check-idle file and recreate their RStudio AMI. More info here

To introduce Auto Stop for EMR would be a new feature - and I'm very interested to hear your anticipated use case (type of workload, frequency). I'd also appreciate your input around what you would want to drive the Auto Stop functionality (inactivity, time passed, or some combination). I'm changing this label from a bug to a feature request.

aGutierrezSacristan commented 2 years ago

Got it. Thank you so much for the information. For the EMR workspace, the AutoStop functionality based on X time of inactivity would be really useful. I am not sure about the time passed one, I do not have a use case in mind yet for this.