Add ecsshutdown command

mbari-org / deepsea-ai

DeepSea-AI is a Python package to simplify processing deep sea video in AWS https://aws.amazon.com from a command line.

http://docs.mbari.org/deepsea-ai/

Apache License 2.0

3 stars 1 forks source link

Add ecsshutdown command #34

Closed danellecline closed 6 months ago

danellecline commented 7 months ago

This is a new feature request to add a shutdown command to halt any data processed with the ecsprocess command. e.g.

deepsea-ai ecsshutdown -u \
        --job "DocRicketts 2021/08 with benthic model" \
        --cluster benthic33k

Tasks

[x] Purge SQS VIDEO_QUEUE queue to halt any autoscaling
[x] Forced shutdown of any running ECS tasks
[x] Remove any completed video tracks from S3 as queued in the TRACK_QUEUE
[x] Update job status in sqlite

danellecline commented 7 months ago

Forcing a shutdown of EC2 may require disabling autoscaling for a period to accomplish clean shutdown. See reference: AWS docs as-suspend-resume-processes