search

mbari-org / deepsea-ai

DeepSea-AI is a Python package to simplify processing deep sea video in AWS https://aws.amazon.com from a command line.
http://docs.mbari.org/deepsea-ai/
Apache License 2.0
3 stars 1 forks source link

Increase storage for 1280 YV5 model in ECS processing workflow #32

Closed danellecline closed 9 months ago

danellecline commented 9 months ago

Getting errors when processing prores video in ECS stack with larger 1280 model.

Waiting for M3/master/Ventana/2022/04/4394/V4394_20220427T184055Z_prores.mov to become available [Errno 28] No space left on device
danellecline commented 9 months ago

The current stack volume size is set to 10GB per the ecs_task_autoscaling

and a single prores is 51GB

ls -lh /mnt/M3/master/Ventana/2022/04/4394/V4394_20220427T184055Z_prores.mov                                     (base)
-rwx------ 1 root root 51G Apr 29  2022 /mnt/M3/master/Ventana/2022/04/4394/V4394_20220427T184055Z_prores.mov*
danellecline commented 9 months ago

Fixed with this commit.