search

aws-samples / schedule-sagemaker-data-wrangler-flow

MIT No Attribution
1 stars 1 forks source link

Lambda Time limit exceed #1

Open Prakash059 opened 2 years ago

Prakash059 commented 2 years ago

Hey Team,

If my wrangler flow job take 30mins for processing, and scheduling the job in lambda. How to handle time limit exceed error in lambda? Since, Lambda execution time limit is 15mins.

chenliu0831 commented 2 years ago

Hi Prakash,

One way I can think of is to wrap the code here as ECS Fargate task and use CloudWatch rules to trigger it. We are working on first party support on scheduling flow files, I can report back when it's ready.