bacalhau-project / bacalhau

Compute over Data framework for public, transparent, and optionally verifiable computation
https://docs.bacalhau.org
Apache License 2.0
643 stars 85 forks source link

feature: pre and post job execution hooks #3187

Open alabdao opened 6 months ago

alabdao commented 6 months ago

this would be useful for when there's need to perform setup at before execution of a job and cleanup post execution.

simonwo commented 6 months ago

Thanks for the request @alabdao. Can you say more about what you'd like these hooks to do? I.e. to help us figure things out like: do they need to run at the same compute node that's executing the job?

alabdao commented 6 months ago

I'm thinking of using this to protect node from scale in as part of pre execution and remove protection post execution https://docs.aws.amazon.com/autoscaling/ec2/userguide/ec2-auto-scaling-instance-protection.html