awslabs / benchmark-ai

Anubis (formerly known as Benchmark AI), measures the goodness of machine learning workloads
Apache License 2.0
16 stars 6 forks source link

Is there a definitive FAIL / SUCCEED event status? #1035

Open gavinmbell opened 3 years ago

gavinmbell commented 3 years ago

It would be good to have a definitive FAIL/SUCCEED status for Actions. This way they can be more directly tested against to inform end user.. One case for this is the use of --terminate (with --watch) We are looking at the status event message string. There can be a tighter contract than that.

ryansteakley commented 3 years ago

There is a definitive fail status. However there the succeed status will appear multiple times throughout the run as different steps complete ie(initialization, submission, running).