awslabs / benchmark-ai

Anubis (formerly known as Benchmark AI), measures the goodness of machine learning workloads
Apache License 2.0
16 stars 6 forks source link

change: make task_name mandatory for labels #1020

Closed surajkota closed 4 years ago

surajkota commented 4 years ago

Issue #1015

Description of changes:

Testing: Used pipeline to run a benchmark job for positive and negative inputs Also used Json validator tools online to verify the changes to the schema

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

jlcontreras commented 4 years ago

Left two comments, one of them is a nit, but the other one would be a nice addition, since the system breaks if custom labels don't fill that condition