google / nitroml

NitroML is a modular, portable, and scalable model-quality benchmarking framework for Machine Learning and Automated Machine Learning (AutoML) pipelines.
Apache License 2.0
41 stars 6 forks source link

MetaLearning Evaluation #38

Closed cweill closed 4 years ago

cweill commented 4 years ago

Extract Area under-Learning Curve (ALC) from Keras Tuner for evaluation.

The plot should show on the x axis trial_number and on the y axis the objective which will be the best AUC or Accuracy found so far. The plot should be monotonically increasing. Can be a Colab notebook or the Custom Tuner can spit out the plot.