autonomio / talos

Hyperparameter Experiments with TensorFlow and Keras
https://autonom.io
MIT License
1.62k stars 270 forks source link

we have implemented autodl using talos. #493

Closed nandinimatam closed 3 years ago

nandinimatam commented 4 years ago

we have developed the autodl using talos , problem is that , best_modelSNN = scan_object.best_model(metric='val_acc', asc=True), not sure how it is returning the best model

Not sure but it seems like it will pick lessor accuracy model rather than higher accuracy model. please can you give me the explaination how it is giving best model i mean based on what it is giving best model.

mikkokotila commented 3 years ago

Sorry for late reply.

It is based on a two-stepped process, where first during Scan() it will score each permutation. Then it will take n best models based on that, and use a validation metric to do k-fold and find "best" model.