GoogleCloudPlatform / cloudml-samples

Cloud ML Engine repo. Please visit the new Vertex AI samples repo at https://github.com/GoogleCloudPlatform/vertex-ai-samples
https://cloud.google.com/ai-platform/docs/
Apache License 2.0
1.52k stars 857 forks source link

epoch_acc not defined in census tf-keras example? #459

Closed caseyjconger closed 4 years ago

caseyjconger commented 4 years ago

I think there may be an issue with cloudml-samples/census/tf-keras/hptuning_config.yaml. It seems like the target metric is set to be epoch_acc but epoch_acc isn't defined anywhere in the code. Should this just be 'accuracy' as that's the metric defined in the model?

andrewferlitsch commented 4 years ago

@dizcology PTAL

gogasca commented 4 years ago

@caseyjconger for Hyper parameter tuning we use the TensorBoard callback. https://www.tensorflow.org/api_docs/python/tf/keras/callbacks/TensorBoard what happens is that this callback returns a summary name of epoch_ because of this: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/keras/callbacks.py#L2084 You may need to create custom callbacks and it summary operation to use other names.

gogasca commented 4 years ago

Updated sample, please take a look here.