search

LMZimmer / Auto-PyTorch_refactor

Apache License 2.0
0 stars 2 forks source link

Add a check that makes sure each supported metric works #21

Closed franchuterivera closed 3 years ago

franchuterivera commented 3 years ago

Add a checker to make sure we create an instance of each metric object and make sure it is working. For example:

https://github.com/LMZimmer/Auto-PyTorch_refactor/blob/acc7eebe9641a995933c9243c1308b7e23b7ab08/autoPyTorch/pipeline/components/training/metrics/Accuracy.py#L22

Assumes that pytorch lighting has a pytorchlighting.classification.Accuracy object but it should be pytorch_lightning.metrics.classification.Accuracy

ravinkohli commented 3 years ago

Isn't this being done in test_metrics.py

ravinkohli commented 3 years ago

Isn't this being done in test_metrics.py

add a method for testing every metric and not just the supported metrics