DevoLearn / devolearn

Accelerate data driven research on embryos with deep learning models :microscope:
MIT License
43 stars 31 forks source link

tests: unit tests do not check the outputs of models #53

Open Mayukhdeb opened 3 years ago

Mayukhdeb commented 3 years ago

While the unit tests do cover the output types, they do not check if the outputs themselves are correct/incorrect.

To do:

vrutikrabadia commented 3 years ago

Hello @Mayukhdeb, for the lineage population model we can calculate loss from the ground truth population labels from the CSV. But, I don't understand how can we test the output of the segmentation model. One way I think could be running the model on the same image multiple times and calculating the mutual loss between them. If that would be helpful, I wish to work on the issue.

Mayukhdeb commented 3 years ago

Hi @vrutikrabadia.

For the segmentation model, I plan to execute the testing procedure by saving a few .npy files which would then be compared with the predictions with np.allclose().