search

junyanz / pytorch-CycleGAN-and-pix2pix

Image-to-Image Translation in PyTorch
Other
22.83k stars 6.29k forks source link

Evaluation on own datasets #716

Open Mayankjha1535 opened 5 years ago

Mayankjha1535 commented 5 years ago

How to evaluate on our own datasets ?

junyanz commented 5 years ago

The evaluation depends on your specific task and application. There is no single metric that works for all the datasets and tasks.

Mayankjha1535 commented 5 years ago

Actually, I have trained the model on my own datasets and Day to night dataset. I want to evaluate it on Mean IOU, Mean pixel accuracy and Mean class accuracy. So, how to evaluate these on my datasets ?

junyanz commented 5 years ago

MeanIOU is only useful for the cityscape dataset and other segmentation datasets. It cannot be used in Day2night dataset. You need to design a new metric for your own dataset.

diaosiji commented 5 years ago

MeanIOU is only useful for the cityscape dataset and other segmentation datasets. It cannot be used in Day2night dataset. You need to design a new metric for your own dataset.

Yes, it depends on your specific task. You can find some paper in the area which your own data maybe related to, then you may find some metric，and could compare with Other one.