invrs-io / leaderboard

Database of solutions to inverse design challenges
https://invrs-io.github.io/leaderboard/
MIT License
7 stars 0 forks source link

Ensuring solutions are not "overfit" #8

Open mfschubert opened 2 months ago

mfschubert commented 2 months ago

It may happen that the simulation for a solution is not converged, which could lead to evaluation metrics which are artificially good. Already, we force evaluation metrics to be computed using 64-bit mode. Should other steps be taken? E.g. compute eval metrics for more wavelengths, or with different simulation settings?