Open llrs opened 4 years ago
Another relevant manuscript: https://projecteuclid.org/journals/bayesian-analysis/advance-publication/Bayesian-Experimental-Design-Without-Posterior-Calculations-An-Adversarial-Approach/10.1214/22-BA1306.full
With relevant code here (not a package) and in python most of it
Check this paper: Batch Effect Confounding Leads to Strong Bias in Performance Estimates Obtained by Cross-Validation (PMC4072626) that measures how bad batch effects are. Perhaps the same simulations could be used to show how to avoid them. code