Closed Deathn0t closed 11 months ago
DTLZ (10 random seeds each for a fixed number of evaluations):
HPOBench (10 random seeds for each, fixed number of evaluations, 2-objectives: valid-rmse, training time):
JAHS-Bench (5 seeds for each, 3-objectives: valid-acc, latency, an size_MB, 3 datasets: Cifar10, Colorectal, Fashion-Mnist, 8 + 1 hyperparameters):
ECP-Candle/Pilot1/Combo:
PINNBench/DiffusionReaction:
Continuous Benchmark Functions
DTLZ (10 random seeds each for a fixed number of evaluations):
Hyperparameter Optimization Benchmarks
Community Benchmarks
HPOBench (10 random seeds for each, fixed number of evaluations, 2-objectives: valid-rmse, training time):
JAHS-Bench (5 seeds for each, 3-objectives: valid-acc, latency, an size_MB, 3 datasets: Cifar10, Colorectal, Fashion-Mnist, 8 + 1 hyperparameters):
Custom Benchmarks
ECP-Candle/Pilot1/Combo:
PINNBench/DiffusionReaction: