quant-aq / aeromancy

⚗️ Aeromancy: A framework for performing reproducible AI and ML
https://quant-aq.github.io/aeromancy/
Apache License 2.0
10 stars 1 forks source link

Support sweeps in W&B #28

Open dmcc opened 3 weeks ago

dmcc commented 3 weeks ago

Right now, sweeps are essentially done manually in Aeromancy. With https://github.com/quant-aq/aeromancy/issues/27 and some Aeromancy API updates, we could make sweeps better integrated in experiment trackers.

Proof of concept for retroactive sweep creation:

>>> sweep_id = wandb.sweep(project='...', sweep={'method': 'random', 'parameters': {'...': {'values': [1, 2, 3]}}}, prior_runs=['...'])

where prior_runs is a list of short run IDs (e.g., cmzbpa8q) -- not the full entity/project/cmzbpa8q path.