maho3 / ltu-ili

Robust ML in Astro
https://ltu-ili.readthedocs.io/en/latest/
43 stars 8 forks source link

Setup dataloaders to sample new simulations #37

Closed maho3 closed 1 year ago

maho3 commented 1 year ago

Our current dataloaders only load summaries and parameters from existing storage. However, if we want to do active learning, we want to be able to sample from our data loaders at specific cosmologies dictated by our training procedure. Then, later, we can integrate these dataloaders with our forward modeling methods, e.g. BORG-PM, pmwd, and AFM methods.

The goal here is to build a dataloader which acts similarly to our existing dataloaders, except that it can also sample new data points from an external simulator.

A good place to start would be building a simulator-dataloader for our toy example in example_inference.py.

maho3 commented 1 year ago

If this works, it would also be cool to try connecting that with sbi's active sampler.