astrodeepnet / sbi_experiments

Simulation Based Inference experiments
MIT License
3 stars 3 forks source link

Affine sigmoid bijector and mixtures of affine sigmoid #16

Closed EiffL closed 2 years ago

EiffL commented 2 years ago

This PR adds a bunch of things:

Annnnnd, finally we get flows that train by score matching \o/ (see notebook) image Can probably be further fine-tuned, but at least it shows that we get non-stupid gradients. You can also train it directly by NLL, and woks quite well, a single coupling layer seems to be enough here.

There are a few things we will want to improve, in particular our bijectors here only work in the 2d case, but we can maybe look at that in a separate issue. This code should be enought to start experimenting.

Justinezgh commented 2 years ago

With 1 coupling layer and

Justinezgh commented 2 years ago

With 2 CL and

EiffL commented 2 years ago

It should work a little bit better than this I think, but probably depends on your training strategy. I start at lr=0.001, run it for "long enough", and then lower the learning rate.