Tractables / pyjuice

Scalable training and inference for Probabilistic Circuits
https://tractables.github.io/pyjuice/
Apache License 2.0
45 stars 8 forks source link

Parameter tracking by PyTorch #16

Open mlnpapez opened 1 month ago

mlnpapez commented 1 month ago

Hi,

Do you plan to add tracking of the PC's parameters by PyTorch? For example, a switch that would change the requires_grad of the PC's parameters from False to True. I would like to use the optimizers from torch.optim to train your PCs.

Best regards, Milan

liuanji commented 4 weeks ago

Hi Milan,

Yes, this is on our TODO list. However, there are a few problems such as the parameters are currently stored in probability space yet we want to optimize log probabilities when using gradient-based methods. We need to figure out the best way to do it. We are also very open to suggestions from your side.

Best, Anji