Closed josephdviviano closed 1 year ago
Problems may happen when the edge parameters are set to trainable (c.f. your comment about Adam above)
Ideally, write a test in FLeCS/test/test_intervention.py
I think you need to re-initialize the optimizer whenever you intervene on the cell (because the set of parameters has changed)
Check the old version of the code where we were storing the values of momentum after intervention
watch for ADAM momentum updates!