Open refraction-ray opened 4 years ago
Comment: I am not independently realizing that stochastic reconfiguration method in VMC is the same thing as natural gradient descent. The idea is from this paper: PHYSICAL REVIEW X 8, 011006 (2018). This is a physics paper on RBM wavefunction VMC, however, the authors mentioned in this work:
stochastic reconfiguration optimization, which is equivalent to the natural gradient descent
Great observation! And it is impressive that some optimization based on imaginary time dynamics and Schrodinger equations can be fully reduced to general optimization setups. But I am not sure who is the first one that realized this connection.
Idea: If I have time, I will think about imaginary time evolution in TNS settings, which is also used for optimization ground state energy. And I will definitely check whether such "physicsy" optimization scheme can also be reduced to some general well-established optimization scheme in optimization field.
Update: this relation is in particular be clarified in Append B of arXiv:1909.02487. But the authors mentioned in this work that either community doesn't realize it before. No, the above PRX is the evidence. Another paper on this: On the geometry of learning neural quantum states