JenniNiku / gllvm

Generalized Linear Latent Variable Models
https://jenniniku.github.io/gllvm/
48 stars 19 forks source link

Correction to Hessian #95

Closed BertvanderVeen closed 1 year ago

BertvanderVeen commented 1 year ago

This update makes a small correction to the 2nd derivatives of the canonical coefficients in constrained and concurrent ordination models, in order to account for the fact that they lay on a constrained parameter space.

The correction is based on the formulation of the likelihood subject to equality constraints with the method of Lagrange multipliers.

In essence, at the solution, an estimate for the Lagrangian multipliers is retrieved, which is then added to dL/db1db2, i.e., the second partial derivative of the likelihood w.r.t. the canonical coefficients of the same predictor, but on different latent variables.

For constrained ordination the correction seems usually negligible, but for concurrent ordination it usually has a larger effect.

Can immediately be accepted @JenniNiku