yuki-koyama / mathtoolbox

Mathematical tools (interpolation, dimensionality reduction, optimization, etc.) written in C++11 with Eigen
https://yuki-koyama.github.io/mathtoolbox/
MIT License
257 stars 35 forks source link

The GPR demo sometimes fails to find appropriate hyperparameters #50

Closed yuki-koyama closed 5 years ago

yuki-koyama commented 5 years ago

The current demo uses maximum likelihood estimation for hyperparameters, but it fails sometimes. Especially, the length-scale hyperparameter in the ARD squared exponential kernel becomes unrealistically small, resulting in a "no relevance" kernel matrix.

A possible fix is to use maximum a posteriori estimation with an appropriate prior assumption for the hyperparameters.