The EM algorithm for fitting LDS described in the book PRML (ch13) is numerical (very) unstable, that the covariance matrices are often singular during iterations.
There is no easy way to fix this. Two options are
(1) Leave it as it is in the book, so that people can learn it but not use it in practice.
(2) write stable algorithm, which is quite different to the one in the book.
The EM algorithm for fitting LDS described in the book PRML (ch13) is numerical (very) unstable, that the covariance matrices are often singular during iterations.
There is no easy way to fix this. Two options are (1) Leave it as it is in the book, so that people can learn it but not use it in practice. (2) write stable algorithm, which is quite different to the one in the book.
Current status is (1).