PTB-M4D / PyDynamic

Python library for the analysis of dynamic measurements
https://ptb-m4d.github.io/PyDynamic/
GNU Lesser General Public License v3.0
26 stars 13 forks source link

support for large sparse covariance matrices #11

Open bruns01 opened 8 years ago

bruns01 commented 8 years ago

Some routines in the package make use of np.random.multivariate_normal(...) which samples from a multivariate normal distribution based on information given by the covariance matrix in the arguments to the call. In many cases of dynamic measurements long time series of combinations of time series lead to very large but (very) sparse covariance matrices. These cannot be handled efficiently by np.random.multivariate_normal(). A dedicated function fit to deal efficiently with scipy.sparse-matrices would be much appreciated!

eichstaedtPTB commented 8 years ago

This is very reasonable request, thanks! Actually, there are a couple of methods to address this issue and I am aware of a recently published paper from NPL colleagues on large scale covariance matrix compression methods. Therefore, I'll assign this feature request to the NPL contributors for PyDynamic to implement this.