search

xtensor-stack / xtensor-blas

BLAS extension to xtensor
BSD 3-Clause "New" or "Revised" License
158 stars 55 forks source link

The different precision between numpy and xtensor_blas package when using cholesky function #237

Closed smasky closed 1 year ago

smasky commented 1 year ago

Hello, i am using cholesky function from the xstensor_blas package. But i find the fact that there is difference between numpy and xtensor_blas package. Following picture is the result from numpy. QQ截图20231116163959 Following picture is the output from xtensor_blas QQ截图20231116164303

The precision difference affect the subsequent result. Please help me.

smasky commented 1 year ago

The problem may occur in here: 微信截图_20231116184621

The matrix M has been different with the matrix A

smasky commented 1 year ago

Sorry, i find the reason. The function cholesky need 'L' matrix, but i use 'U' matirx.