search

xtensor-stack / xtensor-blas

BLAS extension to xtensor
BSD 3-Clause "New" or "Revised" License
155 stars 54 forks source link

The different precision between numpy and xtensor_blas package when using cholesky function #237

Closed smasky closed 9 months ago

smasky commented 9 months ago

Hello, i am using cholesky function from the xstensor_blas package. But i find the fact that there is difference between numpy and xtensor_blas package. Following picture is the result from numpy. QQ截图20231116163959 Following picture is the output from xtensor_blas QQ截图20231116164303

The precision difference affect the subsequent result. Please help me.

smasky commented 9 months ago

The problem may occur in here: 微信截图_20231116184621

The matrix M has been different with the matrix A

smasky commented 9 months ago

Sorry, i find the reason. The function cholesky need 'L' matrix, but i use 'U' matirx.