Closed alexbovet closed 4 years ago
Ok, I just realized that this is the same issue than #6 .
if I pass export MKL_INTERFACE_LAYER=ILP64
the problem is solved. :-)
Appreciate the report anyway; there's an explicit error message about the solution if either input matrix is too big, but I forgot the case where only the product is too big.
I added a clearer error message for this in 7d0d2253e8b1b5c9ca06fc10c0346db6b08df338 and I'll put it on pypi at some point.
Thanks a lot for this great library. This is extremely useful.
I have a problem happening with large sparse matrices and
gram_matrix_mkl
returning `2 (SPARSE_STATUS_ALLOC_FAILED)'.I understand that there is a limit in the available memory to allocate, but this happens well before I reach the limit of my system.
The simplest example is:
which returns:
But, for example, I can do
without any problem. Here,
O.nbytes/1024/1024/1024
= 36.50 GB and I have 1.5TB of ram installed.I know that this could be a problem of intel MKL rather than your library, but I could not find anything on the intel MKL forums or documentation.
I would appreciate If you know if this is expected or if there is a way to fix it.
I am using python3.8, sparse_dot_mkl 0.5.3 and Intel MKL 2020.2.254.
uname -a: Linux 5.4.0-42-generic #46-Ubuntu SMP Fri Jul 10 00:24:02 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux