luhenry / netlib

An high-performance, hardware-accelerated implementation of Netlib in Java
Other
60 stars 12 forks source link

Make Debugging JNI Loading Failures Easier For BLAS #20

Open tburned opened 1 year ago

tburned commented 1 year ago

At the moment, when attempting to load JNIBLAS, the exception is discarded. As a result, debugging library loading failures is much more difficult. By providing more information at a more fine-grained log level, more information can be provided about why the native library was unable to be loaded instead of just that it wasn't able to be loaded.

dineshdharme commented 10 months ago

I was burned by this issue. So I had to separately compile the jars and get spark on EMR to use them. I have detailed the steps to compile the jar in this gist. Hope this helps someone in the future.

https://gist.github.com/dineshdharme/8bd39cdbc35a09033b9ba2cfd1bdf146