Open tburned opened 1 year ago
I was burned by this issue. So I had to separately compile the jars and get spark on EMR to use them. I have detailed the steps to compile the jar in this gist. Hope this helps someone in the future.
https://gist.github.com/dineshdharme/8bd39cdbc35a09033b9ba2cfd1bdf146
At the moment, when attempting to load JNIBLAS, the exception is discarded. As a result, debugging library loading failures is much more difficult. By providing more information at a more fine-grained log level, more information can be provided about why the native library was unable to be loaded instead of just that it wasn't able to be loaded.