search

jupyter-incubator / sparkmagic

Jupyter magics and kernels for working with remote Spark clusters
Other
1.33k stars 447 forks source link

sparkmagic extension can't enable for env LD_LIBRARY_PATH [BUG] #601

Closed SmartInWhut closed 4 years ago

SmartInWhut commented 4 years ago

Describe the bug i have hadoop client(2.7.3) with env LD_LIBRARY_PATH=${HADOOP_HOME}/lib/native ；when i run the command jupyter serverextension enable --py sparkmagic (the previous steps have been completed) there was an error: 

File "/opt/conda/lib/python3.6/site-packages/requests_kerberos/kerberos_.py", line 2, in <module>
    import kerberos
ImportError: /usr/lib/mapreduce_client/lib/native/libk5crypto.so.3: symbol krb5int_utf8cs_to_ucs2les version krb5support_0_MIT not defined in file libkrb5support.so.0 with link time reference

if i unset the env , the command works normally.

Expected behavior both hadoop clinet and sparkmagic perform normal

Versions:

SmartInWhut commented 4 years ago

solved by unset the env LD_LIBRARY_PATH. rm the libk5crypto.so.3 also works, turns out that this file is added man-made,not officially