search

valiantljk / h5spark

Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark
Other
42 stars 25 forks source link

Using H5Spark in Jupyter #6

Open valiantljk opened 8 years ago

valiantljk commented 8 years ago

A user requests to use H5Spark in Jupyter, which is a popular notebook used anywhere. The current issue is that the class path is not recognized in the notebook, i.e., the h5spark library can not be exported and used.

eracah commented 8 years ago

Yes. This is a strange issue that @valiantljk and I were dealing with. I suspect it's some issue with PYTHONPATH and init.py Let me look into it

jakehockey10 commented 7 years ago

May I ask what the current status of this issue is?

valiantljk commented 7 years ago

Hi Evan, Is h5spark usable in Jupyter?

Best, Jialin

On Jan 26, 2017, at 2:35 PM, Jake Smith notifications@github.com wrote:

May I ask what the current status of this issue is?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/valiantljk/h5spark/issues/6#issuecomment-275535864, or mute the thread https://github.com/notifications/unsubscribe-auth/ABVQgyyUbUHh6T3Kcbjd-E6hhusCLHSsks5rWR_JgaJpZM4ILcJn.

eracah commented 7 years ago

I believe so. For python at least. If you can get a pyspark notebook set up then you can do it. All you need is the h5spark python module to be on your PYTHONPATH or your sys.path

I will note that I no longer contribute to h5spark, so I cannot guarantee bug-free python code for h5spark

Thanks, Evan

valiantljk commented 7 years ago

Sounds good. Thanks and good luck.

-Jialin

On Thu, Jan 26, 2017 at 3:06 PM, Evan Racah notifications@github.com wrote:

I believe so. For python at least. If you can get a pyspark notebook set up then you can do it. All you need is the h5spark python module to be on your PYTHONPATH or your sys.path

I will note that I no longer contribute to h5spark, so I cannot guarantee bug-free python code for h5spark

Thanks, Evan

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/valiantljk/h5spark/issues/6#issuecomment-275542518, or mute the thread https://github.com/notifications/unsubscribe-auth/ABVQg-j4oce1EDtkpOxDH64D4dQN5gkuks5rWSbwgaJpZM4ILcJn .