Question: is there any way to interoperate with spark/pyspark?

scijava / scijava-jupyter-kernel

[RETIRED] Try IJava or BeakerX

Apache License 2.0

178 stars 42 forks source link

Question: is there any way to interoperate with spark/pyspark? #87

Closed javadba closed 5 years ago

javadba commented 6 years ago

The polyglot is great - but my use cases are typically a combination of spark and/or pyspark dataframes. Is there any future for scijava-jupyter with those?

ctrueden commented 5 years ago

@javadba Sorry your question went unanswered for so long. The plan is to retire scijava-jupyter-kernel in favor of using BeakerX's kernels directly. The only potential downside is the lack of seamless polyglot, but as you say, it doesn't really impact our use cases.