Open tomaszdudek7 opened 7 years ago
I am working on it. Progress can be seen at https://github.com/jupyter-incubator/sparkmagic/pull/413. Any comments/suggestions appreciated.
@aggFTW
As a workaround, I used below code to pass from local to spark
` %%local
from IPython import get_ipython ipython = get_ipython() input_str = input()
line = ''
ipython.run_cell_magic(magic_name='spark', line=line, cell=input_str)
`
Enable sending Pandas DF from a
%%local
context to the%%spark
one - the functionaly should look quite like%%spark -o
from the users' perspective.