search

exacaster / lighter

REST API for Apache Spark on K8S or YARN
MIT License
91 stars 21 forks source link

Tab completion in jupyter notebook #505

Closed itamar-otonomo closed 1 year ago

itamar-otonomo commented 1 year ago

Hi, I have searched all over but didn't find any reference to tab completion when using a sparkmagic kernel supported by lighter.

Is completion working? And if so, what did I miss in the configuration stages?

Thanks Itamar

Minutis commented 1 year ago

Hello,

if I understand correctly you are asking about IDE-like autocompletion in Jupyterlab. If that's the case - you should look for answers in Jupyterlab related issue trackers or community groups because this feature is not related to Lighter.

Only to nudge you in the right direction: there is already a built in autocompletion using Tab but it only relates to the Python that is installed in the Jupyterlab itself. And since Jupyterlab does not contain any Pyspark modules by default you will not get any autocompletion for that module unless you incorporate it in the Jupyterlab.

Also the autocompletion in Jupyterlab does not feel that responsive and you might want to check for 3rd party plugins like https://github.com/wenmin-wu/jupyter-tabnine (haven't tried it myself - seems little outdated).

itamar-otonomo commented 1 year ago

Thank you for your reply!