Suport for IBM Codeengine as executer for notebooks/python scirpts/piplines

elyra-ai / elyra

Elyra extends JupyterLab with an AI centric approach.

https://elyra.readthedocs.io/en/stable/

Apache License 2.0

1.86k stars 344 forks source link

Suport for IBM Codeengine as executer for notebooks/python scirpts/piplines #937

Open romeokienzler opened 4 years ago

romeokienzler commented 4 years ago

IBM Code Engine will soon provide a "Supercomputer as a Service" where tasks can be scaled on 1000s of cores for just a couple of seconds. Would be interesting to look at how an integration can be done at different levels:

notebook cell
notebook
python script
python function
pipeline

ptitzler commented 4 years ago

IBM Cloud Code Engine is currently in beta. https://cloud.ibm.com/docs/codeengine?topic=codeengine-getting-started

romeokienzler commented 4 years ago

yes - so Elyra support also should be either beta as well or we wait until Code Engine is production ready, but then we will loose time for adoption. I think it would be a very nice feature to just push computation elastically to CodeEngine...