kevin-bates
commented
3 years ago Hi @xmehaut - thank you for opening this issue and we apologize for the delay getting back to you. This is a difficult issue, but one we are trying to address.
We've discussed some solutions and feel that perhaps leveraging the work we did in #983 is our best path forward. This requires some decoupling of the HTTPKernelManager so that it can be used from the KFP notebook operation.
We do have some questions for you so that we can ensure this is the right approach.
- Is an Enterprise Gateway server configured in a Kubernetes cluster accessible from the KFP K8s cluster? Are they the same cluster or not?
- Is the EG server the same EG server used in your "standard" notebook operations? We will not assume this, but it will help us prioritize.
- Do you require SSL between your elyra server and your EG instance? If so, can that requirement be temporarily removed? Of course, we will address SSL, but also want to prioritize this effort.
- Are you able to receive periodic dev builds that might allow us to iterate on possible resolutions since this kind of configuration is beyond our "daily" test scenarios? I wouldn't expect this taking many iterations.
Although we will move forward regardless and test out solutions on our end, it would be great if we could work together on this to ensure we're providing the right solution.
Thank you.
ptitzler
Hello, I saw that it was possible to use the enterprise kernel gateway with the notebooks. Is there an exemple showing how to use it? Morover, when deploying a KFP with elyra when the notebook use this remote kernel feature, how it is also deployed in kubeflow? (my use case is a spark cluster on k8s)
Best regards xavier