Texera / texera

Collaborative Machine-Learning-Centric Data Analytics Using Workflows
https://texera.github.io
Apache License 2.0
160 stars 68 forks source link

Implement Basic Workflow Pod Lifecycle API #2758

Closed zhaoKelvin closed 1 month ago

zhaoKelvin commented 1 month ago

This PR implements the createPod, listPods, and terminatePod API endpoints, as well as related service functions. Together, they allow control over the lifecycle of a Kubernetes pod and all pods are saved in the texera_db database under the pod table.

Architecture

The overall architecture is different from the original design shown below as a singular deployment containing all user pods does not allow for the freedom to decide which pod is deleted without significant added complexity. Instead of a singular deployment, each user gets their own deployment, from which a pod the user can use is spawned from. architecture