search

flux-framework / flux-k8s

Project to manage Flux tasks needed to standardize kubernetes HPC scheduling interfaces
Apache License 2.0
21 stars 10 forks source link

Flux-Kube jobtap plugin #13

Closed milroy closed 2 years ago

milroy commented 3 years ago

This PR adds the flux-kube.so jobtap plugin and the associated machinery to build and install it. The jobtap plugin is based on alloc-bypass.so (flux-core 90461710f1f09ed48cc7586abff5cb4fee6dc63d). The plugin looks for attributes.system.flux-kube set in the jobspec. If it's present, the plugin sets the "alloc-bypass" flag, passes the jobspec to flux-kube.py via RPC, and unpacks the response. Then the plugin generates a dummy R (since the resources will reside on OpenShift) and commits it to the KVS. Finally, the plugin emits an "alloc" event.

This PR depends on PR #11 and can only be merged after it.

milroy commented 2 years ago

I am closing this PR as #14 contains the commits and many review comments have been made regarding it.