Parallelize mutliple workload deletions

AI-Hypercomputer / xpk

xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.

Apache License 2.0

81 stars 23 forks source link

Parallelize mutliple workload deletions #72

Closed SurbhiJainUSC closed 8 months ago

SurbhiJainUSC commented 9 months ago

Fixes / Features

Adding batching to parallelize multiple workload deletions to reduce the time

Testing

This PR has been tested to delete 100 workloads in a cluster containing 1 node of n1-standard-8.

Testing / Documentation

[ y ] Tests pass
[ y ] Appropriate changes to documentation are included in the PR