Algorithm queue fail to recover

HKube micro-service algorithm queue

Describe the bug Algorithm queue fails to recover state and pipeline got stock

To Reproduce

delete all worker pods - kubectl delete pod -l type=worker
execute the following pipeline
after the pipeline starts to delete the algorithm queue
the pipeline stays in active mode


{
    "name": "alg-17-pipe",
    "nodes": [
        {
            "nodeName": "alg",
            "algorithmName": "alg-17",
            "input": [
                "#[0...3000]"
            ],
            "kind": "algorithm"
        }
    ],
    "options": {
        "batchTolerance": 100,
        "progressVerbosityLevel": "debug",
        "ttl": 3600
    },
    "kind": "batch",
    "experimentName": "main",
    "priority": 3
}

**Screenshots**
If applicable, add screenshots to help explain your problem.

**Additional context**
Add any other context about the problem here.

kube-HPC / hkube

Algorithm queue fail to recover #1377