OasisLMF / OasisPlatform

Loss modelling platform.
BSD 3-Clause "New" or "Revised" License
41 stars 17 forks source link

Task controller unable to create sub-tasks unless there is a worker on a model queue. #1022

Closed sambles closed 4 months ago

sambles commented 5 months ago

Issue Description

The task controller can block (doesn't chunk up an execution into sub-tasks) when zero workers are on the destination model queue.

(needs investigating)

      "queue": {
        "name": "OasisLMF-PiWind-2.3.3",
        "pending_count": 0,                 (from sub-task objects)
        "queued_count": 0,                  (from sub-task objects)
        "running_count": 0,                 (from sub-task objects)
        "queue_message_count": 5,           (read directly from queue value) 
        "worker_count": 0,                  (read directly from queue value) 
            “name”: “test”,
            “id”: 241,
            “portfolio”: 25,
            “model”: 21,
            “status”: “RUN_QUEUED”,    <-- waiting to be processed by task-controller
            “priority”: 4,
            “analysis_chunks”: null,   <-- loss geneneration sub-tasks not created yet
            “lookup_chunks”: 5,
            “sub_task_count”: 11,  
            “queue_names”: [],
            “status_count”: {
              “TOTAL_IN_QUEUE”: 0,
              “TOTAL”: 11,             <-- these sub-tasks are from input generation
              “PENDING”: 0,
              “QUEUED”: 0,
              “STARTED”: 0,
              “COMPLETED”: 11,
              “CANCELLED”: 0,
              “ERROR”: 0
            }
sambles commented 4 months ago

Tested and verified as not an issue - closing