search

environmental-forecasting / model-ensembler

Model Ensemble tool for batch workflows on HPCs
https://pypi.org/project/model-ensembler/
MIT License
13 stars 1 forks source link

Spurious warnings from job submission #42

Open JimCircadian opened 7 months ago

JimCircadian commented 7 months ago

When submitting a job (successfully) there is still output WARNINGs for the job not being found. This is down to the initial timeout for job registration not being right, which I think is parameterised, but it likely makes sense to clear this logging up a bit as it'll be confusing for users. 

[16-04-24 12:54:22    :INFO    ] - Submitted job with ID 6113027
[16-04-24 12:54:22    :INFO    ] - Submitted job with ID 6113028
[16-04-24 12:54:23    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:23    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:23    :INFO    ] - Submitted job with ID 6113029
[16-04-24 12:54:23    :INFO    ] - Submitted job with ID 6113030
[16-04-24 12:54:23    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:23    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:23    :INFO    ] - Submitted job with ID 6113031
[16-04-24 12:54:23    :INFO    ] - Submitted job with ID 6113032
[16-04-24 12:54:23    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:24    :INFO    ] - Submitted job with ID 6113033
[16-04-24 12:54:24    :INFO    ] - Submitted job with ID 6113034
[16-04-24 12:54:24    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:24    :INFO    ] - Submitted job with ID 6113035
[16-04-24 12:54:24    :INFO    ] - Submitted job with ID 6113036
[16-04-24 12:54:24    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:24    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:24    :WARNING ] - Could not retrieve job from list
[16-04-24 12:54:24    :WARNING ] - Could not retrieve job from list
[16-04-24 12:55:53    :INFO    ] - fc.2024-04-10_south-1 monitor got state COMPLETED for job 6113027
[16-04-24 12:55:53    :INFO    ] - End run fc.2024-04-10_south-1 at 2024-04-16 11:55:53.465084
[16-04-24 12:55:53    :INFO    ] - fc.2024-04-10_south-3 monitor got state COMPLETED for job 6113028
[16-04-24 12:55:53    :INFO    ] - End run fc.2024-04-10_south-3 at 2024-04-16 11:55:53.465987
[16-04-24 12:55:53    :INFO    ] - fc.2024-04-10_south-8 monitor got state COMPLETED for job 6113029
[16-04-24 12:55:53    :INFO    ] - End run fc.2024-04-10_south-8 at 2024-04-16 11:55:53.626843
[16-04-24 12:55:53    :INFO    ] - fc.2024-04-10_south-9 monitor got state COMPLETED for job 6113030
[16-04-24 12:55:53    :INFO    ] - End run fc.2024-04-10_south-9 at 2024-04-16 11:55:53.643070
[16-04-24 12:55:54    :INFO    ] - fc.2024-04-10_south-0 monitor got state COMPLETED for job 6113031
[16-04-24 12:55:54    :INFO    ] - End run fc.2024-04-10_south-0 at 2024-04-16 11:55:54.331846
[16-04-24 12:55:54    :INFO    ] - fc.2024-04-10_south-4 monitor got state COMPLETED for job 6113032
[16-04-24 12:55:54    :INFO    ] - End run fc.2024-04-10_south-4 at 2024-04-16 11:55:54.416978