Enhancement: Prevent error if some input files are missing

[georgemccabe]

In the NOAA/METplus Telecon on 1/8/2024, we discussed adding a config option to allow runs to continue without error if some of the required input files are not found. This would prevent an error being reported when one of the runs did not succeed due to a data outage.

Describe the Enhancement

Add a configuration option to report a warning instead of an error when input files are not found. Shannon noted that she has written logic in her scripts that call METplus to check input files and only run if 80% of the input is available. The new config option could be a number between 0-1 that can be used to report warnings until a threshold is met, in which case errors will be throw. Alternatively, the error could be reported at the end.

Time Estimate

Estimate the amount of work required here. Issues should represent approximately 1 to 3 days of work.

Sub-Issues

Consider breaking the enhancement down into sub-issues.

• [ ] Add a checkbox for each sub-issue here.

Relevant Deadlines

METplus 6.0.0

Funding Source

Define the source of funding and account keys here or state NONE.

Define the Metadata

Assignee

• [ ] Select engineer(s) or no engineer required
• [ ] Select scientist(s) or no scientist required

Labels

• [ ] Select component(s)
• [ ] Select priority
• [ ] Select requestor(s)

Projects and Milestone

• [ ] Select Repository and/or Organization level Project(s) or add alert: NEED CYCLE ASSIGNMENT label
• [ ] Select Milestone as the next official version or Future Versions

Define Related Issue(s)

Consider the impact to the other METplus components.

• [ ] METplus, MET, METdataio, METviewer, METexpress, METcalcpy, METplotpy

Enhancement Checklist

See the METplus Workflow for details.

• [ ] Complete the issue definition above, including the Time Estimate and Funding Source.
• [ ] Fork this repository or create a branch of develop. Branch name: feature_<Issue Number>_<Description>
• [ ] Complete the development and test your changes.
• [ ] Add/update log messages for easier debugging.
• [ ] Add/update unit tests.
• [ ] Add/update documentation.
• [ ] Add any new Python packages to the METplus Components Python Requirements table.
• [ ] Push local changes to GitHub.
• [ ] Submit a pull request to merge into develop. Pull request: feature <Issue Number> <Description>
• [ ] Define the pull request metadata, as permissions allow. Select: Reviewer(s) and Development issues Select: Repository level development cycle Project for the next official release Select: Milestone as the next official version
• [ ] Iterate until the reviewer(s) accept and merge your changes.
• [ ] Delete your fork or branch.
• [ ] Close this issue.

[georgemccabe]

As discussed in NOAA Telecon on 2024/01/22, consider updating the logic to find files so that find_obs_offset will not report a WARNING for each offset that is not found. This message could be changed to a DEBUG message or removed altogether.

[georgemccabe]

This may be related to #1656