If a version is loaded and unmodified, then it should not be reloaded on the next load request.
If a version is loaded but modified, then it should be reloaded on the next load request.
If a version is not loaded and its model file is in the model directory, then it should be loaded on the next load request.
If a version is not loaded nor its model file is in the model directory, then it should be loaded on the next load request.
If a generic file is modified on the model directory, i.e. model_directory/common_dependency.py, then all loaded version(s) should be reloaded on the next load request.
Checklist
[x] PR title reflects the change and is of format <commit_type>: <Title>
What does the PR do?
Add the following tests on model version reload:
model_directory/common_dependency.py
, then all loaded version(s) should be reloaded on the next load request.Checklist
<commit_type>: <Title>
Commit Type:
Check the conventional commit type box here and add the label to the github PR.
Related PRs:
https://github.com/triton-inference-server/core/pull/388
Where should the reviewer start?
Start with the core PR.
Test plan:
The PR adds the test, see the Test plan on the core PR.
Caveats:
N/A
Background
N/A
Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)
N/A