Closed lxning closed 9 months ago
torch-model-archive support no archive format to reduce the overhead for creating large model artifacts. This feature needs apply to kserve.
it takes long time to create mar file for large model.
No response
Issue fixed
🚀 The feature
torch-model-archive support no archive format to reduce the overhead for creating large model artifacts. This feature needs apply to kserve.
Motivation, pitch
it takes long time to create mar file for large model.
Alternatives
No response
Additional context
No response