pytorch / serve

Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
4.18k stars 851 forks source link

kserve support no archive model artifacts #2830

Closed lxning closed 9 months ago

lxning commented 10 months ago

🚀 The feature

torch-model-archive support no archive format to reduce the overhead for creating large model artifacts. This feature needs apply to kserve.

Motivation, pitch

it takes long time to create mar file for large model.

Alternatives

No response

Additional context

No response

agunapal commented 9 months ago

Issue fixed