search

pytorch / serve

Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
4.23k stars 864 forks source link

--ncs flag, what exactly does it do? #1840

Closed joemal1234 closed 2 years ago

joemal1234 commented 2 years ago

📚 The doc issue

can't serve the new model i want to serve with torchserve --start without the --ncs flag

What is it's purpose and what is it doing? What exactly is the benefit of having it?

I've found it to be very confusing, and I can't see clear documentation on what it does.

Suggest a potential alternative/fix

No response

msaroufim commented 2 years ago

--ncs stands for no config snapshot https://github.com/pytorch/serve/blob/master/ts/arg_parser.py#L52

Snapshots are a way to resume inferences in case a deployment goes down or needs to be stopped. For local experimentation it makes more sense to disable it and for prod deployments it makes more sense to enable it