💡 [REQUEST] - How to use TorchServe: Walk through an example

[sekyondaMeta]

🚀 Descirbe the improvement or the new tutorial

We could use an updated tutorial/walk through example on how to use TorchServe. The closest thing we have is the TorchServe Getting Started page located here.

Existing tutorials on this topic

TorchServe Getting started: https://github.com/pytorch/serve/blob/master/docs/getting_started.md

Additional context

No response

cc @msaroufim @agunapal @svekars @carljparker @NicolasHug @kit1980 @subramen

[soma2000-lang]

/assigntome

[svekars]

This issue has been unassigned due to inactivity. If you are still planning to work on this, you can still send a PR referencing this issue.

[soma2000-lang]

Sure @svekars .Sorry for the delay

[pilot-j]

/assigntome

[krishnakalyan3]

/assigntome

[krishnakalyan3]

Hello @svekars, Things have changed since this issue was reported. For example the documentation here points to atleast 21 hyperlinks, 8 tutorials which seem to be quite in-depth.

Let me know if I should do something here.

Regards

[sekyondaMeta]

hi @krishnakalyan3 the hope for this issue was to create a tutorial in the tutorials repo that gets a newbie started with torchserve while also giving a bit of an an explanation as to what it is. A lot of the links on the TorchServe website are more in depth or are for specific use cases. Plus they are located in the TorchServe site/repo. So, think, what is Serve, what does it do and how do I get started with it if I am not familiar with it. Hope that helps.

[krishnakalyan3]

Thank you so much for the clarification @sekyondaMeta.

[agunapal]

Hi @krishnakalyan3 You can also refer to this practical example and write a tutorial based on that https://github.com/pytorch/serve/tree/master/examples/LLM/llama2/chat_app