ML model deployment with Triton Inference Server

[rohitgr7]

Title of the talk

ML model deployment with Triton Inference Server

Description

NVIDIA Triton Inference Server is open-source inference-serving software that helps standardize model deployment and execution and delivers fast and scalable AI in production. I'll talk about its features, and capabilities and a code walkthrough to showcase how this framework can be used for model inferencing.

What format do you have in mind for your talk?

Talk

Table of contents

1. Intro to Triton Inference server
2. Functionalities it offers and how to configure it
3. Showcase an example on an ML model using a Jupyter notebook
4. My learnings while working with it

What domain would you say your talk falls under?

Data Science & Machine Learning

Duration in minutes (including Q&A)

30

Prerequisites

Basic knowledge of python and pytorch (optional).

Speaker bio

Twitter: https://twitter.com/imgrohit LinkedIn: https://linkedin.com/in/rohitgr7

The talk/workshop speaker agrees to

• [X] Share the slides, code snippets and other material used during the talk

• [X] If the talk is recorded, you grant the permission to release the video on BangPyper's YouTube channel under CC-BY-4.0 license

• [X] Not do any hiring pitches during the talk and follow the Code of Conduct

[anistark]

@rohitgr7 Would you like to present this talk this weekend at FOSS Hack ?

[rohitgr7]

I presented this talk at the last foss united meetup.

[RiyaMathew-11]

Hi @rohitgr7, you can have a sort of extended presentation about the same at FOSS Hack too. If you are interested, we can connect on Telegram and discuss more on the same.

This is actually on 4th March (tomorrow) - and we are expecting the interaction to happen at night - post 9 pm.

[anistark]

Hi @rohitgr7

Please confirm if you want to present this talk at this month's meetup?

[rohitgr7]

hey @anistark !

little busy this weekend. maybe next month?

[anistark]

@rohitgr7 Do you want to present in this month's meetup? It's on 20th morning.

[rohitgr7]

Hey @anistark ! Not in the city this month. But next month definitely :)

[anistark]

Hi @rohitgr7

Are you willing to present this in July meetup?

[rohitgr7]

@anistark when is it?

[RiteshAgrawal]

@rohitgr7 It is on July 15 at Cyware Labs, HSR Layout

[rohitgr7]

Cool, I can give a talk :)

[anistark]

Thanks for confirming @rohitgr7 Could you please also share your pic to be used in the promotional banner if you're ok with it?

[rohitgr7]

Thanks for confirming @rohitgr7 Could you please also share your pic to be used in the promotional banner if you're ok with it?

Sure! Check discord