puthurr / python-azure-function-gpu

A short example on how to create Python Azure Function with GPU support
MIT License
47 stars 2 forks source link

GPU Support #1

Open BoPengGit opened 3 years ago

BoPengGit commented 3 years ago

Hi,

So this method of using the Azure Functions will use the GPU from the AKS? Is this correct?

Also how do we setup an API endpoint to send a request to this API?

Thank you and great work.

puthurr commented 3 years ago

That is correct. Today the OOTB Azure functions docker images don't support GPU hence this project.

You need to apply the YAML onto your AKS cluster. You will find the provided sample under yaml/mrc-full-gpu.yaml. The deployed AKS service will give an endpoint to send queries to.

Let me know if this helps.