search

apache / openwhisk

Apache OpenWhisk is an open source serverless cloud platform
https://openwhisk.apache.org/
Apache License 2.0
6.54k stars 1.17k forks source link

GPU support for OpenWhisk Actions #5450

Open Abhishekghosh1998 opened 1 year ago

Abhishekghosh1998 commented 1 year ago

It is not an issue. But just a general query from my end. Does OpenWhisk support GPU acceleration? I was going through this proposal about AI-Actions in OpenWhisk. The proposal there has the WIP [Work In Progress] tag. But that proposal itself is six years old. I was wondering whether there is a mechanism in OpenWhisk using which I can offload actions to get them executed on GPU. The tag-based-scheduling mentions about things like:

wsk action update params tests/dat/actions/params.js -i -a invoker-resources '["v2", "gpu"]'

I do not understand its utility. Does it solve the purpose of offloading actions to GPU? If so, I would like to be helped with some documentation or tutorials explaining how I could achieve the same.

QWQyyy commented 8 months ago

We could use K8s with CUDA-K8s driver, I think it can work.