search

cms-ml / cmsml

Python Package of the CMS Machine Learning Group
https://cmsml.readthedocs.io
BSD 3-Clause "New" or "Revised" License
19 stars 6 forks source link

Add custom GitHub action runner with GPU #5

Open riga opened 3 years ago

riga commented 3 years ago

Some tests might require a local GPU with nvml etc installed. For this, we need a custom GH action runner on an OpenStack machine with a GPU.

https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners

aktech commented 3 years ago

Hi @riga I am the creator of Cirun.io, "GitHub action runner with GPU" caught my eye.

FWIW I'll share my two cents. I created a service for problems like these, which is basically running custom machines (including GPUs) in GitHub Actions: https://cirun.io/

It is used in multiple open source projects needing GPU support like the following:

It is fairly simple to setup, all you need is a cloud account (AWS or GCP) and a simple yaml file describing what kind of machines you need and Cirun will spin up ephemeral machines on your cloud for GitHub Actions to run. It's native to GitHub ecosystem, which mean you can see logs/trigger in the Github's interface itself, just like any Github Action run.

Also, note that Cirun is free for Open source projects. (You only pay to your cloud provider for machine usage)