livepeer / go-livepeer

Official Go implementation of the Livepeer protocol
http://livepeer.org
MIT License
537 stars 165 forks source link

Set gpu per model #3085

Open eliteprox opened 4 weeks ago

eliteprox commented 4 weeks ago

What does this pull request do? Explain your changes. (required)

Adds the ability to set preferred gpu by model in the aimodels config.

    {
        "pipeline": "text-to-image",
        "model_id": "SG161222/RealVisXL_V4.0_Lightning",
        "price_per_unit": 190000,
        "warm": false,
        "gpus": [0]
    },

Linked to changes in https://github.com/livepeer/ai-worker/pull/111

Specific updates (required)

How did you test each of these updates (required)

Does this pull request close any open issues?

AI-134

Checklist: