mithril-security / blindai

Confidential AI deployment with secure enclaves :lock:
https://www.mithrilsecurity.io/
Apache License 2.0
502 stars 36 forks source link

Allow loading multiple models at the same time #39

Closed cchudant closed 2 years ago

cchudant commented 2 years ago

Description

The upload_model request will return a UUID for the model. This UUID will be used by run_model and will be added to the signed response proofs.

We may want to be backward compatible with the way our docs and blogposts are written, so that if the model name is not provided, you just use the last one that was uploaded.

Future work

Motivation and Context

Right now, once you upload a model, you won't be able to upload another one without discarding the first.

Affected Features

State the different existing features that will be broken/affected by this new feature.

Test Plans

Server and client tests + unittests

Additional Information

None

Checklist

CerineBnsd commented 2 years ago

@JoFrost Can I work on this ?

JoFrost commented 2 years ago

Sure. @CerineBnsd

cchudant commented 2 years ago

closed by #73