mithril-security / blindai

Confidential AI deployment with secure enclaves :lock:
https://www.mithrilsecurity.io/
Apache License 2.0
500 stars 35 forks source link

now supports custom output types #60

Closed JoFrost closed 2 years ago

JoFrost commented 2 years ago

Description

Output format now customizable The output format was forced to float32 until now. This can now be changed from the client, with a new parameter in upload model named dtype_out, using the enum ModelDatumType.

Related Issue

54

Type of change

The types of changes must be deduced from the labels of the related issues. Please consider providing these further details.

How Has This Been Tested?

CI tests

Checklist: