(feat): BlindAI Bento API Support

mithril-security / blindai

Confidential AI deployment with secure enclaves :lock:

https://www.mithrilsecurity.io/

Apache License 2.0

502 stars 36 forks source link

Closed kbamponsem closed 1 year ago

kbamponsem commented 1 year ago

Adds the bento support through the input argument nitro to the blindai.api.Audio.transcribe method.

It also adds URL switching for both SGX and Nitro mode when either in simulation or hardware.
For bento, it updates the URL from /nitro to using the port:3000.