search

mithril-security / blindai

Confidential AI deployment with secure enclaves :lock:
https://www.mithrilsecurity.io/
Apache License 2.0
502 stars 36 forks source link

Whisper example missing NNDecodingTask definition #143

Closed keren-riverside closed 1 year ago

keren-riverside commented 1 year ago

Description

I am going through the whisper BlindAI example in examples/whisper/BlindAI_Whisper.ipynb and one of the classes used -- NNDecodingTask -- is not defined in the notebook. Can the definition of this class be added so that it will be possible to export different Whisper models (small, large, multi-language etc)?

Why this modification is needed?

Great tutorial that can't be followed 100%...

What documents need to be updated

JoFrost commented 1 year ago

Hello and thanks for your interest in BlindAI!

Thank you for pointing that out. We found a fix for this and it will be pushed ASAP. In the meantime, you can also apply the fix yourself easily: Rename NNDecodingTask to MetaModel, and the export will work just fine!

JoFrost commented 1 year ago

FYI, the fixed notebook has been pushed on the repo, you can find it here: https://github.com/mithril-security/blindai/blob/master/examples/whisper/BlindAI_Whisper.ipynb