Tokenizers integration - Githubissues

mithril-security / blindai

Confidential AI deployment with secure enclaves :lock:

https://www.mithrilsecurity.io/

Apache License 2.0

502 stars 36 forks source link

Tokenizers integration #72

Closed mbrunel closed 2 years ago

mbrunel commented 2 years ago

Description

Integrating tokenizers-sgx to blindai.

Client

Add method upload_tokenizers Add new field in protobuf for tokenizers upload Add new datatype STRING in protobuf

Server

Add method send_tokenizers in client_communication.rs Update run_inference to tokenize input if needed

Related Issue

Type of change

The types of changes must be deduced from the labels of the related issues. Please consider providing these further details.

[x] This change requires a documentation update
[x] This change affects the client
[x] This change affects the server
[x] This change affects the API
[ ] This change only concerns the documentation

How Has This Been Tested?

I added an integration test in tests/test_distilbert.py file.

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] My changes generate no new warnings
[ ] I have updated the documentation according to my changes