search

axinc-ai / ailia-models-unity

Unity version of ailia models repository
42 stars 2 forks source link

Connect ailia tokenizer to StableDiffusion #117

Closed kyakuno closed 3 weeks ago

kyakuno commented 7 months ago

SDK https://medium.com/axinc/ailia-tokenizer-unity%E3%82%84c-%E3%81%8B%E3%82%89%E4%BD%BF%E7%94%A8%E3%81%A7%E3%81%8D%E3%82%8Bnlp%E5%90%91%E3%81%91%E3%83%88%E3%83%BC%E3%82%AF%E3%83%8A%E3%82%A4%E3%82%B6-b60b68c46b06

Example. https://github.com/axinc-ai/ailia-models-unity/blob/master/Assets/AXIP/AILIA-MODEL[…]turalLanguageProcessing/AiliaNaturalLanguageProcessingSample.cs

ailiaTokenizer = new AiliaTokenizerModel();
modelPrepared = ailiaTokenizer.Create(AiliaTokenizer.AILIA_TOKENIZER_TYPE_CLIP, AiliaTokenizer.AILIA_TOKENIZER_FLAG_NONE);
int[] tokens = tokenizer.Encode(text);