Open iprovalo opened 2 months ago
@iprovalo I'm not able to reproduce your issue. I converted the model on mac, and everything works as expected.
Here is the files that after I converted to onnx:
-rw-r--r-- 1 lufen staff 736 Aug 26 21:25 config.json
-rw-r--r-- 1 lufen staff 683420 Aug 26 21:26 model.onnx
-rw-r--r-- 1 lufen staff 2266886160 Aug 26 21:26 model.onnx_data
-rw-r--r-- 1 lufen staff 5069051 Aug 26 21:25 sentencepiece.bpe.model
-rw-r--r-- 1 lufen staff 162 Aug 26 21:26 serving.properties
-rw-r--r-- 1 lufen staff 964 Aug 26 21:25 special_tokens_map.json
-rw-r--r-- 1 lufen staff 17082799 Aug 26 21:25 tokenizer.json
-rw-r--r-- 1 lufen staff 1173 Aug 26 21:25 tokenizer_config.json
@frankfliu thank you for trying to reproduce. I will continue debugging. I will report back on this thread if I find the issue with my set up.
Description
Runtime won't load a converted model for bge-m3
Expected Behavior
No errors.
Error Message
Exception in thread "main" java.lang.RuntimeException: data did not match any variant of untagged enum PreTokenizerWrapper at line 73 column 3 at ai.djl.huggingface.tokenizers.jni.TokenizersLibrary.createTokenizerFromString(Native Method) at ai.djl.huggingface.tokenizers.HuggingFaceTokenizer.newInstance(HuggingFaceTokenizer.java:176) at ai.djl.huggingface.tokenizers.HuggingFaceTokenizer.newInstance(HuggingFaceTokenizer.java:138) at ai.djl.huggingface.tokenizers.HuggingFaceTokenizer$Builder.build(HuggingFaceTokenizer.java:817) at ai.djl.huggingface.translator.TextEmbeddingTranslatorFactory.newInstance(TextEmbeddingTranslatorFactory.java:64) at ai.djl.translate.DeferredTranslatorFactory.newInstance(DeferredTranslatorFactory.java:69) at ai.djl.repository.zoo.BaseModelLoader.loadModel(BaseModelLoader.java:167) at ai.djl.repository.zoo.Criteria.loadModel(Criteria.java:172)
How to Reproduce?
djl-convert -m BAAI/bge-m3 -f OnnxRuntime
Environment Info - Conversion step
Please run the command
./gradlew debugEnv
from the root directory of DJL (if necessary, clone DJL first). It will output information about your system, environment, and installation that can help us debug your issue. Paste the output of the command below: