search

InAnYan / jabref

Graphical Java application for managing BibTeX and biblatex (.bib) databases
https://devdocs.jabref.org
MIT License
0 stars 0 forks source link

Choose embedding model #85

Open ThiloteE opened 1 month ago

ThiloteE commented 1 month ago

This is a "living issue". Editing is appreciated.

Context:

Conditions:

Models:

To be done.

(1) Advantage: Easy to implement; Currently probably better for multilingual (might change in future); Indexing can be faster than local, because computing can be offloaded to powerful remote hardware. Disadvantage: Costly. Conflicts with Open Source Ethos. Privacy converns. Rate limitations. Censorship. Dependency on external service.

(2) Advantage: JabRef does not depend on external application. Full freedom. No cost (apart from electricity / time). Close integration with JabRef's database. No privacy concerns. Disadvantage: Requires maintenance of JabRef. Increases size of JabRef. Can be slow, because code might not be optimized (e.g. offloading to GPU).

(3) Advantage: Separate applications can be highly optimized for AI workloads. More features. Better speed. More models. Are maintained. Almost all of them support and are compatible with the OpenAI API standard. Disadvantage: A separate application can require creating or maintenance of java bindings or plugin or (OpenAI) API compatibility. Requires installing and running a separate application. Needs maintenance of documentation for the separate application.

Implemenation roadmap:

InAnYan commented 1 month ago

awesome! will take a look into your options!

InAnYan commented 1 month ago

For now, I got to install all-minilm-l6-v2 successfully. It's a local model.

Also JabRef distribution size is nearly unchanged (it's not a double)

InAnYan commented 1 month ago

@ThiloteE I think it's your time to shine! It seems Deep Java Library (djl) can run many many models with different architectures.

Maybe you can pick up some models from MTEB?

It seems you need to provide djl some kind of a URL of a model, and then it will magically handle it. Like this: djl://ai.djl.huggingface.pytorch/sentence-transformers/all-MiniLM-L6-v2. Though, I have no idea (and googling didn't help) how to find those URLs. I opened a question on djl repo: https://github.com/deepjavalibrary/djl/discussions/3357

ThiloteE commented 1 month ago

I think this documentation would be relevant for your question: https://docs.djl.ai/docs/load_model.html

calixtus commented 1 month ago

Thanks for investigating @ThiloteE !

InAnYan commented 1 month ago

Models available in Model Zoo of Deep Java Library (meaning they are stored. probably, on their servers and it's easy to load them):

List of models in Model Zoo ``` [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/inkoziev/sbert_pq/0.0.1/sbert_pq {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/facebook-dpr-ctx_encoder-multiset-base/0.0.1/facebook-dpr-ctx_encoder-multiset-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/uer/sbert-base-chinese-nli/0.0.1/sbert-base-chinese-nli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/RIOLITE/products_matching_aumet_fine_tune_2023-08-22/0.0.1/products_matching_aumet_fine_tune_2023-08-22 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/stsb-bert-large/0.0.1/stsb-bert-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/jegormeister/bert-base-dutch-cased-snli/0.0.1/bert-base-dutch-cased-snli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/BAAI/bge-large-en-v1.5/0.0.1/bge-large-en-v1.5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/obrizum/all-MiniLM-L6-v2/0.0.1/all-MiniLM-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/Seznam/retromae-small-cs/0.0.1/retromae-small-cs {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/pritamdeka/S-PubMedBert-MS-MARCO-SCIFACT/0.0.1/S-PubMedBert-MS-MARCO-SCIFACT {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/setu4993/LEALLA-large/0.0.1/LEALLA-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/efederici/multilingual-e5-small-4096/0.0.1/multilingual-e5-small-4096 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/medmediani/Arabic-KW-Mdel/0.0.1/Arabic-KW-Mdel {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/facebook-dpr-question_encoder-single-nq-base/0.0.1/facebook-dpr-question_encoder-single-nq-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/thenlper/gte-base-zh/0.0.1/gte-base-zh {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/GanymedeNil/text2vec-large-chinese/0.0.1/text2vec-large-chinese {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/paraphrase-MiniLM-L6-v2/0.0.1/paraphrase-MiniLM-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-small-v2/0.0.1/e5-small-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/ToolBench/ToolBench_IR_bert_based_uncased/0.0.1/ToolBench_IR_bert_based_uncased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/paraphrase-TinyBERT-L6-v2/0.0.1/paraphrase-TinyBERT-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/TurkuNLP/sbert-cased-finnish-paraphrase/0.0.1/sbert-cased-finnish-paraphrase {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/cointegrated/LaBSE-en-ru/0.0.1/LaBSE-en-ru {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/snunlp/KR-SBERT-V40K-klueNLI-augSTS/0.0.1/KR-SBERT-V40K-klueNLI-augSTS {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/denaya/indoSBERT-large/0.0.1/indoSBERT-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/ipipan/silver-retriever-base-v1/0.0.1/silver-retriever-base-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/multi-qa-MiniLM-L6-dot-v1/0.0.1/multi-qa-MiniLM-L6-dot-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/hiiamsid/sentence_similarity_spanish_es/0.0.1/sentence_similarity_spanish_es {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/shibing624/text2vec-base-multilingual/0.0.1/text2vec-base-multilingual {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/whaleloops/phrase-bert/0.0.1/phrase-bert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/alfaneo/jurisbert-base-portuguese-sts/0.0.1/jurisbert-base-portuguese-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/embaas/sentence-transformers-e5-large-v2/0.0.1/sentence-transformers-e5-large-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/firqaaa/indo-sentence-bert-base/0.0.1/indo-sentence-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/msmarco-MiniLM-L6-cos-v5/0.0.1/msmarco-MiniLM-L6-cos-v5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/paraphrase-MiniLM-L3-v2/0.0.1/paraphrase-MiniLM-L3-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/all-MiniLM-L6-v1/0.0.1/all-MiniLM-L6-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/KBLab/sentence-bert-swedish-cased/0.0.1/sentence-bert-swedish-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/PM-AI/bi-encoder_msmarco_bert-base_german/0.0.1/bi-encoder_msmarco_bert-base_german {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/flax-sentence-embeddings/multi-qa_v1-MiniLM-L6-cls_dot/0.0.1/multi-qa_v1-MiniLM-L6-cls_dot {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-base-unsupervised/0.0.1/e5-base-unsupervised {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/thenlper/gte-large-zh/0.0.1/gte-large-zh {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/flax-sentence-embeddings/all_datasets_v3_MiniLM-L12/0.0.1/all_datasets_v3_MiniLM-L12 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/msmarco-bert-co-condensor/0.0.1/msmarco-bert-co-condensor {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/Blaxzter/LaBSE-sentence-embeddings/0.0.1/LaBSE-sentence-embeddings {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/hiiamsid/sentence_similarity_hindi/0.0.1/sentence_similarity_hindi {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/textgain/allnli-GroNLP-bert-base-dutch-cased/0.0.1/allnli-GroNLP-bert-base-dutch-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/nli-bert-base/0.0.1/nli-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/paraphrase-MiniLM-L12-v2/0.0.1/paraphrase-MiniLM-L12-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sonoisa/sentence-bert-base-ja-mean-tokens-v2/0.0.1/sentence-bert-base-ja-mean-tokens-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/infgrad/stella-large-zh-v2/0.0.1/stella-large-zh-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/bert-base-nli-mean-tokens/0.0.1/bert-base-nli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/msmarco-MiniLM-L12-cos-v5/0.0.1/msmarco-MiniLM-L12-cos-v5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/jhgan/ko-sbert-multitask/0.0.1/ko-sbert-multitask {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/BAAI/bge-base-zh-v1.5/0.0.1/bge-base-zh-v1.5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/pritamdeka/S-PubMedBert-MS-MARCO/0.0.1/S-PubMedBert-MS-MARCO {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/bert-base-nli-stsb-mean-tokens/0.0.1/bert-base-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/Jerado/all-MiniLM-L6-v2-finetuned/0.0.1/all-MiniLM-L6-v2-finetuned {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/pritamdeka/BioBERT-mnli-snli-scinli-scitail-mednli-stsb/0.0.1/BioBERT-mnli-snli-scinli-scitail-mednli-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/setu4993/LaBSE/0.0.1/LaBSE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/stsb-bert-base/0.0.1/stsb-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/0.0.1/paraphrase-multilingual-MiniLM-L12-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/bert-large-nli-stsb-mean-tokens/0.0.1/bert-large-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/inokufu/bert-base-uncased-xnli-sts-finetuned-education/0.0.1/bert-base-uncased-xnli-sts-finetuned-education {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/naufalihsan/indonesian-sbert-large/0.0.1/indonesian-sbert-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/bert-base-wikipedia-sections-mean-tokens/0.0.1/bert-base-wikipedia-sections-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/Voicelab/sbert-base-cased-pl/0.0.1/sbert-base-cased-pl {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/caskcsg/cotmae_base_msmarco_retriever/0.0.1/cotmae_base_msmarco_retriever {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/msmarco-MiniLM-L-6-v3/0.0.1/msmarco-MiniLM-L-6-v3 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/GanymedeNil/text2vec-base-chinese/0.0.1/text2vec-base-chinese {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/NeuML/pubmedbert-base-embeddings/0.0.1/pubmedbert-base-embeddings {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/Voicelab/sbert-large-cased-pl/0.0.1/sbert-large-cased-pl {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/efederici/sentence-bert-base/0.0.1/sentence-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/bert-large-nli-mean-tokens/0.0.1/bert-large-nli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/infgrad/stella-base-zh-v2/0.0.1/stella-base-zh-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/bert-base-nli-cls-token/0.0.1/bert-base-nli-cls-token {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/menadsa/S-PubMedBERT/0.0.1/S-PubMedBERT {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/jaimevera1107/all-MiniLM-L6-v2-similarity-es/0.0.1/all-MiniLM-L6-v2-similarity-es {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/BAAI/bge-small-en-v1.5/0.0.1/bge-small-en-v1.5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-base-v2/0.0.1/e5-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/NbAiLab/nb-sbert-base/0.0.1/nb-sbert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/stjiris/bert-large-portuguese-cased-legal-tsdae-gpl-nli-sts-MetaKD-v1/0.0.1/bert-large-portuguese-cased-legal-tsdae-gpl-nli-sts-MetaKD-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/cl-nagoya/sup-simcse-ja-base/0.0.1/sup-simcse-ja-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/l3cube-pune/hindi-sentence-similarity-sbert/0.0.1/hindi-sentence-similarity-sbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/pritamdeka/S-Bluebert-snli-multinli-stsb/0.0.1/S-Bluebert-snli-multinli-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/msmarco-MiniLM-L-12-v3/0.0.1/msmarco-MiniLM-L-12-v3 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/shibing624/text2vec-base-chinese/0.0.1/text2vec-base-chinese {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/TaylorAI/bge-micro-v2/0.0.1/bge-micro-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/zerohell/tinydpr-acc_0.315-bs_307/0.0.1/tinydpr-acc_0.315-bs_307 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/imvladikon/sentence-transformers-alephbert/0.0.1/sentence-transformers-alephbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/pritamdeka/S-BioBert-snli-multinli-stsb/0.0.1/S-BioBert-snli-multinli-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/valurank/MiniLM-L6-Keyword-Extraction/0.0.1/MiniLM-L6-Keyword-Extraction {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/shibing624/text2vec-bge-large-chinese/0.0.1/text2vec-bge-large-chinese {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/kamalkraj/BioSimCSE-BioLinkBERT-BASE/0.0.1/BioSimCSE-BioLinkBERT-BASE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/ryanlai/shibing624_text2vec-base-chinese-fine-tune-insurance_data/0.0.1/shibing624_text2vec-base-chinese-fine-tune-insurance_data {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/amu/tao/0.0.1/tao {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/tavakolih/all-MiniLM-L6-v2-pubmed-full/0.0.1/all-MiniLM-L6-v2-pubmed-full {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sap-ai-research/miCSE/0.0.1/miCSE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/emrecan/bert-base-turkish-cased-mean-nli-stsb-tr/0.0.1/bert-base-turkish-cased-mean-nli-stsb-tr {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/all-MiniLM-L12-v1/0.0.1/all-MiniLM-L12-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-large-unsupervised/0.0.1/e5-large-unsupervised {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/facebook-dpr-ctx_encoder-single-nq-base/0.0.1/facebook-dpr-ctx_encoder-single-nq-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/allenai-specter/0.0.1/allenai-specter {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/TurkuNLP/sbert-uncased-finnish-paraphrase/0.0.1/sbert-uncased-finnish-paraphrase {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/setu4993/smaller-LaBSE/0.0.1/smaller-LaBSE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/rufimelo/bert-large-portuguese-cased-sts/0.0.1/bert-large-portuguese-cased-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/setu4993/LEALLA-small/0.0.1/LEALLA-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/thenlper/gte-small-zh/0.0.1/gte-small-zh {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-small/0.0.1/e5-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/jmbrito/ptbr-similarity-e5-small/0.0.1/ptbr-similarity-e5-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/inkoziev/sbert_synonymy/0.0.1/sbert_synonymy {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/llmrails/ember-v1/0.0.1/ember-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/TaylorAI/bge-micro/0.0.1/bge-micro {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/dimitriz/st-greek-media-bert-base-uncased/0.0.1/st-greek-media-bert-base-uncased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/cointegrated/rubert-tiny2/0.0.1/rubert-tiny2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/jhgan/ko-sbert-sts/0.0.1/ko-sbert-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/EZlee/e-commerce-bert-base-multilingual-cased/0.0.1/e-commerce-bert-base-multilingual-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/nickprock/sentence-bert-base-italian-uncased/0.0.1/sentence-bert-base-italian-uncased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/with-madrid/with-e5-small-v2/0.0.1/with-e5-small-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/Seznam/simcse-dist-mpnet-czeng-cs-en/0.0.1/simcse-dist-mpnet-czeng-cs-en {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/ricardo-filho/bert-base-portuguese-cased-nli-assin-2/0.0.1/bert-base-portuguese-cased-nli-assin-2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/TaylorAI/gte-tiny/0.0.1/gte-tiny {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/multilingual-e5-small/0.0.1/multilingual-e5-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-base/0.0.1/e5-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/l3cube-pune/indic-sentence-bert-nli/0.0.1/indic-sentence-bert-nli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/thenlper/gte-large/0.0.1/gte-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/KDHyun08/TAACO_STS/0.0.1/TAACO_STS {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/mrp/simcse-model-m-bert-thai-cased/0.0.1/simcse-model-m-bert-thai-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/NYTK/sentence-transformers-experimental-hubert-hungarian/0.0.1/sentence-transformers-experimental-hubert-hungarian {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/BAAI/bge-base-en-v1.5/0.0.1/bge-base-en-v1.5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/deutsche-telekom/gbert-large-paraphrase-cosine/0.0.1/gbert-large-paraphrase-cosine {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/consciousAI/cai-lunaris-text-embeddings/0.0.1/cai-lunaris-text-embeddings {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/SeyedAli/Multilingual-Text-Semantic-Search-Siamese-BERT-V1/0.0.1/Multilingual-Text-Semantic-Search-Siamese-BERT-V1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/flax-sentence-embeddings/all_datasets_v4_MiniLM-L6/0.0.1/all_datasets_v4_MiniLM-L6 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/nickprock/sentence-bert-base-italian-xxl-uncased/0.0.1/sentence-bert-base-italian-xxl-uncased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/multi-qa-MiniLM-L6-cos-v1/0.0.1/multi-qa-MiniLM-L6-cos-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/amu/tao-8k/0.0.1/tao-8k {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/msmarco-bert-base-dot-v5/0.0.1/msmarco-bert-base-dot-v5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/Craig/paraphrase-MiniLM-L6-v2/0.0.1/paraphrase-MiniLM-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/thenlper/gte-small/0.0.1/gte-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/DMetaSoul/sbert-chinese-general-v1/0.0.1/sbert-chinese-general-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sonoisa/clip-vit-b-32-japanese-v1/0.0.1/clip-vit-b-32-japanese-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/DMetaSoul/sbert-chinese-general-v2/0.0.1/sbert-chinese-general-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/infgrad/stella-base-en-v2/0.0.1/stella-base-en-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/pkshatech/simcse-ja-bert-base-clcmlp/0.0.1/simcse-ja-bert-base-clcmlp {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/DataikuNLP/paraphrase-multilingual-MiniLM-L12-v2/0.0.1/paraphrase-multilingual-MiniLM-L12-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-large-v2/0.0.1/e5-large-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-small-unsupervised/0.0.1/e5-small-unsupervised {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/facebook-dpr-question_encoder-multiset-base/0.0.1/facebook-dpr-question_encoder-multiset-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/jhgan/ko-sbert-nli/0.0.1/ko-sbert-nli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/deutsche-telekom/gbert-large-paraphrase-euclidean/0.0.1/gbert-large-paraphrase-euclidean {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sangmini/msmarco-cotmae-MiniLM-L12_en-ko-ja/0.0.1/msmarco-cotmae-MiniLM-L12_en-ko-ja {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/espejelomar/sentece-embeddings-BETO/0.0.1/sentece-embeddings-BETO {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/intfloat/e5-large/0.0.1/e5-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/aari1995/German_Semantic_STS_V2/0.0.1/German_Semantic_STS_V2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/setu4993/LEALLA-base/0.0.1/LEALLA-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.rust/sentence-transformers/bert-large-nli-cls-token/0.0.1/bert-large-nli-cls-token {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/distilbert-multilingual-nli-stsb-quora-ranking/0.0.1/distilbert-multilingual-nli-stsb-quora-ranking {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sonoisa/sentence-bert-base-ja-en-mean-tokens/0.0.1/sentence-bert-base-ja-en-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/multi-qa-distilbert-dot-v1/0.0.1/multi-qa-distilbert-dot-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/setu4993/LEALLA-large/0.0.1/LEALLA-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-base-v4/0.0.1/msmarco-distilbert-base-v4 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-base-v3/0.0.1/msmarco-distilbert-base-v3 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-base-v2/0.0.1/msmarco-distilbert-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/all-mpnet-base-v2/0.0.1/all-mpnet-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Seznam/dist-mpnet-paracrawl-cs-en/0.0.1/dist-mpnet-paracrawl-cs-en {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/all-mpnet-base-v1/0.0.1/all-mpnet-base-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/FajnyKarton/st-polish-kartonberta-base-alpha-v1/0.0.1/st-polish-kartonberta-base-alpha-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/multilingual-e5-large/0.0.1/multilingual-e5-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/cointegrated/LaBSE-en-ru/0.0.1/LaBSE-en-ru {"ru":"true","en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/embaas/sentence-transformers-multilingual-e5-large/0.0.1/sentence-transformers-multilingual-e5-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/ipipan/silver-retriever-base-v1/0.0.1/silver-retriever-base-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/stsb-distilroberta-base-v2/0.0.1/stsb-distilroberta-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Sakil/sentence_similarity_semantic_search/0.0.1/sentence_similarity_semantic_search {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/shibing624/text2vec-base-multilingual/0.0.1/text2vec-base-multilingual {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/whaleloops/phrase-bert/0.0.1/phrase-bert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/firqaaa/indo-sentence-bert-base/0.0.1/indo-sentence-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-MiniLM-L6-cos-v5/0.0.1/msmarco-MiniLM-L6-cos-v5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-MiniLM-L3-v2/0.0.1/paraphrase-MiniLM-L3-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/LLukas22/paraphrase-multilingual-mpnet-base-v2-embedding-all/0.0.1/paraphrase-multilingual-mpnet-base-v2-embedding-all {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/KBLab/sentence-bert-swedish-cased/0.0.1/sentence-bert-swedish-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/thenlper/gte-large-zh/0.0.1/gte-large-zh {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-cos-v5/0.0.1/msmarco-distilbert-cos-v5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/cl-nagoya/unsup-simcse-ja-large/0.0.1/unsup-simcse-ja-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jhlee3421/faq-semantic-klue-roberta-large/0.0.1/faq-semantic-klue-roberta-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-base-nli-mean-tokens/0.0.1/bert-base-nli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pritamdeka/S-PubMedBert-MS-MARCO/0.0.1/S-PubMedBert-MS-MARCO {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Jerado/all-MiniLM-L6-v2-finetuned/0.0.1/all-MiniLM-L6-v2-finetuned {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/setu4993/LaBSE/0.0.1/LaBSE {"af":"true","am":"true","ar":"true","as":"true","az":"true","be":"true","bg":"true","bn":"true","bo":"true","bs":"true","ca":"true","co":"true","cs":"true","cy":"true","da":"true","de":"true","el":"true","en":"true","eo":"true","es":"true","et":"true","eu":"true","fa":"true","fi":"true","fr":"true","fy":"true","ga":"true","gd":"true","gl":"true","gu":"true","ha":"true","he":"true","hi":"true","hr":"true","ht":"true","hu":"true","hy":"true","id":"true","ig":"true","is":"true","it":"true","ja":"true","jv":"true","ka":"true","kk":"true","km":"true","kn":"true","ko":"true","ku":"true","ky":"true","la":"true","lb":"true","lo":"true","lt":"true","lv":"true","mg":"true","mi":"true","mk":"true","ml":"true","mn":"true","mr":"true","ms":"true","mt":"true","my":"true","ne":"true","nl":"true","no":"true","ny":"true","or":"true","pa":"true","pl":"true","pt":"true","ro":"true","ru":"true","rw":"true","si":"true","sk":"true","sl":"true","sm":"true","sn":"true","so":"true","sq":"true","sr":"true","st":"true","su":"true","sv":"true","sw":"true","ta":"true","te":"true","tg":"true","th":"true","tk":"true","tl":"true","tr":"true","tt":"true","ug":"true","uk":"true","ur":"true","uz":"true","vi":"true","wo":"true","xh":"true","yi":"true","yo":"true","zh":"true","zu":"true","multilingual":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/barisaydin/text2vec-base-multilingual/0.0.1/text2vec-base-multilingual {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/TimKoornstra/SAURON/0.0.1/SAURON {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-base-wikipedia-sections-mean-tokens/0.0.1/bert-base-wikipedia-sections-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/efederici/sentence-bert-base/0.0.1/sentence-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/woody72/multilingual-e5-base/0.0.1/multilingual-e5-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-base-v2/0.0.1/e5-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sdadas/mmlw-retrieval-e5-large/0.0.1/mmlw-retrieval-e5-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/distilbert-base-nli-stsb-quora-ranking/0.0.1/distilbert-base-nli-stsb-quora-ranking {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/l3cube-pune/hindi-sentence-similarity-sbert/0.0.1/hindi-sentence-similarity-sbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-MiniLM-L-12-v3/0.0.1/msmarco-MiniLM-L-12-v3 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/TaylorAI/bge-micro-v2/0.0.1/bge-micro-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/zerohell/tinydpr-acc_0.315-bs_307/0.0.1/tinydpr-acc_0.315-bs_307 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/nategro/parameter-mini-lds/0.0.1/parameter-mini-lds {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pritamdeka/S-BioBert-snli-multinli-stsb/0.0.1/S-BioBert-snli-multinli-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/cl-nagoya/sup-simcse-ja-large/0.0.1/sup-simcse-ja-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/lighteternal/stsb-xlm-r-greek-transfer/0.0.1/stsb-xlm-r-greek-transfer {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/stsb-xlm-r-multilingual/0.0.1/stsb-xlm-r-multilingual {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/facebook-dpr-ctx_encoder-single-nq-base/0.0.1/facebook-dpr-ctx_encoder-single-nq-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/stsb-distilbert-base/0.0.1/stsb-distilbert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/ef-zulla/e5-multi-sml-torch/0.0.1/e5-multi-sml-torch {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sdadas/st-polish-paraphrase-from-distilroberta/0.0.1/st-polish-paraphrase-from-distilroberta {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/antoinelouis/biencoder-camembert-base-mmarcoFR/0.0.1/biencoder-camembert-base-mmarcoFR {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/TaylorAI/bge-micro/0.0.1/bge-micro {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/keepitreal/vietnamese-sbert/0.0.1/vietnamese-sbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/with-madrid/with-e5-small-v2/0.0.1/with-e5-small-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/TaylorAI/gte-tiny/0.0.1/gte-tiny {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-base/0.0.1/e5-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/l3cube-pune/indic-sentence-bert-nli/0.0.1/indic-sentence-bert-nli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/mrp/simcse-model-m-bert-thai-cased/0.0.1/simcse-model-m-bert-thai-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Equall/english-beta-0.3/0.0.1/english-beta-0.3 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/nli-distilbert-base/0.0.1/nli-distilbert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilroberta-base-v2/0.0.1/msmarco-distilroberta-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/amu/tao-8k/0.0.1/tao-8k {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/thenlper/gte-small/0.0.1/gte-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/antoinelouis/biencoder-mMiniLMv2-L12-mmarcoFR/0.0.1/biencoder-mMiniLMv2-L12-mmarcoFR {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sonoisa/clip-vit-b-32-japanese-v1/0.0.1/clip-vit-b-32-japanese-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/DataikuNLP/paraphrase-multilingual-MiniLM-L12-v2/0.0.1/paraphrase-multilingual-MiniLM-L12-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-large-nli-max-tokens/0.0.1/bert-large-nli-max-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/roberta-large-nli-stsb-mean-tokens/0.0.1/roberta-large-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/dangvantuan/CrossEncoder-camembert-large/0.0.1/CrossEncoder-camembert-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-small-unsupervised/0.0.1/e5-small-unsupervised {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/deutsche-telekom/gbert-large-paraphrase-euclidean/0.0.1/gbert-large-paraphrase-euclidean {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/hackathon-pln-es/paraphrase-spanish-distilroberta/0.0.1/paraphrase-spanish-distilroberta {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-large-nli-cls-token/0.0.1/bert-large-nli-cls-token {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/uaritm/multilingual_en_uk_pl_ru/0.0.1/multilingual_en_uk_pl_ru {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/inkoziev/sbert_pq/0.0.1/sbert_pq {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/facebook-dpr-ctx_encoder-multiset-base/0.0.1/facebook-dpr-ctx_encoder-multiset-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pierluigic/xl-lexeme/0.0.1/xl-lexeme {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/obrizum/all-MiniLM-L6-v2/0.0.1/all-MiniLM-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-albert-base-v2/0.0.1/paraphrase-albert-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/medmediani/Arabic-KW-Mdel/0.0.1/Arabic-KW-Mdel {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/roberta-large-nli-mean-tokens/0.0.1/roberta-large-nli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/mrp/SCT_Distillation_BERT_Small/0.0.1/SCT_Distillation_BERT_Small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/LaBSE/0.0.1/LaBSE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-multilingual-en-de-v2-tmp-lng-aligned/0.0.1/msmarco-distilbert-multilingual-en-de-v2-tmp-lng-aligned {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/facebook-dpr-question_encoder-single-nq-base/0.0.1/facebook-dpr-question_encoder-single-nq-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/DrSebastianK/medbedding/0.0.1/medbedding {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-MiniLM-L6-v2/0.0.1/paraphrase-MiniLM-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/stsb-roberta-base-v2/0.0.1/stsb-roberta-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/ToolBench/ToolBench_IR_bert_based_uncased/0.0.1/ToolBench_IR_bert_based_uncased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-TinyBERT-L6-v2/0.0.1/paraphrase-TinyBERT-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/TurkuNLP/sbert-cased-finnish-paraphrase/0.0.1/sbert-cased-finnish-paraphrase {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/symanto/sn-xlm-roberta-base-snli-mnli-anli-xnli/0.0.1/sn-xlm-roberta-base-snli-mnli-anli-xnli {"ar":"true","bg":"true","de":"true","el":"true","en":"true","es":"true","fr":"true","ru":"true","th":"true","tr":"true","ur":"true","vn":"true","zh":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/roberta-base-nli-stsb-mean-tokens/0.0.1/roberta-base-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/snunlp/KR-SBERT-V40K-klueNLI-augSTS/0.0.1/KR-SBERT-V40K-klueNLI-augSTS {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/denaya/indoSBERT-large/0.0.1/indoSBERT-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/multi-qa-MiniLM-L6-dot-v1/0.0.1/multi-qa-MiniLM-L6-dot-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/alfaneo/jurisbert-base-portuguese-sts/0.0.1/jurisbert-base-portuguese-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/embaas/sentence-transformers-e5-large-v2/0.0.1/sentence-transformers-e5-large-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/PM-AI/bi-encoder_msmarco_bert-base_german/0.0.1/bi-encoder_msmarco_bert-base_german {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/flax-sentence-embeddings/all_datasets_v3_MiniLM-L12/0.0.1/all_datasets_v3_MiniLM-L12 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sonoisa/sentence-bert-base-ja-mean-tokens/0.0.1/sentence-bert-base-ja-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/ys7yoo/sentence-roberta-large-kor-sts/0.0.1/sentence-roberta-large-kor-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/metarank/ce-esci-MiniLM-L12-v2/0.0.1/ce-esci-MiniLM-L12-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-large-nli-stsb-mean-tokens/0.0.1/bert-large-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/aditeyabaral/sentencetransformer-bert-base-cased/0.0.1/sentencetransformer-bert-base-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/multi-qa-distilbert-cos-v1/0.0.1/multi-qa-distilbert-cos-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/daekeun-ml/koelectra-small-v3-korsts/0.0.1/koelectra-small-v3-korsts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/distilbert-base-nli-mean-tokens/0.0.1/distilbert-base-nli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/naufalihsan/indonesian-sbert-large/0.0.1/indonesian-sbert-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pritamdeka/S-Biomed-Roberta-snli-multinli-stsb/0.0.1/S-Biomed-Roberta-snli-multinli-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Voicelab/sbert-large-cased-pl/0.0.1/sbert-large-cased-pl {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-large-nli-mean-tokens/0.0.1/bert-large-nli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/infgrad/stella-base-zh-v2/0.0.1/stella-base-zh-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/dangvantuan/sentence-camembert-base/0.0.1/sentence-camembert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/recobo/chemical-bert-uncased-simcse/0.0.1/chemical-bert-uncased-simcse {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/dangvantuan/sentence-camembert-large/0.0.1/sentence-camembert-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/d0rj/e5-base-en-ru/0.0.1/e5-base-en-ru {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/bkai-foundation-models/vietnamese-bi-encoder/0.0.1/vietnamese-bi-encoder {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/nli-bert-large-max-pooling/0.0.1/nli-bert-large-max-pooling {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/anatel/bert-augmented-pt-anatel/0.0.1/bert-augmented-pt-anatel {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sadakmed/distiluse-base-multilingual-cased-v2/0.0.1/distiluse-base-multilingual-cased-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sadakmed/distiluse-base-multilingual-cased-v1/0.0.1/distiluse-base-multilingual-cased-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/amu/tao/0.0.1/tao {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sap-ai-research/miCSE/0.0.1/miCSE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Sunkyum/faq-semantic-bert-base/0.0.1/faq-semantic-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/VoVanPhuc/sup-SimCSE-VietNamese-phobert-base/0.0.1/sup-SimCSE-VietNamese-phobert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/efederici/e5-base-multilingual-4096/0.0.1/e5-base-multilingual-4096 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/distiluse-base-multilingual-cased-v1/0.0.1/distiluse-base-multilingual-cased-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/allenai-specter/0.0.1/allenai-specter {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/rufimelo/bert-large-portuguese-cased-sts/0.0.1/bert-large-portuguese-cased-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/setu4993/LEALLA-small/0.0.1/LEALLA-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-small/0.0.1/e5-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jhgan/ko-sroberta-multitask/0.0.1/ko-sroberta-multitask {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-xlm-r-multilingual-v1/0.0.1/paraphrase-xlm-r-multilingual-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/l3cube-pune/tamil-sentence-bert-nli/0.0.1/tamil-sentence-bert-nli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/NetherlandsForensicInstitute/robbert-2022-dutch-sentence-transformers/0.0.1/robbert-2022-dutch-sentence-transformers {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/inkoziev/sbert_synonymy/0.0.1/sbert_synonymy {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/imta-ai/tech_sbert/0.0.1/tech_sbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Research2NLP/electrical_stella/0.0.1/electrical_stella {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/dimitriz/st-greek-media-bert-base-uncased/0.0.1/st-greek-media-bert-base-uncased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/ddobokki/electra-small-nli-sts/0.0.1/electra-small-nli-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/KDHyun08/TAACO_STS/0.0.1/TAACO_STS {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/NYTK/sentence-transformers-experimental-hubert-hungarian/0.0.1/sentence-transformers-experimental-hubert-hungarian {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/nathansutton/explicit-recommendation/0.0.1/explicit-recommendation {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/uaritm/multilingual_en_ru_uk/0.0.1/multilingual_en_ru_uk {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-roberta-base-v2/0.0.1/msmarco-roberta-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-roberta-base-v3/0.0.1/msmarco-roberta-base-v3 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/deutsche-telekom/gbert-large-paraphrase-cosine/0.0.1/gbert-large-paraphrase-cosine {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/consciousAI/cai-lunaris-text-embeddings/0.0.1/cai-lunaris-text-embeddings {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/joseluhf11/symptom_encoder_v10/0.0.1/symptom_encoder_v10 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/nickprock/sentence-bert-base-italian-xxl-uncased/0.0.1/sentence-bert-base-italian-xxl-uncased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/all-distilroberta-v1/0.0.1/all-distilroberta-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/bongsoo/kpf-sbert-v1.1/0.0.1/kpf-sbert-v1.1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-bert-base-dot-v5/0.0.1/msmarco-bert-base-dot-v5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/embedding-data/distilroberta-base-sentence-transformer/0.0.1/distilroberta-base-sentence-transformer {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/biu-nlp/abstract-sim-query-pubmed/0.0.1/abstract-sim-query-pubmed {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/infgrad/stella-base-en-v2/0.0.1/stella-base-en-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pkshatech/simcse-ja-bert-base-clcmlp/0.0.1/simcse-ja-bert-base-clcmlp {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-base-dot-prod-v3/0.0.1/msmarco-distilbert-base-dot-prod-v3 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/facebook-dpr-question_encoder-multiset-base/0.0.1/facebook-dpr-question_encoder-multiset-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/aari1995/German_Semantic_STS_V2/0.0.1/German_Semantic_STS_V2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/OctopusMind/longbert-8k-zh/0.0.1/longbert-8k-zh {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jegormeister/bert-base-dutch-cased-snli/0.0.1/bert-base-dutch-cased-snli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/yunyu/sentence-transformers-e5-small-v2/0.0.1/sentence-transformers-e5-small-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/BAAI/bge-large-en-v1.5/0.0.1/bge-large-en-v1.5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jinaai/jina-embeddings-v2-small-en/0.0.1/jina-embeddings-v2-small-en {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-roberta-base-ance-firstp/0.0.1/msmarco-roberta-base-ance-firstp {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/l3cube-pune/malayalam-sentence-similarity-sbert/0.0.1/malayalam-sentence-similarity-sbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/bespin-global/klue-sentence-roberta-base-kornlu/0.0.1/klue-sentence-roberta-base-kornlu {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/thenlper/gte-base-zh/0.0.1/gte-base-zh {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/GanymedeNil/text2vec-large-chinese/0.0.1/text2vec-large-chinese {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-base-tas-b/0.0.1/msmarco-distilbert-base-tas-b {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/quora-distilbert-base/0.0.1/quora-distilbert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/recobo/chemical-bert-uncased-tsdae/0.0.1/chemical-bert-uncased-tsdae {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/hiiamsid/sentence_similarity_spanish_es/0.0.1/sentence_similarity_spanish_es {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/d0rj/e5-large-en-ru/0.0.1/e5-large-en-ru {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-base-unsupervised/0.0.1/e5-base-unsupervised {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/antoinelouis/biencoder-MiniLM-L6-all-v2-mmarcoFR/0.0.1/biencoder-MiniLM-L6-all-v2-mmarcoFR {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-bert-co-condensor/0.0.1/msmarco-bert-co-condensor {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Blaxzter/LaBSE-sentence-embeddings/0.0.1/LaBSE-sentence-embeddings {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/nli-bert-base/0.0.1/nli-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/stsb-roberta-large/0.0.1/stsb-roberta-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sonoisa/sentence-bert-base-ja-mean-tokens-v2/0.0.1/sentence-bert-base-ja-mean-tokens-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/BAAI/bge-base-zh-v1.5/0.0.1/bge-base-zh-v1.5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pritamdeka/BioBERT-mnli-snli-scinli-scitail-mednli-stsb/0.0.1/BioBERT-mnli-snli-scinli-scitail-mednli-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/nli-roberta-base-v2/0.0.1/nli-roberta-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/AIDA-UPM/mstsb-paraphrase-multilingual-mpnet-base-v2/0.0.1/mstsb-paraphrase-multilingual-mpnet-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/use-cmlm-multilingual/0.0.1/use-cmlm-multilingual {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-base-nli-cls-token/0.0.1/bert-base-nli-cls-token {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/flax-sentence-embeddings/st-codesearch-distilroberta-base/0.0.1/st-codesearch-distilroberta-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jaimevera1107/all-MiniLM-L6-v2-similarity-es/0.0.1/all-MiniLM-L6-v2-similarity-es {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/BAAI/bge-small-en-v1.5/0.0.1/bge-small-en-v1.5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/NbAiLab/nb-sbert-base/0.0.1/nb-sbert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/cl-nagoya/sup-simcse-ja-base/0.0.1/sup-simcse-ja-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pritamdeka/S-Bluebert-snli-multinli-stsb/0.0.1/S-Bluebert-snli-multinli-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/shibing624/text2vec-base-chinese/0.0.1/text2vec-base-chinese {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/VoVanPhuc/bge-base-vi/0.0.1/bge-base-vi {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/mchochlov/codebert-base-cd-ft/0.0.1/codebert-base-cd-ft {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/embaas/sentence-transformers-multilingual-e5-base/0.0.1/sentence-transformers-multilingual-e5-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/quora-distilbert-multilingual/0.0.1/quora-distilbert-multilingual {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/imvladikon/sentence-transformers-alephbert/0.0.1/sentence-transformers-alephbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/all-roberta-large-v1/0.0.1/all-roberta-large-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/clips/mfaq/0.0.1/mfaq {"cs":"true","da":"true","de":"true","en":"true","es":"true","fi":"true","fr":"true","he":"true","hr":"true","hu":"true","id":"true","it":"true","nl":"true","no":"true","pl":"true","pt":"true","ro":"true","ru":"true","sv":"true","tr":"true","vi":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/kaiserrr/pmc-vit-l-14-multilingual/0.0.1/pmc-vit-l-14-multilingual {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/shibing624/text2vec-bge-large-chinese/0.0.1/text2vec-bge-large-chinese {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/tavakolih/all-MiniLM-L6-v2-pubmed-full/0.0.1/all-MiniLM-L6-v2-pubmed-full {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/antoinelouis/crossencoder-mMiniLMv2-L12-mmarcoFR/0.0.1/crossencoder-mMiniLMv2-L12-mmarcoFR {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-distilroberta-base-v2/0.0.1/paraphrase-distilroberta-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/all-MiniLM-L12-v2/0.0.1/all-MiniLM-L12-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/all-MiniLM-L12-v1/0.0.1/all-MiniLM-L12-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Hum-Works/lodestone-base-4096-v1/0.0.1/lodestone-base-4096-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/setu4993/smaller-LaBSE/0.0.1/smaller-LaBSE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/thenlper/gte-small-zh/0.0.1/gte-small-zh {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jmbrito/ptbr-similarity-e5-small/0.0.1/ptbr-similarity-e5-small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/digio/Twitter4SSE/0.0.1/Twitter4SSE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/llmrails/ember-v1/0.0.1/ember-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/kornwtp/ConGen-paraphrase-multilingual-mpnet-base-v2/0.0.1/ConGen-paraphrase-multilingual-mpnet-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/AnnaWegmann/Style-Embedding/0.0.1/Style-Embedding {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jhgan/ko-sroberta-sts/0.0.1/ko-sroberta-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/nickprock/sentence-bert-base-italian-uncased/0.0.1/sentence-bert-base-italian-uncased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Seznam/simcse-dist-mpnet-czeng-cs-en/0.0.1/simcse-dist-mpnet-czeng-cs-en {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/ricardo-filho/bert-base-portuguese-cased-nli-assin-2/0.0.1/bert-base-portuguese-cased-nli-assin-2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/thenlper/gte-large/0.0.1/gte-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/ddobokki/klue-roberta-small-nli-sts/0.0.1/klue-roberta-small-nli-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/BAAI/bge-base-en-v1.5/0.0.1/bge-base-en-v1.5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pritamdeka/PubMedBERT-mnli-snli-scinli-scitail-mednli-stsb/0.0.1/PubMedBERT-mnli-snli-scinli-scitail-mednli-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Lajavaness/CrossEncoder-camembert-large/0.0.1/CrossEncoder-camembert-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/SeyedAli/Multilingual-Text-Semantic-Search-Siamese-BERT-V1/0.0.1/Multilingual-Text-Semantic-Search-Siamese-BERT-V1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/stsb-roberta-base/0.0.1/stsb-roberta-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/nq-distilbert-base-v1/0.0.1/nq-distilbert-base-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/efederici/cross-encoder-umberto-stsb/0.0.1/cross-encoder-umberto-stsb {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/m3hrdadfi/bert-zwnj-wnli-mean-tokens/0.0.1/bert-zwnj-wnli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Craig/paraphrase-MiniLM-L6-v2/0.0.1/paraphrase-MiniLM-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/DMetaSoul/sbert-chinese-general-v1/0.0.1/sbert-chinese-general-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/DMetaSoul/sbert-chinese-general-v2/0.0.1/sbert-chinese-general-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/xlm-r-distilroberta-base-paraphrase-v1/0.0.1/xlm-r-distilroberta-base-paraphrase-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/meedan/paraphrase-filipino-mpnet-base-v2/0.0.1/paraphrase-filipino-mpnet-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/abbasgolestani/ag-nli-DeTS-sentence-similarity-v1/0.0.1/ag-nli-DeTS-sentence-similarity-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/espejelomar/sentece-embeddings-BETO/0.0.1/sentece-embeddings-BETO {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/cmarkea/distilcamembert-base-nli/0.0.1/distilcamembert-base-nli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/uer/sbert-base-chinese-nli/0.0.1/sbert-base-chinese-nli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/RIOLITE/products_matching_aumet_fine_tune_2023-08-22/0.0.1/products_matching_aumet_fine_tune_2023-08-22 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/stsb-bert-large/0.0.1/stsb-bert-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/antoinelouis/crossencoder-camembert-base-mmarcoFR/0.0.1/crossencoder-camembert-base-mmarcoFR {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/multilingual-e5-base/0.0.1/multilingual-e5-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/nli-roberta-large/0.0.1/nli-roberta-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/pritamdeka/S-PubMedBert-MS-MARCO-SCIFACT/0.0.1/S-PubMedBert-MS-MARCO-SCIFACT {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Seznam/retromae-small-cs/0.0.1/retromae-small-cs {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/efederici/multilingual-e5-small-4096/0.0.1/multilingual-e5-small-4096 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/omarelsayeed/Search_Model_PRECHATS_AUGMENTED/0.0.1/Search_Model_PRECHATS_AUGMENTED {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/kmariunas/uncased-bert-triplet-40/0.0.1/uncased-bert-triplet-40 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-small-v2/0.0.1/e5-small-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-multilingual-en-de-v2-tmp-trained-scratch/0.0.1/msmarco-distilbert-multilingual-en-de-v2-tmp-trained-scratch {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/xlm-r-bert-base-nli-stsb-mean-tokens/0.0.1/xlm-r-bert-base-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/dean-ai/legal_heBERT_ft/0.0.1/legal_heBERT_ft {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/all-MiniLM-L6-v2/0.0.1/all-MiniLM-L6-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/all-MiniLM-L6-v1/0.0.1/all-MiniLM-L6-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/flax-sentence-embeddings/multi-qa_v1-MiniLM-L6-cls_dot/0.0.1/multi-qa_v1-MiniLM-L6-cls_dot {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/hiiamsid/sentence_similarity_hindi/0.0.1/sentence_similarity_hindi {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/textgain/allnli-GroNLP-bert-base-dutch-cased/0.0.1/allnli-GroNLP-bert-base-dutch-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-MiniLM-L12-v2/0.0.1/paraphrase-MiniLM-L12-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/infgrad/stella-large-zh-v2/0.0.1/stella-large-zh-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-MiniLM-L12-cos-v5/0.0.1/msmarco-MiniLM-L12-cos-v5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jhgan/ko-sbert-multitask/0.0.1/ko-sbert-multitask {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/roberta-base-nli-mean-tokens/0.0.1/roberta-base-nli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-base-nli-stsb-mean-tokens/0.0.1/bert-base-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/stsb-bert-base/0.0.1/stsb-bert-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/0.0.1/paraphrase-multilingual-MiniLM-L12-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/bert-base-nli-max-tokens/0.0.1/bert-base-nli-max-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/s-nlp/rubert-base-cased-conversational-paraphrase-v1/0.0.1/rubert-base-cased-conversational-paraphrase-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/inokufu/bert-base-uncased-xnli-sts-finetuned-education/0.0.1/bert-base-uncased-xnli-sts-finetuned-education {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jinaai/jina-embedding-t-en-v1/0.0.1/jina-embedding-t-en-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/Voicelab/sbert-base-cased-pl/0.0.1/sbert-base-cased-pl {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/caskcsg/cotmae_base_msmarco_retriever/0.0.1/cotmae_base_msmarco_retriever {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-MiniLM-L-6-v3/0.0.1/msmarco-MiniLM-L-6-v3 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/NeuML/pubmedbert-base-embeddings/0.0.1/pubmedbert-base-embeddings {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/GanymedeNil/text2vec-base-chinese/0.0.1/text2vec-base-chinese {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/brjezierski/sentence-embeddings-similarity/0.0.1/sentence-embeddings-similarity {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/msmarco-distilbert-dot-v5/0.0.1/msmarco-distilbert-dot-v5 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/tekraj/avodamed-synonym-generator1/0.0.1/avodamed-synonym-generator1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/biu-nlp/abstract-sim-sentence-pubmed/0.0.1/abstract-sim-sentence-pubmed {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/menadsa/S-PubMedBERT/0.0.1/S-PubMedBERT {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-multilingual-mpnet-base-v2/0.0.1/paraphrase-multilingual-mpnet-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/nli-distilroberta-base-v2/0.0.1/nli-distilroberta-base-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/kornwtp/ConGen-WangchanBERT-Small/0.0.1/ConGen-WangchanBERT-Small {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/stjiris/bert-large-portuguese-cased-legal-tsdae-gpl-nli-sts-MetaKD-v1/0.0.1/bert-large-portuguese-cased-legal-tsdae-gpl-nli-sts-MetaKD-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/paraphrase-albert-small-v2/0.0.1/paraphrase-albert-small-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/xlm-r-100langs-bert-base-nli-stsb-mean-tokens/0.0.1/xlm-r-100langs-bert-base-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/valurank/MiniLM-L6-Keyword-Extraction/0.0.1/MiniLM-L6-Keyword-Extraction {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/m3hrdadfi/roberta-zwnj-wnli-mean-tokens/0.0.1/roberta-zwnj-wnli-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/kamalkraj/BioSimCSE-BioLinkBERT-BASE/0.0.1/BioSimCSE-BioLinkBERT-BASE {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/ryanlai/shibing624_text2vec-base-chinese-fine-tune-insurance_data/0.0.1/shibing624_text2vec-base-chinese-fine-tune-insurance_data {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/emrecan/bert-base-turkish-cased-mean-nli-stsb-tr/0.0.1/bert-base-turkish-cased-mean-nli-stsb-tr {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/clip-ViT-B-32-multilingual-v1/0.0.1/clip-ViT-B-32-multilingual-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/smart-tribune/sentence-transformers-multilingual-e5-large/0.0.1/sentence-transformers-multilingual-e5-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-large-unsupervised/0.0.1/e5-large-unsupervised {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/TurkuNLP/sbert-uncased-finnish-paraphrase/0.0.1/sbert-uncased-finnish-paraphrase {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/HgThinker/vietnamese-sbert/0.0.1/vietnamese-sbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/dennlinger/bert-wiki-paragraphs/0.0.1/bert-wiki-paragraphs {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/cointegrated/rubert-tiny2/0.0.1/rubert-tiny2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jhgan/ko-sbert-sts/0.0.1/ko-sbert-sts {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/EZlee/e-commerce-bert-base-multilingual-cased/0.0.1/e-commerce-bert-base-multilingual-cased {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/multilingual-e5-small/0.0.1/multilingual-e5-small {"multilingual":"true","af":"true","am":"true","ar":"true","as":"true","az":"true","be":"true","bg":"true","bn":"true","br":"true","bs":"true","ca":"true","cs":"true","cy":"true","da":"true","de":"true","el":"true","en":"true","eo":"true","es":"true","et":"true","eu":"true","fa":"true","fi":"true","fr":"true","fy":"true","ga":"true","gd":"true","gl":"true","gu":"true","ha":"true","he":"true","hi":"true","hr":"true","hu":"true","hy":"true","id":"true","is":"true","it":"true","ja":"true","jv":"true","ka":"true","kk":"true","km":"true","kn":"true","ko":"true","ku":"true","ky":"true","la":"true","lo":"true","lt":"true","lv":"true","mg":"true","mk":"true","ml":"true","mn":"true","mr":"true","ms":"true","my":"true","ne":"true","nl":"true","no":"true","om":"true","or":"true","pa":"true","pl":"true","ps":"true","pt":"true","ro":"true","ru":"true","sa":"true","sd":"true","si":"true","sk":"true","sl":"true","so":"true","sq":"true","sr":"true","su":"true","sv":"true","sw":"true","ta":"true","te":"true","th":"true","tl":"true","tr":"true","ug":"true","uk":"true","ur":"true","uz":"true","vi":"true","xh":"true","yi":"true","zh":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jegormeister/robbert-v2-dutch-base-mqa-finetuned/0.0.1/robbert-v2-dutch-base-mqa-finetuned {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/cointegrated/rubert-base-cased-dp-paraphrase-detection/0.0.1/rubert-base-cased-dp-paraphrase-detection {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/stjiris/bert-large-portuguese-cased-legal-tsdae-gpl-nli-sts-v1/0.0.1/bert-large-portuguese-cased-legal-tsdae-gpl-nli-sts-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/l3cube-pune/marathi-sentence-similarity-sbert/0.0.1/marathi-sentence-similarity-sbert {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sdadas/st-polish-paraphrase-from-mpnet/0.0.1/st-polish-paraphrase-from-mpnet {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/colorfulscoop/sbert-base-ja/0.0.1/sbert-base-ja {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/flax-sentence-embeddings/all_datasets_v4_MiniLM-L6/0.0.1/all_datasets_v4_MiniLM-L6 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/multi-qa-MiniLM-L6-cos-v1/0.0.1/multi-qa-MiniLM-L6-cos-v1 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sentence-transformers/distilbert-base-nli-stsb-mean-tokens/0.0.1/distilbert-base-nli-stsb-mean-tokens {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-large-v2/0.0.1/e5-large-v2 {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/jhgan/ko-sbert-nli/0.0.1/ko-sbert-nli {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/sangmini/msmarco-cotmae-MiniLM-L12_en-ko-ja/0.0.1/msmarco-cotmae-MiniLM-L12_en-ko-ja {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/intfloat/e5-large/0.0.1/e5-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/flax-sentence-embeddings/all_datasets_v3_roberta-large/0.0.1/all_datasets_v3_roberta-large {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/setu4993/LEALLA-base/0.0.1/LEALLA-base {"en":"true"} [INFO ] - NLP.TEXT_EMBEDDING ai.djl.huggingface.pytorch/cointegrated/rubert-tiny/0.0.1/rubert-tiny {"ru":"true","en":"true"} ```

If the model is not in this list, we still can download it manually and run. Though, I currently investigating how to do this

InAnYan commented 1 month ago

@ThiloteE what do you think of https://huggingface.co/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 ?

Seems like a continuation of what we are currently using, but for many languages

ThiloteE commented 1 month ago

You have noticed, that this model is from 2021, right? There must be better. Maybe, if push comes to shove and there is no other model in that size. Edit: I have added the model to the list.

ThiloteE commented 3 days ago

How to add an embedding model to the Deep Java Library model zoo: https://djl.ai/docs/development/add_model_to_model-zoo.html

koppor commented 3 days ago

Steps to close this issue:

  1. Bring paraphrase-multilingual-MiniLM-L12-v2 into JabRef. --> @Ruslan
  2. Write down test instructions for model paraphrase-multilingual-MiniLM-L12-v2 - and test w/ Chocolate.bib - and use the tests at https://blog.jabref.org/2024/08/21/AI-chatting/#ai-chat. - @ThiloteE
  3. Bring all other above models in JabRef - @InAnYan
  4. Depending in (2) --> Make model paraphrase-multilingual-MiniLM-L12-v2 default in JabRef. - @InAnYan
  5. Change documentation (how to switch models --> recommend the other ones and make some guidelines for users) - @ThiloteE

Follow-up: Write down documentation how to bring in a new model into DJL (if the link at https://github.com/InAnYan/jabref/issues/85#issuecomment-2329160668 is not enough - and updating the dependency).