feature Improvement about sentence_transformers(embedding,Reranker) - Githubissues

denser-org / denser-retriever

An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.

https://retriever.denser.ai

MIT License

219 stars 27 forks source link

feature Improvement about sentence_transformers(embedding,Reranker) #14

Closed NLPJCL closed 2 months ago

NLPJCL commented 2 months ago

Description

Adapt the jinaai/jina-reranker-v2-base-multilingual model for Reranker. refer to Jinaai discussions in huggingface
Modify the predict batch size for sentence_transformers from 32 (default) to vector_ingest_passage_bs.(milvus embedding, Reranker)
In order to avoid OOM in during milvus data ingestion, change the 'len(records_per_file)' parameter for saving files from 1000 to 100.

Thanks, please feel free to make suggestions.

TODO

[x] make formatting
[ ] make test

Related Issue

NO

Type of Change

[ ] 📚 Examples / docs / tutorials / dependencies update
[ ] 🔧 Bug fix (non-breaking change which fixes an issue)
[x] 🥂 Improvement (non-breaking change which improves an existing feature)
[ ] 🚀 New feature (non-breaking change which adds functionality)
[ ] 💥 Breaking change (fix or feature that would cause existing functionality to change)
[ ] 🔐 Security fix

Checklist

[x] I've read the CODE_OF_CONDUCT.md document.
[x] I've read the CONTRIBUTING.md guide.
[ ] I've updated the code style using make codestyle.
[ ] I've written tests for all new methods and classes that I created.
[ ] I've written the docstring in Google format for all the methods and classes that I used.