elastic / eland

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch
https://eland.readthedocs.io
Apache License 2.0
640 stars 98 forks source link

Reduce transitive dependencies from sentence-transformers #624

Open joshdevins opened 11 months ago

joshdevins commented 11 months ago

When we install sentence-transformers in our pytorch target, we pull in all of the transitive dependencies of that library which include many libraries that we will never need. Excluding these transitive dependencies will reduce eland's overall installation footprint and consequently the Docker image size. This simplification can also help reduce dependency conflicts such as #408.

'tqdm',
'torchvision',
'numpy',
'scikit-learn',
'scipy',
'nltk',