search

elastic / eland

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch
https://eland.readthedocs.io
Apache License 2.0
635 stars 98 forks source link

import new third party models into elastic #574

Open shreya0685711 opened 1 year ago

shreya0685711 commented 1 year ago

Hi, Is there a way we can import other third party models not in the given list ?

davidkyle commented 1 year ago

Hi @shreya0685711

By the given list I assume you mean this list https://www.elastic.co/guide/en/machine-learning/master/ml-nlp-model-ref.html

That list is by no means comprehensive, it is a list of suggested models that are known to work. There are many other compatible models (for example most BERT based models) that are not on that list.

Do you have a specific model in mind? Why not try uploading the model and if fails then open an issue here.

shreya0685711 commented 1 year ago

hi @davidkyle, for example we tried importing the sklearn.IsolationForest and got the error "not currenlty implemented" image

huchengzejustin commented 1 year ago

Hi @davidkyle

Is there a size limit for the pre-trained models that can be uploaded with the eland_import_hub_model script?

davidkyle commented 1 year ago

@shreya0685711

we tried importing the sklearn.IsolationForest and got the error "not currenlty implemented"

If you would like to import this type of model please open another issue in this repository as an enhancement request. The title can be "Enhancement Request: Support importing sklearn.IsolationForest" then other people can find the issue.

Is there a size limit for the pre-trained models that can be uploaded with the eland_import_hub_model script?

No there isn't a size limit. Have you hit an issue uploading a large model?