search

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.74k stars 24.68k forks source link

Support for flair models #96270

Open jaskozi opened 1 year ago

jaskozi commented 1 year ago

Description

Hello,

I've tried to upload a flair transformer NLP model to the elastic cluster to be included in the inference pipeline. It seems it's not possible since the config.json file is missing:

OSError: flair/ner-german-large does not appear to have a file named config.json

We have also contacted the flair developer team, and they stated that because of the flair model architecture, it's not possible for them to produce a config.json file.

As I've read from the documents, pytorch and huggingface models are already supported. Would it be possible for elastic to include support for flair models? It would increase the possibilities of using NLP deep learning models for inferences, since flair models show excellent performance in terms of inference time and accuracy.

Thank you!

elasticsearchmachine commented 1 year ago

Pinging @elastic/ml-core (Team:ML)