quarkiverse / quarkus-langchain4j

Quarkus Langchain4j extension
https://docs.quarkiverse.io/quarkus-langchain4j/dev/index.html
Apache License 2.0
133 stars 79 forks source link

Introduce an Elastic implementation of an embedding store #633

Open geoand opened 4 months ago

geoand commented 4 months ago

We should introduce an implementation of Elastic as an embedding store in the same way as we have done with PostgresSQL, Neo4j and Redis.

geoand commented 4 months ago

cc @yrodiere @jmartisk

yrodiere commented 4 months ago

IIRC there is already an embedding store for Elasticsearch in lanchain4j -- but of course we still need some work in quarkus-langchain4j. Last time I checked there were severe performance problems with that embedding store (it used brute-force KNN!), and a pending PR to solve them, but that's a different topic.

In our case, the main problem will be: which client do we use to talk to Elasticsearch.

geoand commented 4 months ago

Neither client is integrated with Vertx, they both use Apache HTTP client, but I guess that's something we can live with.

Indeed :)