Update Code Pattern to latest Elasticsearch version

IBM / elasticsearch-spark-recommender

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

Apache License 2.0

841 stars 266 forks source link

Closed MLnick closed 4 years ago

MLnick commented 4 years ago

This PR updates the Code Pattern as follows:

Upgrade to use latest Elasticsearch version (7.6.x)
Use new built-in dense_vector field and scoring functionality from ES 7.6.x
- as a result the custom ES plugin is no longer required
Upgrade to latest Apache Spark version (2.4.5)

README and notebook updates for these changes.

MLnick commented 4 years ago

I have tested the updated instructions and notebooks (from clean base folder and Conda env) and all works as expected.

You can test based off the repo es7 branch.

MLnick commented 4 years ago

Ping @rhagarty @stevemar

cc @djalova you may also take a look?