search

IHTSDO / snowstorm

Scalable SNOMED CT Terminology Server using Elasticsearch
Other
208 stars 83 forks source link

Will Snowstorm move to OpenSearch when upgrading the Elasticsearch dependency? (Quick answer - No) #411

Open metaruslan opened 2 years ago

metaruslan commented 2 years ago

My team is considering moving from Elasticsearch to OpenSearch (which is a fork of Elasticsearch at version 7.10). Snowstorm is one of our tools and we got curious if we'll have to work with both OpenSearch and Elasticsearch in the future because of Snowstorm. It is mentioned here https://github.com/IHTSDO/snowstorm/blob/master/docs/getting-started.md that Snowstorm is tested against Elasticsearch 7.7.

Will you guys move to OpenSearch when upgrading the Elasticsearch dependency in the future or will you stay with Elasticsearch (i.e. upgrading to Elasticsearch version 8, etc)?

And when are you planning to do the upgrade?

Thanks in advance!

kaicode commented 2 years ago

We will discuss this internally and get back to you.

kaicode commented 1 year ago

We have just upgraded to the last version of Elasticsearch that AWS supports (7.10.x).

The current plan is for Snowstorm to stay with Elasticsearch and not move to OpenSearch, mainly because Elasticsearch provides better performance.

Over the next year we will be trying different Elasticsearch hosting options so we can consider eventually upgrading to Elasticsearch 8 (that AWS do not support). The Elasticsearch 8 license prevents AWS from offering that version as an AWS service but it does not prevent anyone from setting up and running Elasticsearch 8 in AWS themselves. Much of the production features of Elasticsearch like incremental snapshot backups to AWS S3 are actually built into the Elasticsearch product itself so it should be possible to reproduce this using a chon job. There is also the option of using Elastic.co hosting.

It's worth noting that although the Elasticsearch 8 license prevents hosting providers other than Elastic.co from offering Elasticsearch as a service, it does not prevent anyone offering other apps like Snowstorm that use Elasticsearch as a service.

metaruslan commented 1 year ago

Thank you for the update!