icgc-argo / donor-submission-aggregator

Event-driven donor aggregation service for the ICGC-ARGO Submission System
GNU Affero General Public License v3.0
3 stars 0 forks source link

update existing qa and dev indices setting to the new shard setting #108

Closed Buwujiu closed 3 years ago

Buwujiu commented 3 years ago

The problem: recently we updated the default es index settings in this ticket: https://github.com/icgc-argo/donor-submission-aggregator/issues/54, this resulted in rollcall unable to clone existing indices because of the mismatch in es settings, as es only allows index clone when old and new index have the same settings.

old index with number_of_shards = 1, numer_of_replicas= 1: image.png

new index settings: image.png

Expected results: all donor-aggregator indices in qa and dev should be updated to new settings:

"settings": {
    "index.number_of_shards": 3,
    "index.number_of_replicas": 2
  }

Possible Solution:

  1. Manually update indices settings using es PUT /_settings endpoint
    • can only update number_of_replicas not number_of_shards
  2. change aggregator rollcall CreateResolvableIndexRequestrequest to cloneFromReleasedIndex = false which disables clone
  3. ?
rosibaj commented 3 years ago
rosibaj commented 3 years ago

@Buwujiu was there a PR to attach here?

Buwujiu commented 3 years ago

https://github.com/icgc-argo/donor-submission-aggregator/pull/99