search

mozilla / participation-metrics-org

Participation metrics planning repository
4 stars 4 forks source link

Kibana 5 upgrade #79

Closed hmitsch closed 6 years ago

hmitsch commented 7 years ago

Community Analytics will be upgraded to Kibana 5. It is currently estimated during March. As a consequence all panels will be updated to the lates Grimoire Lab panels (incl. enrichment libraries).

canasdiaz commented 7 years ago

We are ready to start pushing this.

We will need an upgrade of the current ES instance. AFAIK this is done creating a new instance, so we would need the new ES5 instance up & running at the same time for a couple of days (less than three) so we can switch it smoothly.

Steps:

hmitsch commented 7 years ago

Hi @flamingspaz, can you help us with step 1?

When could @sanacl get this from you?

-Henrik

canasdiaz commented 7 years ago

Update:

@flamingspaz ideally we would like to have 5.1.1 but if it is not possible, any 5.1.x is ok.

flamingspaz commented 7 years ago

We can go up to 5.5, would that be better?

canasdiaz commented 7 years ago

@flamingspaz No, we don't support versions above 5.1.x yet

flamingspaz commented 7 years ago

opened https://github.com/mozilla/partinfra-terraform/pull/169 which would give a new ES cluster on 5.1 (Amazon doesn't have 5.1.1 it looks like) with a new endpoint. Once it's merged I'll update this issue so y'all can move data to it.

flamingspaz commented 7 years ago

The new endpoint is https://search-bitergia-metrics-es-ewoai7ko3v7ta25jzsrsvkwnqq.us-west-1.es.amazonaws.com

Let me know when you've transferred the data over so I can remove the old one!

canasdiaz commented 7 years ago

@flamingspaz oupss, I didn't know this was ready. We're starting the copy today.

canasdiaz commented 7 years ago

@hmitsch Bitergia upgrade will be ready before Wednesday next week.

@flamingspaz I'll update you as soon as we can decommission the 2.x ES server

canasdiaz commented 6 years ago

I'm reviewing the status of this. Data should be up to date during the next 4 or 5 hours, so we are close to decommission the 2.x ES server.

canasdiaz commented 6 years ago

@hmitsch @flamingspaz

We are done with this. I've been comparing the data and panels, please give us a couple of days before decommission the old ES 2.x server.

canasdiaz commented 6 years ago

@hmitsch @flamingspaz

migration to Kibana 5 (at least in data sets) is ready, so elasticsearch 2.x server is no longer needed. Please confirm you've read this.

flamingspaz commented 6 years ago

Awesome, I will decommission the old 2.x server in the next week or so.

canasdiaz commented 6 years ago

Great. We are done here :)