🚀 Release v1.55.0

[matusdrobuliak66]

Release version

1.55.0

Commit SHA

48d29cda9cb81c570fbd329ec560eb0c2167321a

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Watermelon2

Did the commit CI suceeded?

• [x] The commit CI succeeded.

Motivation

n/a

Changes

Release Issue: https://github.com/ITISFoundation/osparc-simcore/issues/4397

• https://github.com/ITISFoundation/osparc-simcore/pull/4347 by @sanderegg
• https://github.com/ITISFoundation/osparc-simcore/pull/4349 by @sanderegg
• https://github.com/ITISFoundation/osparc-simcore/pull/4343 by @bisgaard-itis
• https://github.com/ITISFoundation/osparc-simcore/pull/4297 by @matusdrobuliak66
• https://github.com/ITISFoundation/osparc-simcore/pull/4330 by @pcrespov
• https://github.com/ITISFoundation/osparc-simcore/pull/4338 by @GitHK
• https://github.com/ITISFoundation/osparc-simcore/pull/4365 by @odeimaiz
• https://github.com/ITISFoundation/osparc-simcore/pull/4042 by @mrnicegyu11
• https://github.com/ITISFoundation/osparc-simcore/pull/4368 by @mrnicegyu11
• https://github.com/ITISFoundation/osparc-simcore/pull/4360 by @odeimaiz
• https://github.com/ITISFoundation/osparc-simcore/pull/4367 by @mrnicegyu11
• https://github.com/ITISFoundation/osparc-simcore/pull/4366 by @bisgaard-itis
• https://github.com/ITISFoundation/osparc-simcore/pull/4336 by @pcrespov
• https://github.com/ITISFoundation/osparc-simcore/pull/4373 by @pcrespov
• https://github.com/ITISFoundation/osparc-simcore/pull/4324 by @odeimaiz
• https://github.com/ITISFoundation/osparc-simcore/pull/4362 by @sanderegg
• https://github.com/ITISFoundation/osparc-simcore/pull/4381 by @sanderegg
• https://github.com/ITISFoundation/osparc-simcore/pull/4384 by @sanderegg
• https://github.com/ITISFoundation/osparc-simcore/pull/4382 by @dependabot
• https://github.com/ITISFoundation/osparc-simcore/pull/4388 by @bisgaard-itis
• https://github.com/ITISFoundation/osparc-simcore/pull/4379 by @pcrespov
• https://github.com/ITISFoundation/osparc-simcore/pull/4378 by @odeimaiz
• https://github.com/ITISFoundation/osparc-simcore/pull/4387 by @pcrespov
• https://github.com/ITISFoundation/osparc-simcore/pull/4383 by @matusdrobuliak66
• https://github.com/ITISFoundation/osparc-simcore/pull/4386 by @odeimaiz
• https://github.com/ITISFoundation/osparc-simcore/pull/4393 by @matusdrobuliak66
• https://github.com/ITISFoundation/osparc-simcore/pull/4390 by @pcrespov
• https://github.com/ITISFoundation/osparc-simcore/pull/4395 by @matusdrobuliak66

No response

Devops check 👷

• [x] Add changes (if any) and release tags in https://github.com/ITISFoundation/osparc-ops-environments/tags
• [x] Add changes (if any) and release tags in osparc-ops-deployment-configuration (osparc.io & osparc.speag.com & tip.itis.swiss)
• [x] https://github.com/ITISFoundation/osparc-simcore/pull/4349
• [x] https://github.com/ITISFoundation/osparc-simcore/pull/4367
• [x] double check INVITATION_PASSWORD (from comment below)
• [x] DB migrations
• [x] Restart many ops services (see comment below)
• [x] Double check AUTOSCALING_EC2_INSTANCES_PRE_PULL_IMAGES (from comment below)
• [x] Test Prometheus fix
• [x] Recreate the swarm in aws-orid
• [x] Add a new ops machine

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• [x] Prepare release link

  make release-prod version=1.55.0  git_sha=48d29cda9cb81c570fbd329ec560eb0c2167321a

• [x] Draft release changelog
• [x] Announce maintenance ( ANNOUNCE AT LEAST 24 HOURS BEFORE )
• redis {"start": "2023-06-23T07:00:00.000Z", "end": "2023-06-23T08:15:00.000Z", "reason": "Release v1.55.0"}
  • [x] aws
  • [x] dalco
  • [x] tip
• status page (https://manage.statuspage.io/)
  • [x] osparc
  • [x] s4l
• mattermost channels
  • [x] maintenance
  • [x] power users

Releasing 🚀

• [x] Maintenance page up.

  cd /deployment/production/osparc-ops-environments
  make up-maintenance
  make down-maintenance

• [x] Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• [ ] Release by publishing draft
• [x] Check release CI
• [ ] Check deployed
  • [ ] aws deploy
  • [x] dalco deploy
  • [x] tip deploy
• [x] Check testing endpoint ex. https://testing.osparc.speag.com/
• [x] Delete announcement
• [ ] Check e2e runs
• [ ] Announce

  :tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v1.55.0

[mrnicegyu11]

The deployment agent on aws-prod is paused since there were faulty env-vars for the invitations service. The env-vars have been adjusted manually in portainer

[mrnicegyu11]

We tried to put the fix in here, please double check upon releasing that especially the INVITATION_PASSWORD is correctly set on the service's env-vars, and not truncated after the dollar sign

https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/e6828f94b150cad47034111675923fbbdc84be5f

[mrnicegyu11]

The deployment agent is paused, the faulty variable of AUTOSCALING_EC2_INSTANCES_PRE_PULL_IMAGES on the autoscaling service was corrected and is now set to

["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","prom/node-exporter:v0.18.1","portainer/agent:2.13.1","docker:20.10.14-dind","caddy:2.4.5-alpine","gcr.io/cadvisor/cadvisor:v0.45.0","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

I just noticed that this is not necessarily in sync with the actually used ops-containers, for example the portainer version is for sure outdated. I will open an issue about this.

[sanderegg]

The deployment agent is paused, the faulty variable of `` on the autoscaling service was corrected and is now set to

["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","prom/node-exporter:v0.18.1","portainer/agent:2.13.1","docker:20.10.14-dind","caddy:2.4.5-alpine","gcr.io/cadvisor/cadvisor:v0.45.0","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

I just noticed that this is not necessarily in sync with the actually used ops-containers, for example the portainer version is for sure outdated. I will open an issue about this.

@mrnicegyu11 Maybe we should just remove those ops ones. the images are not so big I think so that should not make a huge difference.

[mrnicegyu11]

The deployment agent is paused, the faulty variable of `` on the autoscaling service was corrected and is now set to

["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","prom/node-exporter:v0.18.1","portainer/agent:2.13.1","docker:20.10.14-dind","caddy:2.4.5-alpine","gcr.io/cadvisor/cadvisor:v0.45.0","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

I just noticed that this is not necessarily in sync with the actually used ops-containers, for example the portainer version is for sure outdated. I will open an issue about this.

@mrnicegyu11 Maybe we should just remove those ops ones. the images are not so big I think so that should not make a huge difference.

Sounds good I will put this in place on aws-prod now, we can then see how it looks/feels.

New env-var is: ["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

[mrnicegyu11]

The deployment agent is paused, the faulty variable of `` on the autoscaling service was corrected and is now set to

["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","prom/node-exporter:v0.18.1","portainer/agent:2.13.1","docker:20.10.14-dind","caddy:2.4.5-alpine","gcr.io/cadvisor/cadvisor:v0.45.0","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

I just noticed that this is not necessarily in sync with the actually used ops-containers, for example the portainer version is for sure outdated. I will open an issue about this.

@mrnicegyu11 Maybe we should just remove those ops ones. the images are not so big I think so that should not make a huge difference.

Sounds good I will put this in place on aws-prod now, we can then see how it looks/feels.

New env-var is: ["itisfoundation/dynamic-sidecar:release-github-latest","itisfoundation/agent:release-github-latest","registry.osparc.io/simcore/services/dynamic/s4l-core-lite:2.0.106"]

Fixed in https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/6412871d2dea6caf396574689babf97910e0e1ab

[mrnicegyu11]

Please add the second ops machine:

• https://git.speag.com/oSparc/osparc-infra/-/merge_requests/138
• https://github.com/ITISFoundation/osparc-ops-environments/pull/181
• https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/8976902aa11b42a6d9279631245c73e1bbe2270b

[mrnicegyu11]

Please restart the following ops-services and thus roll out the latest ops-code from osparc-ops-environments on prod:

• filestash
• jaeger
• monitoring
• registry
• (ops) traefik
• graylog
• portainer

on aws-prod, dalco-prod and tip.itis.swiss.

Grafana and Graylog Alerts need to be re-provisioned.

[mrnicegyu11]

In order for the grafana dashboard to work, the old proper hostnames (instance prometheus labels) need to be restored. Potentially a full teardown and recreation of the swarm is necessary for this.

See: https://github.com/ITISFoundation/osparc-ops-environments/pull/182

[odeimaiz]

Please include this commit as hotfix

[Surfict]

• Swarm was recreated
• Some problems to start the deploy script in aws production, ticket will be created
• The pwd for invitation service was not set correctly (keeping two $), I paused the deployemnt agent in aws production and set the good password manually in the service. An issue will be created
• We need documentation about how to run the swarm recipes in Ansible for the different uses cases

[pcrespov]

• Follow up on the invitations issue: https://github.com/ITISFoundation/osparc-simcore/issues/1980

[matusdrobuliak66]

Invitations:

• INVITATIONS_OSPARC_URL
• INVITATIONS_PASSWORD were manually modified in the Portainer