🚀 [sim4life] Release v1.67.0

[YuryHrytsuk]

Release version

1.67.0

Commit SHA

bed592156a9e5d8f9bd590fbc67c1ebde904dc7b

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Schoggilebe3

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

Release to sim4life.io

Changes

• 🐛 datcore: fix non-implement get_file in storage #5357 by @elisabettai
• ✨node_ports is capable of talking with storage using basic auth ⚠️ #5361 by @GitHK
• 🎨 initiate proper error handling for backend clients in api server #5362 by @bisgaard-itis
• 🔨 Adds logs in e2e with timestamps #5368 by @pcrespov
• ✨ added STORAGE_SECURE to StorageAuthSettings #5366 by @GitHK
• 🎨 removing jupyterlab flaky part of the e2e test #5371 by @matusdrobuliak66
• 🐛 Adds auth to simcore_sdk endpoints that were missing it #5374 by @GitHK
• 🎨 Send email on successful payment w/ payment-method #5376 by @pcrespov
• improve logging when raising exception coming from backend services #5377 by @bisgaard-itis
• ♻️ Update docker service hostname #5379 by @YuryHrytsuk
• ⚗️ Use uv to replace pip #5350 by @sanderegg
• ✨ Privacy Policy & EULA #5378 by @ignapas
• ✨Front-end driven service shutdown when ran out of credits ⚠️🚨 #5352 by @GitHK
• 🐛 HTTPException -> JSONResponse: fix exception handler in api-server #5385 by @bisgaard-itis
• 🐛UV related issues #5388 by @sanderegg
• 🎨E2E: sleepers test adapt expected output files to sleepers version #5389 by @sanderegg
• 🐛♻️ Billing center: latest fixes #5329 by @ignapas
• 🐛 Using secure links if storage is secure #5387 by @GitHK
• Default project thumbnails - PT 2 #5381 by @jsaq007
• 🐛 Update env vars for starting locally #5399 by @GitHK
• Bump codecov/codecov-action from 3.1.4 to 4.1.0 #5382 by @dependabot
• 🐛 Minor fixes: resources files path, gateway openapi specs #5398 by @pcrespov
• ♻️ dynamic-sidecar fails to boot if external dependencies are not present #5349 by @GitHK
• ✨Autoscaling/Clusters-keeper tags also volume and network-interface #5405 by @sanderegg
• 🎨🗃️ add migration that creates postgres extension needed for export to S3 #5407 by @matusdrobuliak66
• Bump yezz123/setup-uv from 1 to 3 #5406 by @dependabot
• ♻️ Cleanup status codes on tests and new helper functions #5392 by @pcrespov
• ⬆️Maintenance: remove blocking docker buildx version #5409 by @sanderegg
• 🐛✨EC2 machine creation: try to create at least 1 machine #5408 by @sanderegg
• ♻️ Remove $MACHINE_FQDN from resource usage tracker #5411 by @mrnicegyu11
• 🐛 Storage liveliness check inside dynamic-sidecar now respects authentication #5410 by @GitHK
• 👽️ ✨ document status codes in api server #5386 by @bisgaard-itis
• director-v2's dynamic scheduler monitoring task runs exclusively #5401 by @GitHK
• 🐛🎨♻️Bugfix-refactor: Docker pull progress #5404 by @sanderegg
• 🐛E2e: fix imports #5414 by @sanderegg
• 🐛Webserver: exclusive/non-exclusive RabbitMQ consumers are deleting each other, and also probably replacing each other #5415 by @sanderegg
• 🎨 Frontend changes for CookieBanner on s4l-io #5413 by @mrnicegyu11
• ♻️Maintenance: uv and osparc clusters improvements #5417 by @sanderegg
• 🐛 Fix: Open study from notification #5412 by @odeimaiz
• ✨ Display warning message for low and out of disk space  #5309 by @jsaq007
• ✨ Users pre-registration 🗃️ 🚨 #5391 by @pcrespov
• 🎨 Separate Privacy Policy and EULA checkboxes #5420 by @odeimaiz
• 🐛 Fix bug that throws error when capturing api responses in dev mode #5425 by @wvangeit
• 🎨Maintenance: osparc clusters improvements #5423 by @sanderegg
• 🐛 Fix issues with pip cache in ci python setup #5426 by @GitHK
• Study page refactor #5421 by @jsaq007
• ⚗️Disable e2e playwright for now #5428 by @sanderegg
• ✨ Sort studies #5393 by @jsaq007
• 🎨 Study home page redesign II #5430 by @odeimaiz
• 🐛 Bugfix: catalog was broken #5433 by @odeimaiz

DevOps after:

• merge e2e portainer creds update (https://git.speag.com/oSparc/e2e-ops/-/merge_requests/214)

Devops check 👷

• portainer works with new password @YuryHrytsuk

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=<M.m.0>  git_sha=<commit_sha>

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis {"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}
  • aws
  • dalco
  • tip
• status page (https://manage.statuspage.io/)
  • osparc
  • s4l
• mattermost channels
  • maintenance
  • power users

Releasing 🚀

• Maintenance page up.

cd /deployment/production/osparc-ops-environments
make up-maintenance
make down-maintenance

• Release by publishing draft
• Check release CI
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Check deployed
  • aws deploy
  • dalco deploy
  • tip deploy
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Delete announcement
• Check e2e runs
• Announce

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>

[GitHK]

Actions to take during release by pr:

• ✨node_ports is capable of talking with storage using basic auth ⚠️ #5361
  • 1. If this command works curl -v https://storage.sim4life.io:443/v0/ -u admin:${SERVICES_PASSWORD}; it provides a reply similar to {"data": {"name": "simcore_service_storage", "api_version": "0.3.0", "version": "0.3.0"}}
  • set the following env var DIRECTOR_V2_NODE_PORTS_STORAGE_AUTH='{"STORAGE_USERNAME": "admin", "STORAGE_PASSWORD": "__REPALCE_ME__", "STORAGE_HOST": "storage.sim4life.io", "STORAGE_PORT": "443", "STORAGE_SECURE": "1"}' NOTE STORAGE_PASSWORD should contain ${SERVICES_PASSWORD} the password in clear text -> have a look at AWS master fo guidelines
  • in case it does not work, we need to ask @YuryHrytsuk why the traffic basic auth is not configured in a similar way as it is for AWS master.
• ✨Front-end driven service shutdown when ran out of credits ⚠️🚨 #5352
  • I have rebated and merged the associated MR
  • check the running out of credits in a deployment and services shutdown

[matusdrobuliak66]

Release done 8.3.2024 11:30