🚀 Release v1.73.0

[matusdrobuliak66]

Release version

1.73.0

Commit SHA

74d4870

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_LeeroyJenkins5

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

• Regular release

Changes

• 🐛 Fix: successful job's output returns None instead of result  #5721 by @pcrespov
• ✨Dynamic proxy: add allowed CORS header #5756 by @sanderegg
• ♻️🔨 Moves httpx-calls-capture tooling to pytest-simcore #5727 by @pcrespov
• 🎨 Frontend: favicons pointing to assets repo #5755 by @odeimaiz
• 🐛 Frontend: bind login page to /announcements #5758 by @odeimaiz
• 🎨 Improve the service startup progress display #5760 by @jsaq007
• 🐛 fix jupyterlab e2e test #5761 by @matusdrobuliak66
• 🎨🗃️ improve performance of check resource heartbeat #5762 by @matusdrobuliak66
• 🎨 Enhanced json serialization #5682 by @pcrespov
• ✨ TIP frontend: 4th plus button #5766 by @odeimaiz
• 🎨E2E: re-enable web-security when running playwright #5763 by @sanderegg
• ✨ Add profiling middleware to simcore services #5749 by @bisgaard-itis
• 🎨 enable show-all in profiling middleware to ensure profile is fully detailed #5769 by @bisgaard-itis
• ⚗️ New web-api service ⚠️🚨 #5767 by @pcrespov
• 🐛 Fixes web-api-server config #5779 by @pcrespov
• 🐛 🔨 Fixes wb-api-server configuration #5780 by @pcrespov
• 🐛 Only allow to search *owned* files in storage search endpoint #5772 by @bisgaard-itis
• 🐛 Frontend Fix: fetch Announcements at start up #5774 by @odeimaiz
• 🐛Garbage collector: possible fix to "spurious" shutdowns #5768 by @sanderegg
• 🐛 Frontend Fix: Make sure SelectBox's selection is not null #5785 by @odeimaiz
• ✨ e2e: playwright frontend #5717 by @odeimaiz
• ✨ Frontend TIP Feature: Pop up window with available new Plans #5784 by @odeimaiz
• Bump codecov/codecov-action from 4.3.0 to 4.3.1 #5788 by @dependabot
• 🐛⚗️RClone: Disable multi-threading 🚨 #5790 by @sanderegg
• ⬆️ Maintenance: upgrades test and tooling dependencies #5787 by @pcrespov
• 🐛 fixes validation error in notifications call #5794 by @pcrespov
• 🐛Agent: ensure RClone does not create kernel panics #5793 by @sanderegg
• 🐛 improve storage performance when listing files #5786 by @bisgaard-itis
• 🎨 Frontend: Show Tiers in secondary column #5791 by @odeimaiz
• 🎨 Re-fetch project state if it's closing #5800 by @odeimaiz
• 🐛? Frontend: Remove sourceMappingURLs #5801 by @odeimaiz
• 🐛 only pass user_id when project_id is not explicitly specified when listing files #5799 by @bisgaard-itis
• 🎨 Increase performance by paginating search files entry-points #5796 by @pcrespov
• ♻️ Cleanup compose specs environment #5776 by @pcrespov
• ✨E2E: Refactor jupyter lab test and adds large files option #5797 by @sanderegg
• ⬆️ Maintenance: upgrade socket.io to 4.7.5 #5805 by @odeimaiz
• 🐛Fix up-devel Makefile target #5806 by @sanderegg
• ♻️ project & project node PATCH 🚨  #5802 by @matusdrobuliak66
• 🐛 add validators to ProjectDB model #5810 by @matusdrobuliak66
• 🐛 fix hardcoded s3 region string #5808 by @matusdrobuliak66
• 🎨 dynamic-sidecar health check fails if RabbitMQ client disconnects #5671 by @GitHK
• 🎨 patch projects when creating study job #5817 by @bisgaard-itis
• 👽️✨ "Undev" files and studies endpoints #5825 by @bisgaard-itis
• 🐛 improve tip e2e test #5831 by @matusdrobuliak66
• 🚑️Rclone: downgrade to 1.63.1 #5830 by @sanderegg
• 🐛 Frontend: Fix open issue #5818 by @odeimaiz
• 🐛 Avoid aioredis client form hanging on calls if redis is no longer available #5821 by @GitHK
• ✨Autoscaling: terminate long pending EC2s #5832 by @sanderegg
• 🐛 Fix Frontend: Allow starting in App Mode #5836 by @odeimaiz
• 🐛 Wait for dynamic-sidecar's API to be responding before pinning to node #5841 by @GitHK
• 🐛 Frontend: open node on Full Screen Mode #5844 by @odeimaiz
• ✨ introducing inputs_required to workbench #5838 by @matusdrobuliak66
• 🎨 Check for zero credits (if pricing unit cost is greater than 0) #5835 by @matusdrobuliak66
• Bump codecov/codecov-action from 4.3.1 to 4.4.1 #5847 by @dependabot
• ✨Autoscaling: add a delay before draining a node #5843 by @sanderegg
• ✨Autoscaling: Drain node before terminating #5846 by @sanderegg
• 🔨 Retires deprecated pkg_resources module #5856 by @pcrespov
• ⬆️ Maintenance: Dask upgrade to 2024.5.1 and upgrades of autoscaling/clusters-keeper/director-v2/dask-sidecar/osparc-gateway 🚨 #5737 by @sanderegg
• ♻️🔨 Removes httpx client capture from api-server and moves to a plugin in pytest_simcore (⚠️) #5798 by @pcrespov
• 🐛⬆️Osparc-gateway-server: missing requirements update #5868 by @sanderegg
• 🐛 fix for pending transactions #5852 by @matusdrobuliak66
• 🐛Webserver: Fix show weird messages in the frontend UI #5863 by @sanderegg
• ✨Clusters-keeper: terminate broken EC2s🚨 #5851 by @sanderegg
• ⬆️Remove redis deprecation warning #5869 by @sanderegg
• ⬆️Maintenance: upgrade docker-py to latest version, unblocking requests library #5871 by @sanderegg
• ♻️🎨 Improves error handling in the api-server #5866 by @pcrespov
• 🎨Autoscaling/Clusters-keeper: disable public IP address #5882 by @sanderegg
• 🔨 Reuses pytest_simcore fixtures and exposes CLI options to override them #5876 by @pcrespov
• 🐛♻️Clusters-keeper: use private dns name instead of public IP #5883 by @sanderegg
• 🐛 use ip address in upload link check #5849 by @bisgaard-itis
• ✨ Adding deferred tasks ⚠️ #5704 by @GitHK
• ✨ Registers OSPARC_VARIABLE_API_* as osparc session variable (🚨) #5858 by @pcrespov
• ♻️ Dy service checking -> XHR to fetch requests #5885 by @ignapas
• 🐛 Fixes api-keys unique constraint violation (🚨) #5890 by @pcrespov
• 🎨 👽️ allow user to unhide study/solver job #5894 by @bisgaard-itis
• ♻️ Frontend: use PATCH instead of PUT for /projects I #5884 by @odeimaiz
• 👽️ update api-server specs #5895 by @bisgaard-itis
• ⬆️ upgrading faststream repo wide #5898 by @GitHK
• 🎨 Frontend: Redesign File Picker in App Mode  #5893 by @odeimaiz
• 🎨 Frontend: Credits indicator only visible in warning zone by default (🚨) #5897 by @odeimaiz
• ✨ introducing elastic file system guardian (OPS ⚠️) #5887 by @matusdrobuliak66
• ♻️ Removing default network form agent #5901 by @GitHK
• ✨♻️ New version_display and release_date fields for service metadata #5902 by @pcrespov
• ♻️Ensure parent project/node is well structured in the DB 🗃️ #5874 by @sanderegg
• ✨ api-server: New study jobs metadata entrypoints #5690 by @pcrespov
• 🎨 introducing parent ids to rut (🗃️) #5891 by @matusdrobuliak66
• ✨ Frontend: Expose inputs required property #5899 by @odeimaiz
• 🎨 propagate job parent ids through api server #5903 by @bisgaard-itis
• ✨ dynamic-services will fail if they have any required input that is not set #5845 by @GitHK
• 🎨 Frontend: Usage table: show root_parent_project_name instead of project_name #5908 by @odeimaiz
• 🔨Clusters maintenance script: refactoring and add SSH tunneling #5886 by @sanderegg
• 🔨 New pytest-simcore environment_config fixtures and utils_postgres helpers #5909 by @pcrespov
• ♻️ Major cleanup of catalog service #5904 by @pcrespov
• ✨ [Frontend] Dashboard: filters on the left #5907 by @odeimaiz
• 🎨 [Frontend] App Mode: Pop up instructions if any #5915 by @odeimaiz
• 🎨♻️Use structured parent project/node in director-v2 and connect with RUT #5877 by @sanderegg
• 🐛Dask sidecar: disable concurrent pulling of files until new version is out #5912 by @sanderegg
• ✨ Efs Guardian can create directories (OPS ⚠️) #5911 by @matusdrobuliak66
• 🐛 [Frontend bugfix] Move side spacer to Resource Browser #5919 by @odeimaiz
• ♻️🎨 ooil config init to create first.osparc config layout #5913 by @pcrespov

Devops before 👷

• Merge / Apply / Test --> https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/596

Devops actions 👷

• Update RDS certificates YH (https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/603)
• Import AWS TargetGroup Attachments in terraform (NIH PROD) (no need with new eMaintenance)
• Sync TF TGA YH (https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/596)
• Enhance OPS route53 records (https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/merge_requests/604) YH

Devops after 👷

• Close AWS RDS Certificate expire on Aug. 22th, 2024 osparc-ops-environments#327
• Close Security: Autoscaled EC2 instances currently need to be accessible through the internet osparc-ops-environments#195

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=<M.m.0>  git_sha=<commit_sha>

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis add an entry in db scheduled_maintenance with key maintenance {"start": "2023-03-06T13:00:00.000Z", "end": "2023-03-06T15:00:00.000Z", "reason": "Release <vX.X.0>"}. Note the time is in UTC, please adjust accordingly
  • aws
  • dalco
  • tip
• status page (https://manage.statuspage.io/)
  • osparc
  • s4l
• mattermost channels
  • maintenance
  • power users

Releasing 🚀

• Maintenance page up.

cd /deployment/production/osparc-ops-environments
make up-maintenance
make down-maintenance

• Release by publishing draft
• Check release CI
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Check deployed
  • aws deploy
  • dalco deploy
  • tip deploy
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Delete announcement
• Check e2e runs
• Announce

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>