Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

♻️ extending run_id with int_timestamp #4505

Merged
merged 19 commits into from
Jul 27, 2023

Conversation

GitHK
Copy link
Contributor

@GitHK GitHK commented Jul 18, 2023

What do these changes do?

The run_id used for running dynamic services is not very useful since it does not encode any information that can be of help.

Changing it to also include int_timestamp string everywhere. This will allow us to more accurately track sort the data associated with each run. This is especially important since our file backup systems keep the original created and last change dates. So you cannot tell by looking at the parent folder which is the latest one. The time information regarding the creation of the volume needs to be tracked in the name.

NOTE: after changing the type from UUID to str, the changes are still retrocompatible with the old legacy data format for the state of the dynamic sidecar, in fact that one was not changed

Related issue/s

How to test

DevOps Checklist

@GitHK GitHK self-assigned this Jul 18, 2023
@GitHK GitHK added t:maintenance Some planned maintenance work a:dynamic-sidecar dynamic-sidecar service changelog:♻️refactor a:agent agent service labels Jul 18, 2023
@GitHK GitHK added this to the Sundae milestone Jul 18, 2023
@codecov
Copy link

codecov bot commented Jul 18, 2023

Codecov Report

Merging #4505 (da4bec8) into master (bd7f4b4) will increase coverage by 3.3%.
The diff coverage is 75.0%.

Impacted file tree graph

@@           Coverage Diff            @@
##           master   #4505     +/-   ##
========================================
+ Coverage    83.8%   87.1%   +3.3%     
========================================
  Files        1009     844    -165     
  Lines       43193   38670   -4523     
  Branches      997     482    -515     
========================================
- Hits        36197   33719   -2478     
+ Misses       6767    4837   -1930     
+ Partials      229     114    -115     
Flag Coverage Δ
integrationtests 68.3% <100.0%> (+<0.1%) ⬆️
unittests 84.4% <66.6%> (+3.3%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
...es/dynamic_sidecar/docker_service_specs/sidecar.py 87.7% <ø> (ø)
...src/simcore_service_dynamic_sidecar/core/errors.py 100.0% <ø> (ø)
...ages/models-library/src/models_library/services.py 92.5% <66.6%> (-1.7%) ⬇️
...or_v2/models/schemas/dynamic_services/scheduler.py 98.7% <100.0%> (ø)
...modules/dynamic_sidecar/scheduler/_core/_events.py 96.7% <100.0%> (-0.1%) ⬇️

... and 229 files with indirect coverage changes

@GitHK GitHK changed the title ♻️ replacing run_id with isoformatted date ♻️ replacing run_id with isodatetime Jul 19, 2023
@GitHK GitHK changed the title ♻️ replacing run_id with isodatetime ♻️ replacing run_id with int_timestamp Jul 19, 2023
@GitHK GitHK marked this pull request as ready for review July 19, 2023 12:53
Copy link
Contributor

@matusdrobuliak66 matusdrobuliak66 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Copy link
Member

@sanderegg sanderegg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Along the same lines as @matusdrobuliak66 said I am a bit concerned about the uniqueness of this run_id and would like to understand better where and how it is used. Please consider a scenario with multiple director-v2s

@GitHK GitHK requested a review from pcrespov July 24, 2023 12:58
@GitHK GitHK requested a review from sanderegg July 24, 2023 12:58
@GitHK GitHK changed the title ♻️ replacing run_id with int_timestamp ♻️ extending run_id with int_timestamp Jul 24, 2023
Copy link
Member

@sanderegg sanderegg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you ensuring backwards compatibility still?

@codeclimate
Copy link

codeclimate bot commented Jul 27, 2023

Code Climate has analyzed commit da4bec8 and detected 0 issues on this pull request.

View more on Code Climate.

@sonarqubecloud
Copy link

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.1% 0.1% Duplication

@GitHK GitHK merged commit bfa07d9 into ITISFoundation:master Jul 27, 2023
@GitHK GitHK deleted the pr-osparc-run-id-based-on-time branch July 27, 2023 06:39
@matusdrobuliak66 matusdrobuliak66 mentioned this pull request Sep 22, 2023
50 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
a:agent agent service a:dynamic-sidecar dynamic-sidecar service t:maintenance Some planned maintenance work
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improve the run_id on the dy-sidecar
4 participants