-
Notifications
You must be signed in to change notification settings - Fork 152
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
RFC: Add design for blueprint and phase progress calculation #1461
Conversation
Thanks for submitting this pull request 🎉. The team will review it soon and get back to you. If you haven't already, please take a moment to review our project contributing guideline and Code of Conduct document. |
a27cc0a
to
b1d710f
Compare
design/progress-tracking.md
Outdated
completed phases against the total number of phases: | ||
|
||
``` | ||
blueprint_progress_percent = num_completed_phases / total_num_phases * 100 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should this be action_progress_percent
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Check with Yevgeny, he has a weighting system for phases.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@viveksinghggits yes, good catch! To get the blueprint overall progress, we should be assessing the completed actions, not phases.
Here's a sample log output of the Kopia create snapshot function: | ||
|
||
```sh | ||
$ kopia snapshot create kanister |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In both the examples (kopia and restic) we are just considering the utilities that are going to upload the data to object store but in some cases there are chances that there are some other commands that are taking some time.
- One example is the utility that we are using to take backup for example
mysqldump
,esdump
etc. Should we consider these as well or just measuring upload time would be sufficient.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Definitely if we can get progress from the tools we should expose that.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@viveksinghggits Yes, the goal is that downstream users can add more custom progress trackers (at the code level) per their requirements, if the built-in ones don't work. We can consider adding a built-in generic tracker to output the 25%, 50%, 75% and 100% markers based on certain events in the logs.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like this. Thanks for putting this together!
design/progress-tracking.md
Outdated
completed phases against the total number of phases: | ||
|
||
``` | ||
blueprint_progress_percent = num_completed_phases / total_num_phases * 100 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Check with Yevgeny, he has a weighting system for phases.
Here's a sample log output of the Kopia create snapshot function: | ||
|
||
```sh | ||
$ kopia snapshot create kanister |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Definitely if we can get progress from the tools we should expose that.
Signed-off-by: Ivan Sim <ivan.sim@kasten.io>
Signed-off-by: Ivan Sim <ivan.sim@kasten.io>
Signed-off-by: Ivan Sim <ivan.sim@kasten.io>
Signed-off-by: Ivan Sim <ivan.sim@kasten.io>
Signed-off-by: Ivan Sim <ivan.sim@kasten.io>
Change Overview
This PR adds the design proposal for the blueprint and phase progress calculation. Welcome all comments and feedback.
Pull request type
Please check the type of change your PR introduces:
Issues