-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TEP-0118: Enable pipeline to handle matrix include params #6248
TEP-0118: Enable pipeline to handle matrix include params #6248
Conversation
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
d72aa67
to
430f575
Compare
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
/assign |
/assign |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think in general we need to make sure the logic and tests are synced for both v1 and v1beta1 API versions at this time?
430f575
to
627d912
Compare
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
/hold Thanks Quan! Holding this for now. May need to include implementation FanOut() logic with this as well. |
cb8a770
to
77c38a3
Compare
The following is the coverage report on the affected files.
|
74532d8
to
c5ff9b3
Compare
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
c5ff9b3
to
fbea2b2
Compare
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
fbea2b2
to
3c23992
Compare
/ unhold |
1 similar comment
/ unhold |
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
3c23992
to
6447e5d
Compare
[TEP-0090: Matrix] introduced `Matrix` to the `PipelineTask` specification such that the `PipelineTask` executes a list of `TaskRuns` or `Runs` in parallel with the specified list of inputs for a `Parameter` or with different combinations of the inputs for a set of `Parameters`. To build on this, Tep-0018 introduced Matrix.Include, which allows passing in a specific combinations of `Parameters` into the `Matrix`. This commit enables pipeline to handle matrix include params Note: This feature is still in preview mode. Implementation logic will be added in subsequent commits.
6447e5d
to
c9a3de6
Compare
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
The following is the coverage report on the affected files.
|
Thanks for all the changes Emma! 😺 /unhold |
@@ -259,6 +259,16 @@ func (m *Matrix) convertTo(ctx context.Context, sink *v1.Matrix) { | |||
param.convertTo(ctx, &new) | |||
sink.Params = append(sink.Params, new) | |||
} | |||
if m.hasInclude() { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: the check here might also be removed
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"handling matrix include params" is ambiguous, let's clarify what this means in the commit and PR description 🙏🏾
looking into the PR itself, it seems there are three things happening:
- refactoring extraction of parameters from a pipelinetask
- conversion of matrix.include to/from v1
- substituting result references in matrix.include.params
I recommend splitting this PR into three PRs such that each does only one thing 🙏🏾
@EmmaMunley related to Jerop's comment, with a lot of background copy-pasted between matrix include commit messages, it's hard to tell what's actually changing as a result of the commit. Can you focus the commit messages more on the specific changes being introduced? |
Thank you for the feedback and suggestions. @JeromeJu @JeromeJu @lbernick I have addressed the comments and broken this out into multiple PRs and shortened the commit messages to be more specific.
|
thanks for breaking the PRs up Emma! |
[TEP-0090: Matrix] introduced
Matrix
to thePipelineTask
specification such that thePipelineTask
executes a list ofTaskRuns
orRuns
in parallel with the specified list of inputs for aParameter
or with different combinations of the inputs for a set ofParameters
.To build on this TEP-0018 introduced Matrix.Include, which allows passing in a specific combinations of
Parameters
into theMatrix
.This PR enables pipeline to handle matrix include params.
Note: This feature is still in preview mode. Implementation logic will be added in subsequent commits.
/kind feature
Submitter Checklist
As the author of this PR, please check off the items in this checklist:
functionality, content, code)
/kind <type>
. Valid types are bug, cleanup, design, documentation, feature, flake, misc, question, tepRelease Notes