Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(launcher): put pipeline context as parent of run context. Part of #5669 #5785

Merged
merged 1 commit into from
Jun 5, 2021

Conversation

Bobgy
Copy link
Contributor

@Bobgy Bobgy commented Jun 3, 2021

Description of your changes:
put pipeline context as parent of run context

Part of #5669

Checklist:

@Bobgy
Copy link
Contributor Author

Bobgy commented Jun 3, 2021

/hold
this depends on upgrading MLMD to 1.0.0, because put parent context is a new feature

_, err := c.svc.PutParentContexts(ctx, req)
if err != nil {
if status.Convert(err).Code() == codes.AlreadyExists {
// already exists code is expected when multiple requests are sent in parallel
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add a logging here which indicates that the parental edge already exists

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will happen too many times, it's probably not worth logging.
(Because every task runs in parallel, only the first task will successfully put the parent edge, all other tasks will get this already exists status code)

@capri-xiyue
Copy link
Contributor

Do we need to modify the e2e test to verify that the parental edges exists in MLMD?

@Bobgy
Copy link
Contributor Author

Bobgy commented Jun 4, 2021

Do we need to modify the e2e test to verify that the parental edges exists in MLMD?

Not sure, I feel that the extra test is not of enough value when we already verify in the unit test (with a real MLMD server).

@Bobgy
Copy link
Contributor Author

Bobgy commented Jun 4, 2021

/retest
I've updated test infra to MLMD 1.0.0
kubeflow/testing@22261a6
/unhold

@Bobgy
Copy link
Contributor Author

Bobgy commented Jun 4, 2021

/unhold

@capri-xiyue
Copy link
Contributor

/lgtm

@Bobgy
Copy link
Contributor Author

Bobgy commented Jun 5, 2021

Thanks
/approve

@google-oss-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: Bobgy

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@Bobgy
Copy link
Contributor Author

Bobgy commented Jun 5, 2021

/retest

@google-oss-robot google-oss-robot merged commit 6a1b841 into kubeflow:master Jun 5, 2021
@Bobgy Bobgy deleted the parent-ctx branch June 9, 2021 08:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants