Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(sdk): add subprocess task handler #localexecution #10302

Merged

Conversation

connor-mccarthy
Copy link
Member

@connor-mccarthy connor-mccarthy commented Dec 12, 2023

Description of your changes:
Add subprocess task handler to the task dispatcher.

There are basic tests, but will add more comprehensive E2E local execution tests once we support accessing outputs on locally executed tasks. There several other TODOs included throughout.

Checklist:

Copy link

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@connor-mccarthy
Copy link
Member Author

/assign @chensun

@connor-mccarthy connor-mccarthy marked this pull request as draft December 12, 2023 23:15
@connor-mccarthy connor-mccarthy force-pushed the add-subprocess-task-handler branch 4 times, most recently from 180de73 to 7e0ea2f Compare December 13, 2023 00:20
@connor-mccarthy connor-mccarthy marked this pull request as ready for review December 13, 2023 00:21
@connor-mccarthy connor-mccarthy force-pushed the add-subprocess-task-handler branch 4 times, most recently from 4bc18f3 to 6680d5d Compare December 13, 2023 15:10
@connor-mccarthy
Copy link
Member Author

/retest

@@ -191,7 +191,7 @@ def handle_single_return_value(self, output_name: str, annotation_type: Any,
origin_type = getattr(annotation_type, '__origin__',
None) or annotation_type
# relax float-typed return to allow both int and float.
if origin_type == float:
if origin_type in {int, float}:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems to be an orthogonal behavior change? And it seems this might be problematic to accept float when the int was expected?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. Thank you for catching that. This LOC was included in error.

I'll flag the correct solution to the problem this intended to solve in the next PR.

Copy link
Member

@chensun chensun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

Thanks!

@google-oss-prow google-oss-prow bot added the lgtm label Dec 15, 2023
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: chensun

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@connor-mccarthy
Copy link
Member Author

/retest

Copy link

google-oss-prow bot commented Dec 15, 2023

@connor-mccarthy: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
kfp-kubernetes-execution-tests f1f398c link false /test kfp-kubernetes-execution-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@google-oss-prow google-oss-prow bot merged commit 21f8e9c into kubeflow:master Dec 15, 2023
27 of 28 checks passed
stijntratsaertit pushed a commit to stijntratsaertit/kfp that referenced this pull request Feb 16, 2024
* add subprocess task handler

* response to review feedback
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants