Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature request: supporting placeholders in ProcessingStep constructor #139

Closed
lucaboulard opened this issue Jun 7, 2021 · 2 comments
Closed
Assignees

Comments

@lucaboulard
Copy link

Currently, the container_arguments parameter to the ProcessingStep constructor does not support placeholders, so that the only way to pass dynamic values to a processing job is to use a lambda to create a file on s3 with the values in it and bring it into the job as a processing input. Unfortunately this is quite inconvenient.
It would be a major improvement if ProcessingStep's constructor accepted placeholders.

@ca-nguyen
Copy link
Contributor

The fix (#155) will be available with next release

@yanhong-zhao-ef
Copy link

I am wondering if we can re-open this issue since the original feature request is still not possible where execution_input['argument'].to_jsonpath() will get passed straight to the processing script without the variable being replaced on execution and execution_input['argument'] runs into TypeError: Object of type ExecutionInput is not JSON serializable when trying to create workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants