You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the container_arguments parameter to the ProcessingStep constructor does not support placeholders, so that the only way to pass dynamic values to a processing job is to use a lambda to create a file on s3 with the values in it and bring it into the job as a processing input. Unfortunately this is quite inconvenient.
It would be a major improvement if ProcessingStep's constructor accepted placeholders.
The text was updated successfully, but these errors were encountered:
I am wondering if we can re-open this issue since the original feature request is still not possible where execution_input['argument'].to_jsonpath() will get passed straight to the processing script without the variable being replaced on execution and execution_input['argument'] runs into TypeError: Object of type ExecutionInput is not JSON serializable when trying to create workflow
Currently, the
container_arguments
parameter to theProcessingStep
constructor does not support placeholders, so that the only way to pass dynamic values to a processing job is to use a lambda to create a file on s3 with the values in it and bring it into the job as a processing input. Unfortunately this is quite inconvenient.It would be a major improvement if
ProcessingStep
's constructor accepted placeholders.The text was updated successfully, but these errors were encountered: