Enables inputs to be also outputs; Fixes #936 #947
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This enables one to pass in inputs and request them as outputs independent of the graph.
The use case here is that you want to join some data at the end that is extra and not in the DAG. E.g. extra pandas data.
I skip the visualization parts because this is an odd case.
This was easier than expected because the new executor already uses inputs as outputs... So really only had to modify the old code path.
Changes
How I tested this
Notes
Checklist