Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor Child & Infant Pipelines to Make Worker Execute Simpler and Isolated #56

Closed
mrpaulandrew opened this issue Sep 15, 2020 · 0 comments · Fixed by #57
Closed

Refactor Child & Infant Pipelines to Make Worker Execute Simpler and Isolated #56

mrpaulandrew opened this issue Sep 15, 2020 · 0 comments · Fixed by #57
Assignees
@mrpaulandrew
Labels
enhancement New feature or request Solution Area: Orchestrator Azure Data Factory or Azure Synapse Analytics - Processing pipelines.

Comments

@mrpaulandrew
Copy link
Owner

Move worker pipeline execute activities into infant pipeline along side run handling, making the call to run a worker pipeline an isolated operation.

The child level pipeline can then be made simpler and used just for the purpose of scaling out executions.

Once done. Refactor infant to use local variables replacing hard coded activity output expressions where possible.
@mrpaulandrew mrpaulandrew self-assigned this Sep 15, 2020
@mrpaulandrew mrpaulandrew added enhancement New feature or request Solution Area: Orchestrator Azure Data Factory or Azure Synapse Analytics - Processing pipelines. labels Sep 15, 2020
@mrpaulandrew mrpaulandrew linked a pull request Sep 15, 2020 that will close this issue
Refactor Infant to Make Worker Call Isolated #57
Merged
@mrpaulandrew mrpaulandrew linked a pull request Sep 15, 2020 that will close this issue
Cross Tenant & Subscription Workers #58
Merged
@mrpaulandrew mrpaulandrew removed a link to a pull request Sep 15, 2020
Cross Tenant & Subscription Workers #58
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mrpaulandrew mrpaulandrew

Labels
enhancement New feature or request Solution Area: Orchestrator Azure Data Factory or Azure Synapse Analytics - Processing pipelines.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Refactor Infant to Make Worker Call Isolated mrpaulandrew/procfwk
1 participant
@mrpaulandrew