Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Workflow Triggers #5

Merged
merged 1 commit into from
Jun 18, 2024
Merged

Workflow Triggers #5

merged 1 commit into from
Jun 18, 2024

Conversation

dkovvuri
Copy link
Collaborator

Reason for this change

This change introduces a new construct for creating and managing AWS Glue Workflows and Triggers. AWS Glue Workflows are orchestration services that allow users to create, manage, and monitor complex extract, transform, and load (ETL) activities involving multiple crawlers, jobs, and triggers. The new construct provides a convenient way to define and configure Glue Workflows and different types of triggers, such as on-demand, scheduled, event-based, and conditional triggers.

Description of changes

The following changes have been made:

  1. Added a new Workflow construct that extends the WorkflowBase class.
  2. Implemented methods in the WorkflowBase class to add different types of triggers (on-demand, scheduled, event-based, and conditional) to the Workflow.
  3. Added helper methods to render actions, predicates, and event batching conditions for the triggers.
  4. Implemented import functionality to import existing Workflows using their name or ARN.

Description of how you validated changes

Unit tests have been added to validate the behavior of the Workflow construct and the different types of triggers. The tests cover the following scenarios:

  1. Creating a Workflow with different types of triggers (on-demand, scheduled, event-based, and conditional).
  2. Verifying the correct rendering of actions, predicates, and event batching conditions for the triggers.
  3. Importing an existing Workflow using its name or ARN.
  4. Testing error handling for invalid inputs, such as providing both job and crawler for an action, or providing job without job state for a condition.

Checklist


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

@natalie-white-aws natalie-white-aws merged commit 72818b0 into mjanardhan:main Jun 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants