[Feature] Enable execution mode for AWS ECS tasks

[romina-nikolova]

Description

Similarly to the Azure Container Instance execution mode, it would be super useful to have an AWS ECS execution mode supported! Alternatively, could a different mode be used to run ECS tasks?

Use case/motivation

Enrich scope of Cosmos

Related issues

(#635)

Are you willing to submit a PR?

• Yes, I am willing to submit a PR!

[tatiana]

@romina-nikolova, we would gladly receive a contribution in this area; thanks for suggesting it!

[nicor88]

@tatiana I might be interested to contribute to this feature.

Do you have any guidelines to start with?

[aoelvp94]

@tatiana I might be interested to contribute to this feature.

Do you have any guidelines to start with?

Some of my workmates were working on this https://github.com/MuttData/astronomer-cosmos/tree/feat/aws-ecs-task-run-execution-mode/ in case you want to take that development. Tests and docs would be great to have for having this feature completely. WDYT @tatiana @nicor88 ?

[tatiana]

This is looking great, @aoelvp94 ! Please, could you create a PR with these changes?

I agree we'd need tests and docs. Is this something your team would have the capacity or would you need help?

@nicor88 our contribution guidelines:
https://github.com/astronomer/astronomer-cosmos/blob/main/docs/contributing.rst

And some examples of similar PRs:

• https://github.com/astronomer/astronomer-cosmos/pull/771/files
• https://github.com/astronomer/astronomer-cosmos/pull/1153/files

We're aiming to release Cosmos 1.9 on the 14th of February - we may be able to add this with your help.

[aoelvp94]

This is looking great, @aoelvp94 ! Please, could you create a PR with these changes?

I agree we'd need tests and docs. Is this something your team would have the capacity or would you need help?

@nicor88 our contribution guidelines: https://github.com/astronomer/astronomer-cosmos/blob/main/docs/contributing.rst

And some examples of similar PRs:

• https://github.com/astronomer/astronomer-cosmos/pull/771/files
• https://github.com/astronomer/astronomer-cosmos/pull/1153/files

We're aiming to release Cosmos 1.9 on the 14th of February - we may be able to add this with your help.

We are testing the feature on ECS just to make sure it works. We want to have the PR with the feature already tested on ECS and the pending stuff like docs and tests for next week :)