v1.9.0a4

(More work to come in the stable 1.9 release)

Breaking changes

• When using LoadMode.DBT_LS, Cosmos will now attempt to use the dbtRunner as opposed to subprocess to run dbt ls. While this represents significant performance improvements (half the vCPU usage and some memory consumption improvement), this may not work in scenarios where users had multiple Python virtual environments to manage different versions of dbt and its adaptors. In those cases, please set RenderConfig(invocation_mode=InvocationMode.SUBPROCESS) to have the same behaviour Cosmos had in previous versions. Additional information here and here.

Features

• Use dbtRunner in the DAG Processor when using LoadMode.DBT_LS if dbt-core is available by @tatiana in #1484. Additional information here.
• Allow users to opt-out of dbtRunner during DAG parsing with InvocationMode.SUBPROCESS by @tatiana in #1495. Check out the documentation.
• Add structure to support multiple db for async operator execution by @pankajastro in #1483
• Support overriding the profile_config per dbt node or folder using config by @tatiana in #1492. More information here.

Bug Fixes

• Fix select complex intersection of three tag-based graph selectors by @tatiana in #1466

Enhancement

• Fix OpenLineage deprecation warning by @CorsettiS in #1449
• Move DbtRunner related functions into dbt/runner.py module by @tatiana in #1480

Others

• GitHub Actions Dependabot: #1487
• Pre-commit updates: #1473, #1493

Cut from: main after merging #1492