Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compatibility for dbt v0.20, dbt-utils v0.7, spark3 #15

Merged
merged 1 commit into from
Jul 7, 2021

Conversation

jtcohen6
Copy link
Collaborator

@jtcohen6 jtcohen6 commented Jun 6, 2021

Nothing here is a breaking change:

  • There are a few small tweaks to dateadd and datediff
  • The addition of concat, to account for dbt_utils.default__concat switching from concat() to || in 0.7.0 (but this is backwards compatible with older versions of dbt-utils)

The integration tests update to the latest dispatch project config syntax.

Before merge

  • Wait for dbt-spark==0.20.0rc1
  • Wait for dbt-utils==0.7.0
  • Will need to upgrade dockerized Spark version to 3 (I haven't been able to get this working), or use Databricks cluster for dbt-utils testing as well

@jtcohen6 jtcohen6 marked this pull request as ready for review June 9, 2021 02:11
@jtcohen6 jtcohen6 changed the title WIP compatibility for dbt v0.20, dbt-utils v0.7, spark3 Compatibility for dbt v0.20, dbt-utils v0.7, spark3 Jun 9, 2021
@jtcohen6 jtcohen6 force-pushed the feat/utils-070-spark3-compat branch from 6973527 to 0b22c81 Compare July 7, 2021 01:17
@jtcohen6 jtcohen6 merged commit f391be1 into master Jul 7, 2021
@jtcohen6 jtcohen6 deleted the feat/utils-070-spark3-compat branch July 7, 2021 01:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant