-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Sync #69
Sync #69
Commits on May 19, 2023
-
break out a large test suite as a separate execution to avoid memory …
…issues on windows CI runs (#7669)
Configuration menu - View commit details
-
Copy full SHA for 87ea28f - Browse repository at this point
Copy the full SHA 87ea28fView commit details
Commits on May 22, 2023
-
Remove
DelayedFileHandler
(#7661)* remove DelayedFileHandler * Changelog * set_path to no-op * more no-ops for rpc * Clearer comments
Configuration menu - View commit details
-
Copy full SHA for 265e09d - Browse repository at this point
Copy the full SHA 265e09dView commit details
Commits on May 23, 2023
-
* CT-2461: Work toward model deprecation * CT-2461: Remove unneeded conversions * CT-2461: Fix up unit tests for new fields, correct a couple oversights * CT-2461: Remaining implementation and tests for model/ref deprecation warnings * CT-2461: Changelog entry for deprecation warnings * CT-2461: Refine datetime handling and tests * CT-2461: Fix up unit test data * CT-2461: Fix some more unit test data. * CT-2461: Fix merge issues * CT-2461: Code review items. * CT-2461: Improve version -> str conversion
Configuration menu - View commit details
-
Copy full SHA for 4a4b7be - Browse repository at this point
Copy the full SHA 4a4b7beView commit details -
Configuration menu - View commit details
-
Copy full SHA for c25d0c9 - Browse repository at this point
Copy the full SHA c25d0c9View commit details -
Honor
--skip-profile-setup
parameter when inside an existing project (#7609) * Honor `--skip-profile-setup` parameter when inside an existing project * Use project name as the profile name * Use separate file connections for reading and writing * Raise a custom exception when no adapters are installed * Test skipping interactive profile setup when inside a dbt project * Replace `assert_not_called()` since it does not work * Verbose CLI argument for skipping profile setup * Use separate file connections for reading and writing * Check empty list in a Pythonic manner
Configuration menu - View commit details
-
Copy full SHA for 0f22366 - Browse repository at this point
Copy the full SHA 0f22366View commit details
Commits on May 24, 2023
-
Include null checks in utils test base (#7672)
* Include null checks in utils test base * Add tests for the schema test * Add tests for this macro --------- Co-authored-by: Mila Page <versusfacit@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0d71a32 - Browse repository at this point
Copy the full SHA 0d71a32View commit details -
Bump ubuntu from 23.04 to 23.10 (#7675)
* Bump ubuntu from 23.04 to 23.10 Bumps ubuntu from 23.04 to 23.10. --- updated-dependencies: - dependency-name: ubuntu dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> * Add automated changelog yaml from template for bot PR --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com>
Configuration menu - View commit details
-
Copy full SHA for 0fe3ee8 - Browse repository at this point
Copy the full SHA 0fe3ee8View commit details -
Adding performance modeling for 1.3.4 to refs/heads/main (#7525)
* adding performance baseline for 1.3.4 * Add newline --------- Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: leahwicz <60146280+leahwicz@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 9373c4d - Browse repository at this point
Copy the full SHA 9373c4dView commit details -
Adding performance modeling for 1.4.1 to refs/heads/main (#7527)
* adding performance baseline for 1.4.1 * Add newline --------- Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: leahwicz <60146280+leahwicz@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for b88e60f - Browse repository at this point
Copy the full SHA b88e60fView commit details -
Adding performance modeling for 1.3.0 to refs/heads/main (#7530)
* adding performance baseline for 1.3.0 * Add newline --------- Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: leahwicz <60146280+leahwicz@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 3b6222e - Browse repository at this point
Copy the full SHA 3b6222eView commit details -
Adding performance modeling for 1.4.6 to refs/heads/main (#7532)
* adding performance baseline for 1.4.6 * Add newline --------- Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: leahwicz <60146280+leahwicz@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f99be58 - Browse repository at this point
Copy the full SHA f99be58View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0516192 - Browse repository at this point
Copy the full SHA 0516192View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1fdebc6 - Browse repository at this point
Copy the full SHA 1fdebc6View commit details -
Updating CODEOWNERS to consolidate (#7693)
Consolidating to remove Language and Execution and instead default to the `core-team`
Configuration menu - View commit details
-
Copy full SHA for 70a132d - Browse repository at this point
Copy the full SHA 70a132dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7c1bd91 - Browse repository at this point
Copy the full SHA 7c1bd91View commit details
Commits on May 25, 2023
-
Configuration menu - View commit details
-
Copy full SHA for a3d40e0 - Browse repository at this point
Copy the full SHA a3d40e0View commit details -
[Automated] Merged prep-release/1.6.0b2_5081502847 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for feb06e2 - Browse repository at this point
Copy the full SHA feb06e2View commit details
Commits on May 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for aa11cf2 - Browse repository at this point
Copy the full SHA aa11cf2View commit details -
Add
%
to adapter suite test cases forpersist_docs
(#7699)* Test table/view/column-level comments with `%` symbol * Test docs block with `%` symbol * Changelog entry
Configuration menu - View commit details
-
Copy full SHA for 620ca40 - Browse repository at this point
Copy the full SHA 620ca40View commit details -
Update to reusable workflow for branch testing (#7676)
* fix overlooked node12 case with abandonded marketplace action * update slack notification * remove spaces per formatting * replace with cli dispatch * move conditional * add explicit token, temp comment out slack * add checkout * checkout teh right branch * switch to PAT * add back repo checkout * manually check workflow status * fix notification * swap to reusable workflow * fix path * swap permissions * remove trigger * fix secrets * point to main
Configuration menu - View commit details
-
Copy full SHA for ac16a55 - Browse repository at this point
Copy the full SHA ac16a55View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7e3a6ee - Browse repository at this point
Copy the full SHA 7e3a6eeView commit details -
Target path should be relative to project dir, rather than current wo…
…rking directory (#7706)
Configuration menu - View commit details
-
Copy full SHA for 38ca4fc - Browse repository at this point
Copy the full SHA 38ca4fcView commit details
Commits on May 28, 2023
-
Adding performance modeling for 1.2.0 to refs/heads/main (#7560)
* adding performance baseline for 1.2.0 * Adding newline --------- Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: leahwicz <60146280+leahwicz@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 1ac6df0 - Browse repository at this point
Copy the full SHA 1ac6df0View commit details
Commits on May 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9c7e01d - Browse repository at this point
Copy the full SHA 9c7e01dView commit details -
Configuration menu - View commit details
-
Copy full SHA for fd301a3 - Browse repository at this point
Copy the full SHA fd301a3View commit details -
Template rendering optimization (#7451)
* CT-2478: Template rendering optimization * CT-2478: Fix type annotation, and accomodate non-string unit test cases.
Configuration menu - View commit details
-
Copy full SHA for 00a531d - Browse repository at this point
Copy the full SHA 00a531dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 45d6145 - Browse repository at this point
Copy the full SHA 45d6145View commit details
Commits on Jun 1, 2023
-
add ability to select models by access (#7739)
* add ability to select models by access * changie * Update core/dbt/graph/selector_methods.py
Configuration menu - View commit details
-
Copy full SHA for 9dd5ab9 - Browse repository at this point
Copy the full SHA 9dd5ab9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7a06d35 - Browse repository at this point
Copy the full SHA 7a06d35View commit details
Commits on Jun 2, 2023
-
Fix doc link in selector.py (#7755)
* Fix doc link in selector.py * Ran changie to modify changelog entry
Configuration menu - View commit details
-
Copy full SHA for e1d7a53 - Browse repository at this point
Copy the full SHA e1d7a53View commit details -
Configuration menu - View commit details
-
Copy full SHA for 05b0ebb - Browse repository at this point
Copy the full SHA 05b0ebbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7917bd5 - Browse repository at this point
Copy the full SHA 7917bd5View commit details
Commits on Jun 5, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 79bd985 - Browse repository at this point
Copy the full SHA 79bd985View commit details -
Configuration menu - View commit details
-
Copy full SHA for 89541fa - Browse repository at this point
Copy the full SHA 89541faView commit details -
remove entire changes folder (#7766)
Co-authored-by: Kshitij Aranke <kshitij.aranke@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 4dbc4a4 - Browse repository at this point
Copy the full SHA 4dbc4a4View commit details -
log PublicationArtifactAvailable even when partially parsing & public…
… models unchanged (#7783)
Configuration menu - View commit details
-
Copy full SHA for 60d116b - Browse repository at this point
Copy the full SHA 60d116bView commit details -
Configuration menu - View commit details
-
Copy full SHA for dc35f56 - Browse repository at this point
Copy the full SHA dc35f56View commit details
Commits on Jun 6, 2023
-
Fix not equals comparison to be null-safe for adapters/utils tests (#…
…7776) * Fix names within functional test * Changelog entry * Test for implementation of null-safe equals comparison * Remove duplicated where filter * Fix null-safe equals comparison * Fix tests for `concat` and `hash` by using empty strings () instead of `null` * Remove macro namespace interpolation
Configuration menu - View commit details
-
Copy full SHA for 8e1c4ec - Browse repository at this point
Copy the full SHA 8e1c4ecView commit details -
Improve warnings for constraints and materialization types (#7696)
* first pass * debugging * regen proto types * refactor to use warn_supported flag * PR feedback
Configuration menu - View commit details
-
Copy full SHA for 587bbcb - Browse repository at this point
Copy the full SHA 587bbcbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6a22ec1 - Browse repository at this point
Copy the full SHA 6a22ec1View commit details -
Configuration menu - View commit details
-
Copy full SHA for dd445e1 - Browse repository at this point
Copy the full SHA dd445e1View commit details -
Fixes #7551: Create
add_from_artifact
to populatestate_relation
……field of nodes (#7796)
Configuration menu - View commit details
-
Copy full SHA for 84166bf - Browse repository at this point
Copy the full SHA 84166bfView commit details
Commits on Jun 7, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 3b63dd9 - Browse repository at this point
Copy the full SHA 3b63dd9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 444c787 - Browse repository at this point
Copy the full SHA 444c787View commit details -
Adap 496/add test connection mode to debug (#7741)
* --connection-flag * Standardize the plugin functions used by DebugTask * Cleanup redundant code and help logic along. * Add more output tests to add logic coverage and formatting. * Code review --------- Co-authored-by: Mila Page <versusfacit@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 919822e - Browse repository at this point
Copy the full SHA 919822eView commit details -
Configuration menu - View commit details
-
Copy full SHA for f4253da - Browse repository at this point
Copy the full SHA f4253daView commit details -
ADAP-2: Materialized Views (#7239)
* changie * ADAP-387: Stub materialized view as a materialization (#7211) * init attempt at mv and basic forms of helper macros by mixing view and experimental mv sources * init attempt at mv and basic forms of helper macros by mixing view and experimental mv sources * remove unneeded return statement, rename directory * remove unneeded () * responding to some pr feedback * adjusting order of events for mv base work * move up prexisting drop of backup * change relatiion type to view to be consistent * add base test case * fix jinja exeception message expression, basic test passing * response to feedback, removeal of refresh infavor of combined create_as, etc. * swapping to api layer and stratgeies for default implementation (basing off postgres, redshift) * remove stratgey to limit need for now * remove unneeded story level changelog entry * add strategies to condtional in place of old macros * macro name fix * rename refresh macro in api level * align names between postgres and default to same convention * align names between postgres and default to same convention * change a create call to full refresh * pull adapter rename into strategy, add backup_relation as optional arg * minor typo fix, add intermediate relation to refresh strategy and initial attempt at further conditional logic * updating to feature main --------- Co-authored-by: Matthew McKnight <matthew.mcknight@dbtlabs.com> * ADAP-387: reverting db_api implementation (#7322) * changie * init attempt at mv and basic forms of helper macros by mixing view and experimental mv sources * remove unneeded return statement, rename directory * remove unneeded () * responding to some pr feedback * adjusting order of events for mv base work * move up prexisting drop of backup * change relatiion type to view to be consistent * add base test case * fix jinja exeception message expression, basic test passing * response to feedback, removeal of refresh infavor of combined create_as, etc. * swapping to api layer and stratgeies for default implementation (basing off postgres, redshift) * remove stratgey to limit need for now * remove unneeded story level changelog entry * add strategies to condtional in place of old macros * macro name fix * rename refresh macro in api level * align names between postgres and default to same convention * change a create call to full refresh * pull adapter rename into strategy, add backup_relation as optional arg * minor typo fix, add intermediate relation to refresh strategy and initial attempt at further conditional logic * updating to feature main * removing db_api and strategies directories in favor of matching current materialization setups * macro name change * revert to current approach for materializations * added tests * added `is_materialized_view` to `BaseRelation` * updated materialized view stored value to snake case * typo * moved materialized view tests into adapter test framework * add enum to relation for comparison in jinja --------- Co-authored-by: Mike Alfare <mike.alfare@dbtlabs.com> * ADAP-391: Add configuration change option (#7272) * changie * init attempt at mv and basic forms of helper macros by mixing view and experimental mv sources * move up pre-existing drop of backup * change relation type to view to be consistent * add base test case * fix jinja exception message expression, basic test passing * align names between postgres and default to same convention * init set of Enum for config * work on initial Enum class for on_configuration_change base it off ConstraintTypes which is also a str based Enum in core * add on_configuration_change to unit test expected values * make suggested name change to Enum class * add on_configuration_change to some integration tests * add on_configuration_change to expected_manifest to pass functional tests * added `is_materialized_view` to `BaseRelation` * updated materialized view stored value to snake case * moved materialized view tests into adapter test framework * add alter materialized view macro * change class name, and config setup * play with field setup for on_configuration_change * add method for default selection in enum class * renamed get_refresh_data_in_materialized_view_sql to align with experimental package * changed expected values to default string * added in `on_configuration_change` setting * change ignore to skip * updated default option for on_configuration_change on NodeConfig * removed explicit calls to enum values * add test setup for testing fail config option * updated `config_updates` to `configuration_changes` to align with `on_configuration_change` name * setup configuration change framework * skipped tests that are expected to fail without adapter implementation * cleaned up log checks --------- Co-authored-by: Mike Alfare <mike.alfare@dbtlabs.com> * ADAP-388: Stub materialized view as a materialization - postgres (#7244) * move the body of the default macros into the postgres implementation, throw errors if the default is used, indicating that materialized views have not been implemented for that adapter --------- Co-authored-by: Matthew McKnight <matthew.mcknight@dbtlabs.com> * ADAP-402: Add configuration change option - postgres (#7334) * changie * init attempt at mv and basic forms of helper macros by mixing view and experimental mv sources * remove unneeded return statement, rename directory * remove unneeded () * responding to some pr feedback * adjusting order of events for mv base work * move up prexisting drop of backup * change relatiion type to view to be consistent * add base test case * fix jinja exeception message expression, basic test passing * added materialized view stubs and test * response to feedback, removeal of refresh infavor of combined create_as, etc. * updated postgres to use the new macros structure * swapping to api layer and stratgeies for default implementation (basing off postgres, redshift) * remove stratgey to limit need for now * remove unneeded story level changelog entry * add strategies to condtional in place of old macros * macro name fix * rename refresh macro in api level * align names between postgres and default to same convention * change a create call to full refresh * pull adapter rename into strategy, add backup_relation as optional arg * minor typo fix, add intermediate relation to refresh strategy and initial attempt at further conditional logic * init copy of pr 387 to begin 391 implementation * init set of Enum for config * work on initial Enum class for on_configuration_change base it off ConstraintTypes which is also a str based Enum in core * remove postgres-specific materialization in favor of core default materialization * update db_api to use native types (e.g. str) and avoid direct calls to relation or config, which would alter the run order for all db_api dependencies * add clarifying comment as to why we have a single test that's expected to fail at the dbt-core layer * add on_configuration_change to unit test expected values * make suggested name change to Enum class * add on_configuration_change to some integretion tests * add on_configuration_change to expected_manifest to pass functuional tests * removing db_api and strategies directories in favor of matching current materialization setups * macro name change * revert to current approach for materializations * revert to current approach for materializations * added tests * move materialized view logic into the `/materializations` directory in line with `dbt-core` * moved default macros in `dbt-core` into `dbt-postgres` * added `is_materialized_view` to `BaseRelation` * updated materialized view stored value to snake case * moved materialized view tests into adapter test framework * updated materialized view tests to use adapter test framework * add alter materialized view macro * add alter materialized view macro * change class name, and config setup * change class name, and config setup * play with field setup for on_configuration_change * add method for default selection in enum class * renamed get_refresh_data_in_materialized_view_sql to align with experimental package * changed expected values to default string * added in `on_configuration_change` setting * change ignore to skip * added in `on_configuration_change` setting * updated default option for on_configuration_change on NodeConfig * updated default option for on_configuration_change on NodeConfig * fixed list being passed as string bug * removed explicit calls to enum values * removed unneeded test class * fixed on_configuration_change to be picked up appropriately * add test setup for testing fail config option * remove breakpoint, uncomment tests * update skip scenario to use empty strings * update skip scenario to avoid using sql at all, remove extra whitespace in some templates * push up initial addition of indexes for mv macro * push slight change up * reverting alt macro and moving the do create_index call to be more in line with other materializations * Merge branch 'feature/materialized-views/ADAP-2' into feature/materialized-views/ADAP-402 # Conflicts: # core/dbt/contracts/graph/model_config.py # core/dbt/include/global_project/macros/materializations/models/materialized_view/alter_materialized_view.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/create_materialized_view_as.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/get_materialized_view_configuration_changes.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/materialized_view.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/refresh_materialized_view.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/replace_materialized_view.sql # plugins/postgres/dbt/include/postgres/macros/materializations/materialized_view.sql # tests/adapter/dbt/tests/adapter/materialized_views/base.py # tests/functional/materializations/test_materialized_view.py * merge feature branch into story branch * merge feature branch into story branch * added indexes into the workflow * fix error in jinja that caused print error * working on test messaging and skipping tests that might not fit quite into current system * add drop and show macros for indexes * add drop and show macros for indexes * add logic to determine the indexes to create or drop * pulled index updates through the workflow properly * convert configuration changes to fixtures, implement index changes into tests * created Model dataclass for readability, added column to swap index columns for testing * fixed typo --------- Co-authored-by: Matthew McKnight <matthew.mcknight@dbtlabs.com> * ADAP-395: Implement native materialized view DDL (#7336) * changie * changie * init attempt at mv and basic forms of helper macros by mixing view and experimental mv sources * init attempt at mv and basic forms of helper macros by mixing view and experimental mv sources * remove unneeded return statement, rename directory * remove unneeded () * responding to some pr feedback * adjusting order of events for mv base work * move up prexisting drop of backup * change relatiion type to view to be consistent * add base test case * fix jinja exeception message expression, basic test passing * added materialized view stubs and test * response to feedback, removeal of refresh infavor of combined create_as, etc. * updated postgres to use the new macros structure * swapping to api layer and stratgeies for default implementation (basing off postgres, redshift) * remove stratgey to limit need for now * remove unneeded story level changelog entry * add strategies to condtional in place of old macros * macro name fix * rename refresh macro in api level * align names between postgres and default to same convention * align names between postgres and default to same convention * change a create call to full refresh * pull adapter rename into strategy, add backup_relation as optional arg * minor typo fix, add intermediate relation to refresh strategy and initial attempt at further conditional logic * init copy of pr 387 to begin 391 implementation * updating to feature main * updating to feature main * init set of Enum for config * work on initial Enum class for on_configuration_change base it off ConstraintTypes which is also a str based Enum in core * remove postgres-specific materialization in favor of core default materialization * update db_api to use native types (e.g. str) and avoid direct calls to relation or config, which would alter the run order for all db_api dependencies * add clarifying comment as to why we have a single test that's expected to fail at the dbt-core layer * add on_configuration_change to unit test expected values * make suggested name change to Enum class * add on_configuration_change to some integretion tests * add on_configuration_change to expected_manifest to pass functuional tests * removing db_api and strategies directories in favor of matching current materialization setups * macro name change * revert to current approach for materializations * revert to current approach for materializations * added tests * move materialized view logic into the `/materializations` directory in line with `dbt-core` * moved default macros in `dbt-core` into `dbt-postgres` * added `is_materialized_view` to `BaseRelation` * updated materialized view stored value to snake case * typo * moved materialized view tests into adapter test framework * updated materialized view tests to use adapter test framework * add alter materialized view macro * add alter materialized view macro * added basic sql to default macros, added postgres-specific sql for alter scenario, stubbed a test case for index update * change class name, and config setup * change class name, and config setup * play with field setup for on_configuration_change * add method for default selection in enum class * renamed get_refresh_data_in_materialized_view_sql to align with experimental package * changed expected values to default string * added in `on_configuration_change` setting * change ignore to skip * added in `on_configuration_change` setting * updated default option for on_configuration_change on NodeConfig * updated default option for on_configuration_change on NodeConfig * fixed list being passed as string bug * fixed list being passed as string bug * removed explicit calls to enum values * removed explicit calls to enum values * removed unneeded test class * fixed on_configuration_change to be picked up appropriately * add test setup for testing fail config option * remove breakpoint, uncomment tests * update skip scenario to use empty strings * update skip scenario to avoid using sql at all, remove extra whitespace in some templates * push up initial addition of indexes for mv macro * push slight change up * reverting alt macro and moving the do create_index call to be more in line with other materializations * Merge branch 'feature/materialized-views/ADAP-2' into feature/materialized-views/ADAP-402 # Conflicts: # core/dbt/contracts/graph/model_config.py # core/dbt/include/global_project/macros/materializations/models/materialized_view/alter_materialized_view.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/create_materialized_view_as.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/get_materialized_view_configuration_changes.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/materialized_view.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/refresh_materialized_view.sql # core/dbt/include/global_project/macros/materializations/models/materialized_view/replace_materialized_view.sql # plugins/postgres/dbt/include/postgres/macros/materializations/materialized_view.sql # tests/adapter/dbt/tests/adapter/materialized_views/base.py # tests/functional/materializations/test_materialized_view.py * merge feature branch into story branch * merge feature branch into story branch * added indexes into the workflow * fix error in jinja that caused print error * working on test messaging and skipping tests that might not fit quite into current system * Merge branch 'feature/materialized-views/ADAP-2' into feature/materialized-views/ADAP-395 # Conflicts: # core/dbt/include/global_project/macros/materializations/models/materialized_view/get_materialized_view_configuration_changes.sql # plugins/postgres/dbt/include/postgres/macros/adapters.sql # plugins/postgres/dbt/include/postgres/macros/materializations/materialized_view.sql # tests/adapter/dbt/tests/adapter/materialized_views/test_on_configuration_change.py # tests/functional/materializations/test_materialized_view.py * moved postgres implemention into plugin directory * update index methods to align with the configuration update macro * added native ddl to postgres macros * removed extra docstring * updated references to View, now references MaterializedView * decomposed materialization into macros * refactor index create statement parser, add exceptions for unexpected formats * swapped conditional to check for positive state * removed skipped test now that materialized view is being used * return the results and logs of the run so that additional checks can be applied at the adapter level, add check for refresh to a test * add check for indexes in particular for apply on configuration scenario * removed extra argument * add materialized views to get_relations / list_relations * typos in index change logic * moved full refresh check inside the build sql step --------- Co-authored-by: Matthew McKnight <matthew.mcknight@dbtlabs.com> * removing returns from tests to stop logs from printing * moved test cases into postgres tests, left non-test functionality in base as new methods or fixtures * fixed overwrite issue, simplified assertion method * updated import order to standard * fixed test import paths * updated naming convention for proper test collection with the test runner * still trying to make the test runner happy * rewrite index updates to use a better source in Postgres * break out a large test suite as a separate run * update `skip` and `fail` scenarios with more descriptive results * typo * removed call to skip status * reverting `exceptions_jinja.py` * added FailFastError back, the right way * removed PostgresIndex in favor of the already existing PostgresIndexConfig, pulled it into its own file to avoid circular imports * removed assumed models in method calls, removed odd insert records and replaced with get row count * fixed index issue, removed some indirection in testing * made test more readable * remove the "apply" from the tests and put it on the base as the default * generalized assertion for reuse with dbt-snowflake, fixed bug in record count utility * fixed type to be more generic to accommodate adapters with their own relation types * fixed all the broken index stuff * updated on_configuration_change to use existing patterns * updated on_configuration_change to use existing patterns * reflected update in tests and materialization logic * reflected update in tests and materialization logic * reverted the change to create a config object from the option object, using just the option object now * reverted the change to create a config object from the option object, using just the option object now * modelled database objects to support monitoring all configuration changes * updated "skip" to "continue", throw an error on non-implemented macro defaults * updated "skip" to "continue", throw an error on non-implemented macro defaults * updated "skip" to "continue", throw an error on non-implemented macro defaults * updated "skip" to "continue", throw an error on non-implemented macro defaults * reverted centralized framework, retained a few reusable base classes * updated names to be more consistent * readability updates * added readme specifying that `relation_configs` only supports materialized views for now --------- Co-authored-by: Matthew McKnight <matthew.mcknight@dbtlabs.com> Co-authored-by: Matthew McKnight <91097623+McKnight-42@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 2d23782 - Browse repository at this point
Copy the full SHA 2d23782View commit details
Commits on Jun 8, 2023
-
Add SemanticModel Node Type (#7769)
* Add dbt-semantic-interfaces as a dependency With the integration with MetricFlow we're taking a dependency on `dbt-semantic-interfaces` which acts as the source of truth for protocols which MetricFlow and dbt-core need to agree on. Additionally we're hard pinning to 0.1.0.dev3 for now. We plan on having a less restrictive specification when dbt-core 1.6 hits GA. * Add implementations of DSI Metadata protocol to nodes.py * CT-2521: Initial work on adding new SemanticModel node * CT-2521: Second rough draft of SemanticModels * CT-2521: Update schema v10 * CT-2521: Update unit tests for new SemanticModel collection in manifest * CT-2521: Add changelog entry * CT-2521: Final touches on initial implementation of SemanticModel parsing * Change name of Metadata class to reduce potential for confusion * Remove "Replaceable" inheritance, per review * CT-2521: Rename internal variables from semantic_models to semantic_nodes * CT-2521: Update manifest schema to reflect change --------- Co-authored-by: Quigley Malcolm <quigley.malcolm@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for a89da7c - Browse repository at this point
Copy the full SHA a89da7cView commit details -
Update spec MetricNode for dbt x MetricFlow integration and begin out…
…putting semantic manifest artifact (#7812) * Refactor MetricNode definition to satisfy DSI Metric protocol * Fix tests involving metrics to have updated properties * Update UnparsedMetricNode to match new metric yaml spec * Update MetricParser for new unparsed and parsed MetricNodes * Remove `rename_metric_attr` We're intentionally breaking the spec. There will be a separate tool provided for migrating from dbt-metrics to dbt x metricflow. This bit of code was renaming things like `type` to `calculation_method`. This is problematic because `type` is on the new spec, while `calculation_method` is not. Additionally, since we're intentionally breaking the spec, this function, `rename_metric_attr`, shouldn't be used for any property renaming. * Fix tests for Metrics (1.6) changes * Regenerated v10 manifest schema and associated functional test artifact state * Remove no longer needed tests * Skip / comment out tests for metrics functionality that we'll be implementing later * Begin outputting semantic manifest artifact on every run * Drop metrics during upgrade_manifest_json if manifest is v9 or before * Update properties of `minimal_parsed_metric_dict` to match new metric spec * Add changie entry for metric node breaking changes * Add semantic model nodes to semantic manifest
Configuration menu - View commit details
-
Copy full SHA for 98d1a94 - Browse repository at this point
Copy the full SHA 98d1a94View commit details -
Configuration menu - View commit details
-
Copy full SHA for cb64682 - Browse repository at this point
Copy the full SHA cb64682View commit details -
[Automated] Merged prep-release/1.6.0b3_5215324721 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for 6f51de4 - Browse repository at this point
Copy the full SHA 6f51de4View commit details
Commits on Jun 12, 2023
-
Rm spaces from NodeType strings (#7842)
* Rm space from NodeType strings * Add changelog entry
Configuration menu - View commit details
-
Copy full SHA for 5f9e527 - Browse repository at this point
Copy the full SHA 5f9e527View commit details -
Configuration menu - View commit details
-
Copy full SHA for f9abeca - Browse repository at this point
Copy the full SHA f9abecaView commit details
Commits on Jun 13, 2023
-
Move remaining unit tests to
/tests
directory (#7843)* moved remaining unit tests to directory * fix path * Delete profiles.yml * rename remaining test refs
Configuration menu - View commit details
-
Copy full SHA for 4a833a4 - Browse repository at this point
Copy the full SHA 4a833a4View commit details -
Use project directory in path selector instead of cwd (#7829)
* Use contextvar to store and get project_root for path selector method * Changie * Modify test to check Path selector with project-dir * Don't set cv_project_root in base task if no config
Configuration menu - View commit details
-
Copy full SHA for ca73a2a - Browse repository at this point
Copy the full SHA ca73a2aView commit details -
* update adapters url in response to [docs.getedbt.com pr 3465](https://github.com/dbt-labs/docs.getdbt.com/issues/3465), updating this error message to point to the correct URL, which was recently changed. old URL: https://docs.getdbt.com/docs/supported-data-platforms#adapter-installation new URL: https://docs.getdbt.com/docs/connect-adapters#install-using-the-cli thank you @dbeatty10 for your 🦅 👀 ! * adding changie entry * Update .changes/unreleased/Breaking Changes-20230612-161159.yaml --------- Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 60524c0 - Browse repository at this point
Copy the full SHA 60524c0View commit details -
Allow ProjectDependency to have extra fields (#7834)
* Allow ProjectDependency to have extra fields * changelog
Configuration menu - View commit details
-
Copy full SHA for d46e885 - Browse repository at this point
Copy the full SHA d46e885View commit details -
Configuration menu - View commit details
-
Copy full SHA for 83d163a - Browse repository at this point
Copy the full SHA 83d163aView commit details -
Update SemanticModel node to match DSI 0.1.0dev3 protocols (#7848)
* Add tests to ensure our semantic layer nodes satisfy the DSI protocols These tests create runtime checkable versions of the protocols defined in DSI. Thus we can instantiate instances of our semantic layer nodes and use `isinstance` to check that they satisfy the protocol. These `runtime_checkable` versions of the protocols should only exist in testing and should never be used in the actual package code. * Update the `Dimension` object of `SemanticModel` node to match DSI protocol * Make `UnparsedDimension` more strict and update schema readers accordingly * Update the `Entity` object of `SemanticModel` node to match DSI protocol * Make `UnparsedEntity` more strict and update schema readers accordingly * Update the `Measure` object of `SemanticModel` node to match DSI protocol * Make `UnparsedMeasure` more strict and update schema readers accordingly * Update the `SemanticModel` node to match DSI protocol A lot of the additions are helper functions which we don't actually use in core. This is a known issue. We're in the process of removing a fair number of them from the DSI protocol spec. However, in the meantime we need to implement them to satisfy the protocol unfortunately. * Make `UnparsedSemanticModel` more strict and update schema readers accordingly * Changie entry for updating SemanticModel node
Configuration menu - View commit details
-
Copy full SHA for 38c0600 - Browse repository at this point
Copy the full SHA 38c0600View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7068688 - Browse repository at this point
Copy the full SHA 7068688View commit details -
[Automated] Merged prep-release/1.6.0b4_5260249343 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for b947b2b - Browse repository at this point
Copy the full SHA b947b2bView commit details
Commits on Jun 14, 2023
-
Fix:
dbt show --inline
withprivate
models (#7838)* Add functional test * Check resource_type before DbtReferenceError * Changelog entry
Configuration menu - View commit details
-
Copy full SHA for f16bae0 - Browse repository at this point
Copy the full SHA f16bae0View commit details -
Bump mypy from 0.981 to 1.0.1 (#7027)
* Bump mypy from 0.981 to 1.0.1 Bumps [mypy](https://github.com/python/mypy) from 0.981 to 1.0.1. - [Release notes](https://github.com/python/mypy/releases) - [Commits](python/mypy@v0.981...v1.0.1) --- updated-dependencies: - dependency-name: mypy dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * Add automated changelog yaml from template for bot PR * upgrade mypy and fix all errors * fixing some duplicate imports from conflict resolution * fix mypy errors from merging in main --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for ae97831 - Browse repository at this point
Copy the full SHA ae97831View commit details -
Add AdapterRegistered event log message (#7862)
* Add AdapterRegistered event log message * Add AdapterRegistered to unit test * make versioning and logging consistent * make versioning and logging consistent * add to_version_string * remove extra equals * format fire_event
Configuration menu - View commit details
-
Copy full SHA for f767943 - Browse repository at this point
Copy the full SHA f767943View commit details
Commits on Jun 15, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 39e0c22 - Browse repository at this point
Copy the full SHA 39e0c22View commit details -
[CT-2696] Skip jinia parsing of metric filters (#7885)
* Update metric filters in testing fixtures I incorrectly wrote the tests such that they didn't include curly braces, `{{..}}`, around things like `dimension(..)` for filters. This updates the tests fixtures to have proper filter specifications * Skip jinja rendering of `filter` key of metrics Note that `filter` can show up in multiple places: as a root key on a metric (`metric.filter`), on a metric input (`metric.type_params.metrics[x].filter`), denominator (`metric.type_params.denominator.filter`), numerator (`metric.type_params.numerator.filter`), and a metric input measure (`metric.type_params.measure.filter` and `metric.type_params.measures[x].filter`). In this commit we skip all of them :) * Add changie doc for skipping jinja parsing for metric filters * Update yaml renderer test for metrics
Configuration menu - View commit details
-
Copy full SHA for fafab5d - Browse repository at this point
Copy the full SHA fafab5dView commit details
Commits on Jun 16, 2023
-
Ct-2690 Support dbt-semantic-interfaces 0.1.0dev5 (#7888)
* Upgrade to dbt-semantic-interfaces v0.1.0dev5 This is a fairly simple upgrade. Literally it's just pointing at the the new versions. The v3 schemas are directly compatible with v5 because there were no protocol level changes from v3 to v5. All the changers were updates to tools MetricFlow uses from DSI, not tools that we ourselves are using in core (yet). * Add changie doc for DSI version bump
Configuration menu - View commit details
-
Copy full SHA for 86583a3 - Browse repository at this point
Copy the full SHA 86583a3View commit details
Commits on Jun 20, 2023
-
Upgrade core to support dbt-semantic-interfaces
0.1.0dev7
(#7903)* Bump DSI dependency version to 0.1.0dev7 * Cleaner DSI type enum importing Previoulsy we had to use individual import paths for each type enum that dbt-semantic-interfaces provided. However, dbt-semantic-interfaces has been updated to allow for importing all the type enums from a singular path. * Cleaner DSI protocol importing Previoulsy we had to use individual import paths for each protocol that dbt-semantic-interfaces provided. However, dbt-semantic-interfaces has been updated to allow for importing all the protocols from a singular path. * Add semantic protocol satisifcation test for metric type params * Replace `metric.type_params.measures` with `metric.type_params.input_measures` In DSI 0.1.0dev7 `measures` on metric type params became `input_measures`. Additionally `input_measures` should not be user specified but something we compile at parse time, thus we've removed it from `UnparsedMetricTypeParams`. Finally, actually populating `input_measures` is somewhat complicated due to the existance of derived metrics, thus that work is being pushed off to CT-2707. * Update metric numerator/denominator to be `MetricInput`s In DSI 0.1.0dev7 `metric.type_params.numerator` and `metric.type_params.denominator` switched from being `MetricInputMeasure`s to `MetricInput`s. This commit reflects that change. Additionally, some helper functions on metric type params were removed related to the numerator and denominator. Thus we've removed them respectively in this commit. * Add protocol satisfaction tests for `MetricInput` and `MetricInputMeasure` * Add `post_aggregation_reference` to `MetricInput` and fix typo in `MetricInputMeasure` DSI 0.1.0dev7 added `post_aggregation_reference` to the `MetricInput` protocol, thus we've added it to our implementation in core. Additionally, we had a typo in a method name in our implementation of `MetricInputMeasure`, ironically a similar function to the one we've added for `MetricInput` * Changie doc for upgraded to DSI 0.1.0dev7 * Fix parsing of metric numerator and denominator in schema_yaml_readers Previously numerator and denominator of a metric were `MetricInputMeasure`s, now they're `MetricInput`s. Changing the typing isn't enough though. We have parsing functions in `schema_yaml_readers` which were specifically parsing the numerator and denominator as if they were `MetricInputMeasure`s. Thus we had to updating the schema_yaml_readers to parse them as `MetricInput`s. During this we had some logic in a parsing function `_get_metric_inputs` which could be abstracted to newly added functions.
Configuration menu - View commit details
-
Copy full SHA for 8653ffc - Browse repository at this point
Copy the full SHA 8653ffcView commit details -
Fixes #7753: Fix regression in
run-operation
to not require the nam……e of the package to run (#7811)
Configuration menu - View commit details
-
Copy full SHA for 0a1c73e - Browse repository at this point
Copy the full SHA 0a1c73eView commit details
Commits on Jun 21, 2023
-
Reorganize, annotate, and revise dependency pins (#7368)
* Reorganize + annotate dependencies * Loosen pins on other dbt-labs packages * Minor pins, no patch pins * Rm support for py37 * Fix protobuf pin * Bump networkx upper bound #6551
Configuration menu - View commit details
-
Copy full SHA for 73a0dc6 - Browse repository at this point
Copy the full SHA 73a0dc6View commit details -
Do not jinja render packages from dependencies yml (#7910)
* Add some comments to methods constructing Project/RuntimeConfig * Save flag that packages dict came from dependencies.yml * Test for not rendering packages_dict * Changie * Ensure packages_yml_dict and dependencies_yml_dict are dictionaries * Ensure "packages" passed to render_packages is a dict
Configuration menu - View commit details
-
Copy full SHA for 9ff2f6e - Browse repository at this point
Copy the full SHA 9ff2f6eView commit details -
Remove --config-dir instead of fixing #7774 (#7793)
* Stringfy the dir always to solve the bug. * Add changelog --------- Co-authored-by: Mila Page <versusfacit@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 4cdeff1 - Browse repository at this point
Copy the full SHA 4cdeff1View commit details -
Configuration menu - View commit details
-
Copy full SHA for ecf90d6 - Browse repository at this point
Copy the full SHA ecf90d6View commit details -
Further Integrate Semantic Models (#7917)
* CT-2651: Add Semantic Models to the manifest and various pieces of graph linking code * CT-2651: Finish integrating semantic models into the partial parsing system * CT-2651: More semantic model details for partial parsing * CT-2651: Remove merged references to project_dependencies * CT-2651: Revise changelog entry * CT-2651: Disable unit test until partial parsing of semantic models is complete. * CT-2651: Temporarily disable an apparently-flaky test.
Configuration menu - View commit details
-
Copy full SHA for de65697 - Browse repository at this point
Copy the full SHA de65697View commit details
Commits on Jun 22, 2023
-
Configuration menu - View commit details
-
Copy full SHA for fb1ebe4 - Browse repository at this point
Copy the full SHA fb1ebe4View commit details -
Configuration menu - View commit details
-
Copy full SHA for bf15466 - Browse repository at this point
Copy the full SHA bf15466View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6d7b329 - Browse repository at this point
Copy the full SHA 6d7b329View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c93c9b - Browse repository at this point
Copy the full SHA 1c93c9bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8bc0e77 - Browse repository at this point
Copy the full SHA 8bc0e77View commit details -
[Automated] Merged prep-release/1.6.0b5_5349512955 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for 5339882 - Browse repository at this point
Copy the full SHA 5339882View commit details
Commits on Jun 23, 2023
-
Improved Semantic expr specification handling (#7876)
* Update semantic model parsing test to check different measure expr types * Allow semantic model measure exprs to be defined with ints and bools in yaml Sometimes the expr for a measure can defined in yaml with a bool or an int. However, we were only allowing for strings. There was a work around for this, which was wrapping your bool or int in double quotes in the yaml, but this can be fairly annoying for the end user. * Changie doc for fixing measure expr yaml specification
Configuration menu - View commit details
-
Copy full SHA for 7934af2 - Browse repository at this point
Copy the full SHA 7934af2View commit details -
Improved Semantic Model Measure Percentile defaults (#7877)
* Update semantic model parsing test to check measure agg params * Make `use_discrete_percentile` and `use_approximate_percentile` non optional and default false This was a mistake in our implementation of the MeasureAggregationParams. We had defined them as optional and defaulting to `None`. However, as the protocol states, they cannot be `None`, they must be a boolean value. Thus now we now ensure them. * Add changie doc for measure percentile fixes
Configuration menu - View commit details
-
Copy full SHA for 779663b - Browse repository at this point
Copy the full SHA 779663bView commit details -
Configuration menu - View commit details
-
Copy full SHA for aecbb45 - Browse repository at this point
Copy the full SHA aecbb45View commit details -
Configuration menu - View commit details
-
Copy full SHA for b07ff7a - Browse repository at this point
Copy the full SHA b07ff7aView commit details -
[Automated] Merged prep-release/1.6.0b6_5360267609 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for 9836f7b - Browse repository at this point
Copy the full SHA 9836f7bView commit details
Commits on Jun 26, 2023
-
update mashumaro to 3.8.1 (#7951)
* Update mashumaro to 3.8 * Change to 3.8.1 * Changie
Configuration menu - View commit details
-
Copy full SHA for 9c97d30 - Browse repository at this point
Copy the full SHA 9c97d30View commit details -
Configuration menu - View commit details
-
Copy full SHA for f9d4e9e - Browse repository at this point
Copy the full SHA f9d4e9eView commit details -
Factor Out Repeated Logic in the PartialParsing Class (#7952)
* CT-2711: Add remove_tests() call to delete_schema_source() so that call sites are more uniform with other node deletion call sites. This will enable further code factorization. * CT-2711: Factor repeated code section (mostly) out of PartialParsing.handle_schema_file_changes() * CT-2711: Factor a repeated code section out of schedule_nodes_for_parsing()
Configuration menu - View commit details
-
Copy full SHA for b37e5b5 - Browse repository at this point
Copy the full SHA b37e5b5View commit details
Commits on Jun 27, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6a1e3a6 - Browse repository at this point
Copy the full SHA 6a1e3a6View commit details -
Configuration menu - View commit details
-
Copy full SHA for a84fa50 - Browse repository at this point
Copy the full SHA a84fa50View commit details -
Configuration menu - View commit details
-
Copy full SHA for fcd30b1 - Browse repository at this point
Copy the full SHA fcd30b1View commit details -
Add Partial Parsing Support for Semantic Models (#7964)
* CT-2711: Add partial parsing support for semantic models * CT-2711: Fix typo identified in code review
Configuration menu - View commit details
-
Copy full SHA for 7156cc5 - Browse repository at this point
Copy the full SHA 7156cc5View commit details
Commits on Jun 28, 2023
-
Add merge incremental strategy for postgres (#6951)
* Add merge incremental strategy * Expect merge to be a valid strategy for Postgres --------- Co-authored-by: Anders Swanson <anders.swanson@dbtlabs.com> Co-authored-by: Doug Beatty <doug.beatty@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 2ce0c5c - Browse repository at this point
Copy the full SHA 2ce0c5cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 036b95e - Browse repository at this point
Copy the full SHA 036b95eView commit details -
Add thread_id context var (#7942)
* Add thread_id context var * Changie * Fix context test * Update .changes/unreleased/Features-20230623-173357.yaml Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com> * Fix tests --------- Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for b3ac41f - Browse repository at this point
Copy the full SHA b3ac41fView commit details -
Add invocation command flag (#7939)
* Add invocation command flag * Add changie entry * Update .changes/unreleased/Features-20230623-111254.yaml
Configuration menu - View commit details
-
Copy full SHA for 22145e7 - Browse repository at this point
Copy the full SHA 22145e7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7a6beda - Browse repository at this point
Copy the full SHA 7a6bedaView commit details -
Configuration menu - View commit details
-
Copy full SHA for e01d4c0 - Browse repository at this point
Copy the full SHA e01d4c0View commit details -
Configuration menu - View commit details
-
Copy full SHA for cb754fd - Browse repository at this point
Copy the full SHA cb754fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0f52505 - Browse repository at this point
Copy the full SHA 0f52505View commit details -
[Automated] Merged prep-release/1.6.0b7_5402737814 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for d4e620e - Browse repository at this point
Copy the full SHA d4e620eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 05b0820 - Browse repository at this point
Copy the full SHA 05b0820View commit details -
Use events.contextvar because of multiprocessing unable to pickle Con…
…textVar (#7949) * Add task contextvars to events/contextvars.py * Use events.contextvars instead of task.contextvars * Changie
Configuration menu - View commit details
-
Copy full SHA for 2e7c968 - Browse repository at this point
Copy the full SHA 2e7c968View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1af94de - Browse repository at this point
Copy the full SHA 1af94deView commit details
Commits on Jun 29, 2023
-
Co-authored-by: Matthew McKnight <matthew.mcknight@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 5c7aa7f - Browse repository at this point
Copy the full SHA 5c7aa7fView commit details -
CT-2707: Populate metric input measures (#7984)
* Fix tests fixtures which were using measures for metric numerator/denominators In our previous upgrade to DSI dev7, numerators and denominators for metrics switched from being `MetricInputMeasure`s to `MetricInput`s. I.e. metric numerators and denominators should references other metrics, not semantic model measures. However, at that time, we weren't actually doing anything with numerators and denominators in core, so no issue got raised. The changes we are about to make though are going to surface these issues.. * Add tests for ensuring a metric's `input_measures` gets properly populated * Begin populating `metric.type_params.input_measures` This isn't my favorite bit of code. Mostly because there are checks for existence which really should be handled before this point, however a good point for that to happen doesn't exist currently. For instance, in an ideal world by the time we get to `_process_metric_node`, if a metric is of type `RATIO` and the nominator and denominator should be guaranteed. * Update test checking that disabled metrics aren't added to the manifest metrics We updated from the metric `number_of_people` to `average_tenure_minus_people` for this test because disabling `number_of_people` raised other exceptions at parse time due to a metric referencing a disabled metric. The metric `average_tenure_minus_people` is a leaf metric, and so for this test, it is a better candidate. * Update `test_disabled_metric_ref_model` to have more disabled metrics There are metrics which depend on the metric `number_of_people`. If `number_of_people` is disabled without the metrics that depend on it being disabled, then a different (expected) exception would be raised than the one this test is testing for. Thus we've disabled those downstream metrics. * Add test which checks that metrics depending on disabled metrics raise an exception * Add changie doc for populating metric input measures
Configuration menu - View commit details
-
Copy full SHA for 9c6fbff - Browse repository at this point
Copy the full SHA 9c6fbffView commit details -
* UnifiedToUTC * Check proximity of dbt_valid_to and deleted time * update the message to print if the assertion fails * add CHANGELOG entries * test only if naive * Added comments about naive and aware * Generalize comparison of datetimes that are "close enough" --------- Co-authored-by: Doug Beatty <doug.beatty@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for b8bc264 - Browse repository at this point
Copy the full SHA b8bc264View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c201e8 - Browse repository at this point
Copy the full SHA 8c201e8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d93780 - Browse repository at this point
Copy the full SHA 5d93780View commit details
Commits on Jun 30, 2023
-
[CT-2551] Make state selection MECE (#7773)
* ct-2551: adds old and unmodified state selection methods * ct-2551: update check_unmodified_content to simplify * add unit and integration tests for unmodified and old * add changelog entry * ct-2551: reformatting of contingent adapter assignment list
Configuration menu - View commit details
-
Copy full SHA for adcf8bc - Browse repository at this point
Copy the full SHA adcf8bcView commit details -
Added note before running integration tests (#7657)
Co-authored-by: Kshitij Aranke <kshitij.aranke@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for d7d6843 - Browse repository at this point
Copy the full SHA d7d6843View commit details -
Add time spine table configuration to semantic manifest (#7996)
* Bump dbt-semantic-interface to dev8 * Create time_spline_table_configuration in semantic manifest * Add metricflow_time_spin to semantic_models tests * Remove skip from test * Changie * Update exception message Co-authored-by: Quigley Malcolm <QMalcolm@users.noreply.github.com> --------- Co-authored-by: Quigley Malcolm <QMalcolm@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for fe463c7 - Browse repository at this point
Copy the full SHA fe463c7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7ea51df - Browse repository at this point
Copy the full SHA 7ea51dfView commit details -
Configuration menu - View commit details
-
Copy full SHA for ce07ce5 - Browse repository at this point
Copy the full SHA ce07ce5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 307a618 - Browse repository at this point
Copy the full SHA 307a618View commit details -
[Automated] Merged prep-release/1.6.0b8_5425945126 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for 8ee0fe0 - Browse repository at this point
Copy the full SHA 8ee0fe0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c44c29 - Browse repository at this point
Copy the full SHA 4c44c29View commit details
Commits on Jul 1, 2023
-
CT-2752: Extract methods to new SemanticManifest class for better enc…
…apsulation of details. (#8012)
Configuration menu - View commit details
-
Copy full SHA for 7fbfd53 - Browse repository at this point
Copy the full SHA 7fbfd53View commit details
Commits on Jul 5, 2023
-
CT-2780 [Docs] Fix-toc-links-in-contributing-md (#8017)
* docs(contributing): fix-toc-link-in-contributing-md * docs(contributing-md): fix-link2 * Fix-typo * Remove backtick from href * changie new * Cough commit / trigger CI
Configuration menu - View commit details
-
Copy full SHA for a58b5ee - Browse repository at this point
Copy the full SHA a58b5eeView commit details
Commits on Jul 6, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 746ca7d - Browse repository at this point
Copy the full SHA 746ca7dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d28e47 - Browse repository at this point
Copy the full SHA 5d28e47View commit details
Commits on Jul 7, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7c56d72 - Browse repository at this point
Copy the full SHA 7c56d72View commit details -
add workflow for flaky test testing (#8044)
* add workflow for flaky test testing * improve docs * rename workflow * update default input * add min passing tests
Configuration menu - View commit details
-
Copy full SHA for 15ef88d - Browse repository at this point
Copy the full SHA 15ef88dView commit details
Commits on Jul 10, 2023
-
Configuration menu - View commit details
-
Copy full SHA for ee7bc24 - Browse repository at this point
Copy the full SHA ee7bc24View commit details -
Update the PR template (#7892)
* add interface changes section to the PR template * update entire template * split up choices for tests and interfaces * minor formatting change * add line breaks * actually put in line breaks * revert split choices in checklist * add line breaks to top * move docs link * typo
Nathaniel May authoredJul 10, 2023 Configuration menu - View commit details
-
Copy full SHA for 54b1e56 - Browse repository at this point
Copy the full SHA 54b1e56View commit details -
Semantic Model Validation (#8049)
* Use dbt-semantic-interface validations on semantic models and metrics defined in Core. * Remove empty test, since semantic models don't generate any validation warnings. * Add changelog entry. * Temporarily remove requirement that there must be semantic models definied in order to define metrics
Configuration menu - View commit details
-
Copy full SHA for 44572e7 - Browse repository at this point
Copy the full SHA 44572e7View commit details
Commits on Jul 11, 2023
-
Fix accidental propagation of log messages to root logger (#7882)
* Fix accidental propagation of log messages to root logger. * Add changelog entry * Fixed an issue which blocked debug logging to stdout with --log-level debug, unless --debug was also used.
Configuration menu - View commit details
-
Copy full SHA for a8e3afe - Browse repository at this point
Copy the full SHA a8e3afeView commit details -
add negative part number test case for split part cross db util (#7200)
* add negative test case * changie * missed a comma * Update changelog entry * Add a negative number (rather than subtract a positive number) --------- Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com> Co-authored-by: Doug Beatty <doug.beatty@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for a57fdf0 - Browse repository at this point
Copy the full SHA a57fdf0View commit details -
Remove
create_metric
as a public facingSemanticModel.Measure
pro……perty (#8068) * Remove `create_metric` as a public facing `SemanticModel.Measure` property We want to add `create_metric`. The `create_metric` property will be incredibly useful. However, at this time it is not hooked up, and we don't have time to hook it up before the code freeze for 1.6.0rc of core. As it doesn't do anything, we shouldn't allow people to specify it, because it won't do what one would expect. We plan on making the implementation of `create_metric` a priority for 1.7 of core * Changie doc for the removal of create_metric property
Configuration menu - View commit details
-
Copy full SHA for 7740bd6 - Browse repository at this point
Copy the full SHA 7740bd6View commit details -
* add permissions * replace db setup * try with bash instead of just pytest flags * fix test command * remove spaces * remove force-flaky flag * add starting vlaues * add mac and windows postgres isntall * define use bash * fix typo * update output report * tweak last if condition * clarify failures/successful runs * print running success and failure tally * just output pytest instead of capturing it * set shell to not exit immediately on exit code * add formatting around results for easier scanning * more output formatting * add matrix to unlock parallel runners * increase to ten batches * update debug * add comment * clean up comments
Configuration menu - View commit details
-
Copy full SHA for d8f38ca - Browse repository at this point
Copy the full SHA d8f38caView commit details -
Use Ubuntu 22.04.2 LTS (Jammy Jellyfish) since it is a long-term supp…
…orted release (#8071) * Use Ubuntu 22.04.2 LTS (Jammy Jellyfish) since it is a long-term supported release * Changelog entry
Configuration menu - View commit details
-
Copy full SHA for fd233ea - Browse repository at this point
Copy the full SHA fd233eaView commit details -
Configuration menu - View commit details
-
Copy full SHA for 07c3dcd - Browse repository at this point
Copy the full SHA 07c3dcdView commit details -
Add validate_sql method to base adapter with implementation for SQLAd…
…apters (#8001) * Add dry_run method to base adapter with implementation for SQLAdapters resolves #7839 In the CLI integration, MetricFlow will issue dry run queries as part of its warehouse-level validation of the semantic manifest, including all semantic model and metric definitions. In most cases, issuing an `explain` query is adequate, however, BigQuery does not support the `explain` keyword and so we cannot simply pre-pend `explain` to our input queries and expect the correct behavior across all contexts. This commit adds a dry_run() method to the BaseAdapter which mirrors the execute() method in that it simply delegates to the ConnectionManager. It also adds a working implementation to the SQLConnectionManager and includes a few test cases for adapter maintainers to try out on their own. The current implementation should work out of the box with most of our adapters. BigQuery will require us to implement the dry_run method on the BigQueryConnectionManager, and community-maintained adapters can opt in by enabling the test and ensuring their own implementations work as expected. Note - we decided to make these concrete methods that throw runtime exceptions for direct descendants of BaseAdapter in order to avoid forcing community adapter maintainers to implement a method that does not currently have any use cases in dbt proper. * Switch dry_run implementation to be macro-based The common pattern for engine-specific SQL statement construction in dbt is to provide a default macro which can then be overridden on a per-adapter basis by either adapter maintainers or end users. The advantage of this is users can take advantage of alternative SQL syntax for performance or other reasons, or even to enable local usage if an engine relies on a non-standard expression and the adapter maintainer has not updated the package. Although there are some risks here they are minimal, and the benefit of added expressiveness and consistency with other similar constructs is clear, so we adopt this approach here. * Improve error message for InvalidConnectionError in test_invalid_dry_run. * Rename dry_run to validate_sql The validate_sql name has less chance of colliding with dbt's command nomenclature, both now and in some future where we have dry-run operations. * Rename macro and test files to validate_sql * Fix changelog entry
Configuration menu - View commit details
-
Copy full SHA for 4ffd633 - Browse repository at this point
Copy the full SHA 4ffd633View commit details
Commits on Jul 12, 2023
-
Update validate sql test classes to new nomenclature (#8076)
The original implementation of validate_sql was called dry_run, but in the rename the test classes and much of their associated documentation still retained the old naming. This is mainly cosmetic, but since these test classes will be imported into adapter repositories we should fix this now before the wrong name proliferates.
Configuration menu - View commit details
-
Copy full SHA for b78d23f - Browse repository at this point
Copy the full SHA b78d23fView commit details -
Remove volume declaration (#8069)
* Remove volume declaration * Changelog entry --------- Co-authored-by: Doug Beatty <doug.beatty@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 30def98 - Browse repository at this point
Copy the full SHA 30def98View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2d686b7 - Browse repository at this point
Copy the full SHA 2d686b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 305241f - Browse repository at this point
Copy the full SHA 305241fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6604b9c - Browse repository at this point
Copy the full SHA 6604b9cView commit details -
Add semantic_models to tracked resource counts (#8078)
* Add semantic_models to tracked resource counts * Add changelog entry * Simplify node statistic tabulation. * Remove review comment. Replace with explanation. --------- Co-authored-by: Peter Allen Webb <peter.webb@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 6bdf983 - Browse repository at this point
Copy the full SHA 6bdf983View commit details -
CT-2691 Fix the populating of a
Metric
'sdepends_on
property (#8015)* Add metrics from metric type params to a metric's depends_on * Add Lookup utility for finding `SemanticModel`s by measure names * Add the `SemanticModel` of a `Metric`'s measure property to the `Metric`'s `depends_on` * Add `SemanticModelConfig` to `SemanticModel` Some tests were failing due to `Metric`'s referencing `SemanticModels`. Specifically there was a check to see if a referenced node was disabled, and because `SemanticModel`'s didn't have a `config` holding the `enabled` boolean attr, core would blow up. * Checkpoint on test fixing * Correct metricflow_time_spine_sql in test fixtures * Add check for `SemanticModel` nodes in `Linker.link_node` Now that `Metrics` depend on `SemanticModels` and `SemanticModels` have their own dependencies on `Models` they need to be checked for in the `Linker.link_node`. I forget the details but things blow up without it. Basically it adds the SemanticModels to the dependency graph. * Fix artifacts/test_previous_version_state.py tests * fix access/test_access.py tests * Fix function metric tests * Fix functional partial_parsing tests * Add time dimension to semantic model in exposures fixture * Bump DSI version to a minimum of 0.1.0dev10 DSI 0.1.0dev10 fixes an incoherence issue in DSI around `agg_time_dimension` setting. This incoherence was that `measure.agg_time_dimension` was being required, even though it was no longer supposed to be a required attribute (it's specificially typed as optional in the protocol). This was causing a handful of tests to fail because the `semantic_model.defaults.agg_time_dimension` value wasn't being respected. Pulling in the fix from DSI 0.1.0dev10 fixes the issue. Interestingly after bumping the DSI version, the integration tests were still failing. If I ran the tests individually they passed though. To get `make integration` to run properly I ended up having to clear my `.tox` cache, as it seems some outdated state was being persisted. * Add test specifically for checking the `depends_on` of `Metric` nodes * Re-enable test asserting calling metric nodes in models * Migrate `checked_agg_time_dimension` to `checked_agg_time_dimension_for_measure` DSI 0.1.0dev10 moved `checked_agg_time_dimension` from the `Measure` protocol to the `SemanticModel` protocol as `checked_agg_time_dimension_for_measure`. This finishes a change where for a given measure either the `Measure.agg_time_dimension` or the measure's parent `SemanticModel.defaults.agg_time_dimension` needs to be set, instead of always require the measure's `Measure.agg_time_dimension`. * Add changie doc for populating metric --------- Co-authored-by: Gerda Shank <gerda@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 5310d37 - Browse repository at this point
Copy the full SHA 5310d37View commit details
Commits on Jul 13, 2023
-
Configuration menu - View commit details
-
Copy full SHA for be4d0a5 - Browse repository at this point
Copy the full SHA be4d0a5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 961d69d - Browse repository at this point
Copy the full SHA 961d69dView commit details -
[CT-2821] Support
dbt-semantic-interfaces~=0.1.0rc1
(#8085)* Bump version support for `dbt-semantic-interfaces` to `~=0.1.0rc1` * Add tests for asserting WhereFilter satisfies protocol * Add `call_parameter_sets` to `WhereFilter` class to satisfy protocol * Changie doc for moving to DSI 0.1.0rc1 * [CT-2822] Fix `NonAdditiveDimension` Implementation (#8089) * Add test to ensure `NonAdditiveDimension` implementation satisfies protocol * Fix typo in `NonAdditiveDimension`: `window_grouples` -> `window_groupings` * Add changie doc for typo fix in NonAdditiveDimension
Configuration menu - View commit details
-
Copy full SHA for 95a9169 - Browse repository at this point
Copy the full SHA 95a9169View commit details -
Configuration menu - View commit details
-
Copy full SHA for 015c490 - Browse repository at this point
Copy the full SHA 015c490View commit details
Commits on Jul 17, 2023
-
add env vars for datadog ci visibility (#8097)
* add env vars for datadog ci visibility * modify pytest command for tracing * fix posargs * move env vars to job that needs them * add test repeater to DD * swap flags
Configuration menu - View commit details
-
Copy full SHA for 949680a - Browse repository at this point
Copy the full SHA 949680aView commit details -
Apply new integration tests to existing framework to identify support…
…ed features (#8099) * applied new integration tests to existing framework * applied new integration tests to existing framework * generalized tests for reusability in adapters; fixed drop index issue * generalized tests for reusability in adapters; fixed drop index issue * removed unnecessary overrides in tests * adjusted import to allow for usage in adapters * adjusted import to allow for usage in adapters * removed fixture artifact * generalized the materialized view fixture which will need to be specific to the adapter * unskipped tests in the test runner package * corrected test condition * corrected test condition * added missing initial build for the relation type swap tests
Configuration menu - View commit details
-
Copy full SHA for 203bd8d - Browse repository at this point
Copy the full SHA 203bd8dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6d8b645 - Browse repository at this point
Copy the full SHA 6d8b645View commit details -
Configuration menu - View commit details
-
Copy full SHA for 867534c - Browse repository at this point
Copy the full SHA 867534cView commit details
Commits on Jul 18, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 1b1a291 - Browse repository at this point
Copy the full SHA 1b1a291View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9765596 - Browse repository at this point
Copy the full SHA 9765596View commit details
Commits on Jul 19, 2023
-
Configuration menu - View commit details
-
Copy full SHA for cbfc6a8 - Browse repository at this point
Copy the full SHA cbfc6a8View commit details -
Configuration menu - View commit details
-
Copy full SHA for a1b067c - Browse repository at this point
Copy the full SHA a1b067cView commit details -
Configuration menu - View commit details
-
Copy full SHA for a327131 - Browse repository at this point
Copy the full SHA a327131View commit details -
Configuration menu - View commit details
-
Copy full SHA for 121371f - Browse repository at this point
Copy the full SHA 121371fView commit details -
Configuration menu - View commit details
-
Copy full SHA for eeb0570 - Browse repository at this point
Copy the full SHA eeb0570View commit details
Commits on Jul 20, 2023
-
Correcting spelling of partition (#8101)
* Correcting spelling of partition * Changie entry
Configuration menu - View commit details
-
Copy full SHA for fb6c349 - Browse repository at this point
Copy the full SHA fb6c349View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d645c2 - Browse repository at this point
Copy the full SHA 0d645c2View commit details
Commits on Jul 21, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8cab58d - Browse repository at this point
Copy the full SHA 8cab58dView commit details -
[CT-1849]
_connection_exception_retry
handlesEOFError
exceptions (……#8182) * Add test for checking that `_connection_exception_retry` handles `EOFError`s * Update `_connection_exception_retry` to handle `EOFError` exceptions * Add changie docs for `_connection_exception_retry` handling `EOFError` exceptions
Configuration menu - View commit details
-
Copy full SHA for 1e2b9ae - Browse repository at this point
Copy the full SHA 1e2b9aeView commit details -
Fixed double underline (#7944)
* Fixed double-underline * backward compatibility postgres_get_relations * Remove invalid comments * compatibility adapter and get_relation * fix generic for call * fix adapter dispatch grammar issue
Configuration menu - View commit details
-
Copy full SHA for ff5cb7b - Browse repository at this point
Copy the full SHA ff5cb7bView commit details
Commits on Jul 24, 2023
-
[CT-1483] Let macro names include word materialization (#8181)
* Add test asserting that a macro with the work materializtion doesn't cause issues * Let macro names include the word `materialization` Previously we were checking if a macro included a materialization based on if the macro name included the word `materialization`. However, a macro name included the word `materialization` isn't guarnteed to actually have a materialization, and a macro that doesn't have `materialization` in the name isn't guaranteed to not have a materialization. This change is to detect macros with materializations based on the detected block type of the macro. * Add changie doc materialization in macro detection
Configuration menu - View commit details
-
Copy full SHA for 6235145 - Browse repository at this point
Copy the full SHA 6235145View commit details -
[CT-2594] Fix serialization of
warn_error_options
on Contexts (#8180)* Add test ensuring `warn_error_options` is dictified in `invocation_args_dict` of contexts * Add dictification specific to `warn_error_options` in `args_to_dict` * Changie doc for serialization changes of warn_error_options
Configuration menu - View commit details
-
Copy full SHA for 44b3ed5 - Browse repository at this point
Copy the full SHA 44b3ed5View commit details
Commits on Jul 25, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 49560bf - Browse repository at this point
Copy the full SHA 49560bfView commit details -
add param to control maxBytes for single dbt.log file (#8200)
* add param to control maxBytes for single dbt.log file * nits * nits * Update core/dbt/cli/params.py Co-authored-by: Peter Webb <peter.webb@dbtlabs.com> --------- Co-authored-by: Peter Webb <peter.webb@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for f392add - Browse repository at this point
Copy the full SHA f392addView commit details -
Update Core for Latest dbt-extractor with Version Parsing (#8206)
* Update dbt-extractor requirement, and adjust ref handling accordingly * Add changelog entry.
Configuration menu - View commit details
-
Copy full SHA for 799588c - Browse repository at this point
Copy the full SHA 799588cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3954233 - Browse repository at this point
Copy the full SHA 3954233View commit details
Commits on Jul 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for b1d9313 - Browse repository at this point
Copy the full SHA b1d9313View commit details -
Bump mypy from 1.3.0 to 1.4.0 (#7912)
* Bump mypy from 1.3.0 to 1.4.0 Bumps [mypy](https://github.com/python/mypy) from 1.3.0 to 1.4.0. - [Commits](python/mypy@v1.3.0...v1.4.0) --- updated-dependencies: - dependency-name: mypy dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Add automated changelog yaml from template for bot PR * add to pre-commit config --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for fecde23 - Browse repository at this point
Copy the full SHA fecde23View commit details -
Configuration menu - View commit details
-
Copy full SHA for fdeccfa - Browse repository at this point
Copy the full SHA fdeccfaView commit details
Commits on Jul 27, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 23b16ad - Browse repository at this point
Copy the full SHA 23b16adView commit details -
Configuration menu - View commit details
-
Copy full SHA for fe9c875 - Browse repository at this point
Copy the full SHA fe9c875View commit details -
pin upper bound for sqlparse (#8236)
* pin upper bound for sqlparse * changelog
Configuration menu - View commit details
-
Copy full SHA for 3f5617b - Browse repository at this point
Copy the full SHA 3f5617bView commit details -
[CT-2879] Fix unbound variable error in `checked_agg_time_dimension_f…
…or_measure` (#8235) * Fix unbound variable error in `checked_agg_time_dimension_for_measure` * Improve assertion error message in `checked_agg_time_dimension_for_measure` * Add changie doc for checked_agg_time_dimension_for_measure unbound variable fix * Add unit tests for checking functionality of `checked_agg_time_dimension_for_measure`
Configuration menu - View commit details
-
Copy full SHA for f977ed7 - Browse repository at this point
Copy the full SHA f977ed7View commit details
Commits on Jul 28, 2023
-
Bump mypy from 1.4.0 to 1.4.1 (#8219)
* Bump mypy from 1.4.0 to 1.4.1 Bumps [mypy](https://github.com/python/mypy) from 1.4.0 to 1.4.1. - [Commits](python/mypy@v1.4.0...v1.4.1) --- updated-dependencies: - dependency-name: mypy dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Add automated changelog yaml from template for bot PR * update pre-commit --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 3cb44d3 - Browse repository at this point
Copy the full SHA 3cb44d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 410506f - Browse repository at this point
Copy the full SHA 410506fView commit details -
* loosen the click pin * changelog * separate out sqlparse pin * remove changelog * add ignores
Configuration menu - View commit details
-
Copy full SHA for 5b6d21d - Browse repository at this point
Copy the full SHA 5b6d21dView commit details -
[CT-2888] Support dbt-semantic-interfaces 0.2.0 (#8250)
* Upgrade DSI dependency to ~=0.2.0 * Allow users to specify `primary_entity` on semantic models * Add `primary_entity` and `primary_entity_reference` to SemanticModel node * Plumb primary_entity from unparsed to parsed semantic nodes * Fix metric filter specifications in existing tests * Add changie doc about supporting DSI 0.2.0
Configuration menu - View commit details
-
Copy full SHA for 518eb73 - Browse repository at this point
Copy the full SHA 518eb73View commit details
Commits on Jul 31, 2023
-
* change trigger * add logic for different targets * fix comment * hard code test splits
Configuration menu - View commit details
-
Copy full SHA for f230e41 - Browse repository at this point
Copy the full SHA f230e41View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7872f6a - Browse repository at this point
Copy the full SHA 7872f6aView commit details
Commits on Aug 1, 2023
-
Support configurable delimiter for seed files, default to comma (#3990)…
… (#7186) * Support configurable delimiter for seed files, default to comma (#3990) * Update Features-20230317-144957.yaml * Moved "delimiter" to seed config instead of node config * Update core/dbt/clients/agate_helper.py Co-authored-by: Cor <jczuurmond@protonmail.com> * Update test_contracts_graph_parsed.py * fixed integration tests * Added functional tests for seed files with a unique delimiter * Added docstrings * Added a test for an empty string configured delimiter value * whitespace * ran black * updated changie entry * Update Features-20230317-144957.yaml --------- Co-authored-by: Cor <jczuurmond@protonmail.com>
Configuration menu - View commit details
-
Copy full SHA for 6130a6e - Browse repository at this point
Copy the full SHA 6130a6eView commit details
Commits on Aug 2, 2023
-
Issue One Event Per Node Failure (#8210)
* Replaced the FirstRunResultError and AfterFirstRunResultError events with RunResultError. * Attempts at reasonable unit tests. * Restore event manager after unit test.
Configuration menu - View commit details
-
Copy full SHA for 5814928 - Browse repository at this point
Copy the full SHA 5814928View commit details -
Configuration menu - View commit details
-
Copy full SHA for a433c31 - Browse repository at this point
Copy the full SHA a433c31View commit details -
fix constructing param with 0 value (#8298)
* fix constructing param with 0 value * Update core/dbt/cli/flags.py Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com> --------- Co-authored-by: Doug Beatty <44704949+dbeatty10@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 1af489b - Browse repository at this point
Copy the full SHA 1af489bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 991618d - Browse repository at this point
Copy the full SHA 991618dView commit details
Commits on Aug 3, 2023
-
add formatting events into json logs (#8308)
* add formatting events into json logs * changelog * Delete Under the Hood-20230803-100811.yaml
Configuration menu - View commit details
-
Copy full SHA for f637092 - Browse repository at this point
Copy the full SHA f637092View commit details
Commits on Aug 4, 2023
-
[CT-2776] [Feature] Enable-post-parse-population-of-dbt-custom-env (#…
…7998) * patch(events/functions): enable-repopulation-of-metadata-vars * changie new
Configuration menu - View commit details
-
Copy full SHA for 424c636 - Browse repository at this point
Copy the full SHA 424c636View commit details
Commits on Aug 7, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 556b404 - Browse repository at this point
Copy the full SHA 556b404View commit details -
Configuration menu - View commit details
-
Copy full SHA for 53794fb - Browse repository at this point
Copy the full SHA 53794fbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 44d1e73 - Browse repository at this point
Copy the full SHA 44d1e73View commit details
Commits on Aug 9, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8c98ef3 - Browse repository at this point
Copy the full SHA 8c98ef3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 41bb527 - Browse repository at this point
Copy the full SHA 41bb527View commit details -
* fixed comments util.py * add CHANGELOG entries
Configuration menu - View commit details
-
Copy full SHA for 506f65e - Browse repository at this point
Copy the full SHA 506f65eView commit details -
Configuration menu - View commit details
-
Copy full SHA for e69d4e7 - Browse repository at this point
Copy the full SHA e69d4e7View commit details
Commits on Aug 10, 2023
-
Detect changes to model access, deprecation_date, and latest_version …
…in state:modified (#8264)
Configuration menu - View commit details
-
Copy full SHA for 6603a44 - Browse repository at this point
Copy the full SHA 6603a44View commit details -
Configuration menu - View commit details
-
Copy full SHA for 83ff38a - Browse repository at this point
Copy the full SHA 83ff38aView commit details
Commits on Aug 11, 2023
-
add env vars to tox.ini (#8365)
* add env vars to tox.ini * revert test
Configuration menu - View commit details
-
Copy full SHA for b7aee3f - Browse repository at this point
Copy the full SHA b7aee3fView commit details
Commits on Aug 12, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 9388030 - Browse repository at this point
Copy the full SHA 9388030View commit details
Commits on Aug 14, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 27be929 - Browse repository at this point
Copy the full SHA 27be929View commit details -
Configuration menu - View commit details
-
Copy full SHA for 34e6edb - Browse repository at this point
Copy the full SHA 34e6edbView commit details -
add --no-partial-parse-file-diff flag (#8361)
* add --no-partial-parse-file-diff flag * changelog entry
Configuration menu - View commit details
-
Copy full SHA for 8350dfe - Browse repository at this point
Copy the full SHA 8350dfeView commit details -
Configuration menu - View commit details
-
Copy full SHA for b514e4c - Browse repository at this point
Copy the full SHA b514e4cView commit details -
[CT-2526] Add ability to automatically create metrics from semantic m…
…odel measures (#8310) * Update semantic model parsing test to check `create_metric = true` functionality * Add `create_metric` boolean property to unparsed measure objects * Begin creating metrics from measures with `create_metric = True` * Add test ensuring partial parsing handles metrics generated from measures * Ensure partial parsing appropriately deletes metrics generated from semantic models * Add changie doc for addition * Separate generated metrics from parsed metrics for partial parsing I was doing a demo earlier today of this branch (minus this commit) and noticed something odd. When I changes a semantic model, metrics that should have been technically uneffected would get dropped. Basically if I made a change to a semantic model which had metrics in the same file, and then ran parse, those metrics defined in the same file would get dropped. Then with no other changes, if I ran parse again they would come back. What was happening was that parsed metrics and generated metrics were getting tracked the same way on the file objects for partial parsing. In 0787a7c we began dropping all metrics tracked in a file objects when changes to semantic models were detected. Since parsed metrics and generated metrics were being tracked together on the file object, the parsed metrics were getting dropped as well. In this commit we begin separating out the tracking of generated metrics and parsed metrics on the file object, and now only drop the generated metrics when semantic models have a detected change. * Assert in test that semantic model partial parsing doesn't clobber regular metrics
Configuration menu - View commit details
-
Copy full SHA for b045180 - Browse repository at this point
Copy the full SHA b045180View commit details
Commits on Aug 15, 2023
-
Automate opening docs issues (#8373)
* first pass * WIP * update issue body * fix triggering label * fix docs * add better run name * reduce complexity * update description * fix PR title * point at workflow on main * fix wording * add label
Configuration menu - View commit details
-
Copy full SHA for cb4bc2d - Browse repository at this point
Copy the full SHA cb4bc2dView commit details -
Fix run_results.json Performance Regression (#8413)
* Remedy performance regression by only writing run_results.json once. * Write results before cleaning up connections.
Configuration menu - View commit details
-
Copy full SHA for 18ee93c - Browse repository at this point
Copy the full SHA 18ee93cView commit details
Commits on Aug 16, 2023
-
Configuration menu - View commit details
-
Copy full SHA for dfe6b71 - Browse repository at this point
Copy the full SHA dfe6b71View commit details -
Configuration menu - View commit details
-
Copy full SHA for 048553d - Browse repository at this point
Copy the full SHA 048553dView commit details -
Ignore
.github
and.changes
directories for code coverage (#8424)Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for ac539fd - Browse repository at this point
Copy the full SHA ac539fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 17cd145 - Browse repository at this point
Copy the full SHA 17cd145View commit details
Commits on Aug 17, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 37a2907 - Browse repository at this point
Copy the full SHA 37a2907View commit details -
* fail job when anything fails in previous matrix * tweak wording * PR feedback
Configuration menu - View commit details
-
Copy full SHA for 770f804 - Browse repository at this point
Copy the full SHA 770f804View commit details -
Configuration menu - View commit details
-
Copy full SHA for d088d44 - Browse repository at this point
Copy the full SHA d088d44View commit details -
Configuration menu - View commit details
-
Copy full SHA for c30b691 - Browse repository at this point
Copy the full SHA c30b691View commit details -
revert python version for docker images (#8445)
* revert python version for docker images * add comment to not update python version, update changelog
Configuration menu - View commit details
-
Copy full SHA for f485c13 - Browse repository at this point
Copy the full SHA f485c13View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7ad971f - Browse repository at this point
Copy the full SHA 7ad971fView commit details -
[Automated] Merged prep-release/1.7.0b1_5895067219 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for 0553fd8 - Browse repository at this point
Copy the full SHA 0553fd8View commit details
Commits on Aug 18, 2023
-
[CT-3013] Fix parsing of
window_groupings
(#8454)* Update semantic model parsing tests to check measure non_additive_dimension spec * Make `window_groupings` default to empty list if not specified on `non_additive_dimension` * Add changie doc for `window_groupings` parsing fix
Configuration menu - View commit details
-
Copy full SHA for 49397b4 - Browse repository at this point
Copy the full SHA 49397b4View commit details -
update
Number
class to handle integer values (#8306)* add show test for json data * oh changie my changie * revert unecessary cahnge to fixture * keep decimal class for precision methods, but return __int__ value * jerco updates * update integer type * update other tests * Update .changes/unreleased/Fixes-20230803-093502.yaml --------- Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com>
Configuration menu - View commit details
-
Copy full SHA for 661623f - Browse repository at this point
Copy the full SHA 661623fView commit details -
Improve docker image README (#8212)
* Improve docker image README - Fix unnecessary/missing newline escapes - Remove double whitespace between parameters - 2-space indent for extra lines in image build commands * Add changelog entry for #8212
Configuration menu - View commit details
-
Copy full SHA for 424f3d2 - Browse repository at this point
Copy the full SHA 424f3d2View commit details
Commits on Aug 21, 2023
-
ADAP-814: Refactor prep for MV updates (#8459)
* apply reformatting changes only for #8449 * add logging back to get_create_materialized_view_as_sql * changie
Configuration menu - View commit details
-
Copy full SHA for ff98685 - Browse repository at this point
Copy the full SHA ff98685View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ec87a0 - Browse repository at this point
Copy the full SHA 4ec87a0View commit details
Commits on Aug 22, 2023
-
update the implementation template (#8466)
* update the implementation template * add colon
Configuration menu - View commit details
-
Copy full SHA for 582faa1 - Browse repository at this point
Copy the full SHA 582faa1View commit details
Commits on Aug 23, 2023
-
Split tests into classes (#8474)
* add flaky decorator * split up tests into classes
Configuration menu - View commit details
-
Copy full SHA for 10f9724 - Browse repository at this point
Copy the full SHA 10f9724View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4d3c6d9 - Browse repository at this point
Copy the full SHA 4d3c6d9View commit details
Commits on Aug 24, 2023
-
Configuration menu - View commit details
-
Copy full SHA for d18a74d - Browse repository at this point
Copy the full SHA d18a74dView commit details
Commits on Aug 25, 2023
-
Convert error to conditional warning for unversioned contracted model…
…, fix msg format (#8451) * first pass, tests need updates * update proto defn * fixing tests * more test fixes * finish fixing test file * reformat the message * formatting messages * changelog * add event to unit test * feedback on message structure * WIP * fix up event to take in all fields * fix test
Configuration menu - View commit details
-
Copy full SHA for 1afbb87 - Browse repository at this point
Copy the full SHA 1afbb87View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6234267 - Browse repository at this point
Copy the full SHA 6234267View commit details
Commits on Aug 28, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 48d04e8 - Browse repository at this point
Copy the full SHA 48d04e8View commit details
Commits on Aug 29, 2023
-
[CT-2840] Improved semantic layer protocol satisfaction tests (#8456)
* Test `SemanticModel` satisfies protocol when none of it's `Optionals` are specified * Add tests ensuring SourceFileMetadata and FileSlice satisfiy DSI protocols * Add test asserting Defaults obj satisfies protocol * Add test asserting SemanticModel with optionals specified satisfies protocol * Split dimension protocol satisfaction tests into with and without optionals * Simplify DSI Protocol import strategy in protocol satisfaction tests * Add test asserting DimensionValidtyParams satisfies protocol * Add test asserting DimensionTypeParams satisfies protocol * Split entity protocol satisfaction tests into with and without optionals * Split measure protocol satisfication tests and add measure aggregation params satisficaition test * Split metric protocol satisfaction test into optional specified an unspecified Additionally, create where_filter pytest fixture * Improve protocol satisfaction tests for MetricTypeParams and sub protocols Specifically we added/improved protocol satisfaction tests for - MetricTypeParams - MetricInput - MetricInputMeasure - MetricTimeWindow
Configuration menu - View commit details
-
Copy full SHA for 07372db - Browse repository at this point
Copy the full SHA 07372dbView commit details
Commits on Aug 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for f063e4e - Browse repository at this point
Copy the full SHA f063e4eView commit details -
Include Compiled Node Attributes in run_results.json (#8492)
* Add compiled node properties to run_results.json * Include compiled-node attributes in run_results.json * Fix typo * Bump schema version of run_results * Fix test assertions * Update expected run_results to reflect new attributes * Code review changes * Fix mypy warnings for ManifestLoader.load() (#8443) * revert python version for docker images (#8445) * revert python version for docker images * add comment to not update python version, update changelog * Bumping version to 1.7.0b1 and generate changelog * [CT-3013] Fix parsing of `window_groupings` (#8454) * Update semantic model parsing tests to check measure non_additive_dimension spec * Make `window_groupings` default to empty list if not specified on `non_additive_dimension` * Add changie doc for `window_groupings` parsing fix * update `Number` class to handle integer values (#8306) * add show test for json data * oh changie my changie * revert unecessary cahnge to fixture * keep decimal class for precision methods, but return __int__ value * jerco updates * update integer type * update other tests * Update .changes/unreleased/Fixes-20230803-093502.yaml --------- Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com> * Improve docker image README (#8212) * Improve docker image README - Fix unnecessary/missing newline escapes - Remove double whitespace between parameters - 2-space indent for extra lines in image build commands * Add changelog entry for #8212 * ADAP-814: Refactor prep for MV updates (#8459) * apply reformatting changes only for #8449 * add logging back to get_create_materialized_view_as_sql * changie * swap trigger (#8463) * update the implementation template (#8466) * update the implementation template * add colon * Split tests into classes (#8474) * add flaky decorator * split up tests into classes * revert update agate for int (#8478) * updated typing and methods to meet mypy standards (#8485) * Convert error to conditional warning for unversioned contracted model, fix msg format (#8451) * first pass, tests need updates * update proto defn * fixing tests * more test fixes * finish fixing test file * reformat the message * formatting messages * changelog * add event to unit test * feedback on message structure * WIP * fix up event to take in all fields * fix test * Fix ambiguous reference error for duplicate model names across packages with tests (#8488) * Safely remove external nodes from manifest (#8495) * [CT-2840] Improved semantic layer protocol satisfaction tests (#8456) * Test `SemanticModel` satisfies protocol when none of it's `Optionals` are specified * Add tests ensuring SourceFileMetadata and FileSlice satisfiy DSI protocols * Add test asserting Defaults obj satisfies protocol * Add test asserting SemanticModel with optionals specified satisfies protocol * Split dimension protocol satisfaction tests into with and without optionals * Simplify DSI Protocol import strategy in protocol satisfaction tests * Add test asserting DimensionValidtyParams satisfies protocol * Add test asserting DimensionTypeParams satisfies protocol * Split entity protocol satisfaction tests into with and without optionals * Split measure protocol satisfication tests and add measure aggregation params satisficaition test * Split metric protocol satisfaction test into optional specified an unspecified Additionally, create where_filter pytest fixture * Improve protocol satisfaction tests for MetricTypeParams and sub protocols Specifically we added/improved protocol satisfaction tests for - MetricTypeParams - MetricInput - MetricInputMeasure - MetricTimeWindow * Convert to using mashumaro jsonschema with acceptable performance (#8437) * Regenerate run_results schema after merging in changes from main. --------- Co-authored-by: Gerda Shank <gerda@dbtlabs.com> Co-authored-by: Matthew McKnight <91097623+McKnight-42@users.noreply.github.com> Co-authored-by: Github Build Bot <buildbot@fishtownanalytics.com> Co-authored-by: Quigley Malcolm <QMalcolm@users.noreply.github.com> Co-authored-by: dave-connors-3 <73915542+dave-connors-3@users.noreply.github.com> Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com> Co-authored-by: Jaime Martínez Rincón <jaime@jamezrin.name> Co-authored-by: Mike Alfare <13974384+mikealfare@users.noreply.github.com> Co-authored-by: Michelle Ark <MichelleArk@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for fc1a14a - Browse repository at this point
Copy the full SHA fc1a14aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 72898c7 - Browse repository at this point
Copy the full SHA 72898c7View commit details
Commits on Aug 31, 2023
-
Semantic model configs - enable/disable + groups (#8502)
* WIP * WIP * get group and enabled added * changelog * cleanup * getting measure lookup working * missed file * get project level working * fix last test * add groups to config tests * more group tests * fix path * clean up manifest.py * update error message * fix test assert * remove extra check * resolve conflicts in manaifest * update manifest * resolve conflict * add alias
Configuration menu - View commit details
-
Copy full SHA for 7ae3de1 - Browse repository at this point
Copy the full SHA 7ae3de1View commit details -
Fix snapshot success message to display "INSERT 0 1" (for example) in…
…stead of success (#8524)
Configuration menu - View commit details
-
Copy full SHA for d8e8a78 - Browse repository at this point
Copy the full SHA d8e8a78View commit details -
Fix untyped functions in
core/dbt/context/base.py
(#8525)* Improve typing of `ContextMember` functions * Improve typing of `Var` functions * Improve typing of `ContextMeta.__new__` * Improve typing `BaseContext` and functions In addition to just adding parameter typing and return typing to `BaseContext` functions. We also declared `_context_members_` and `_context_attrs_` as properites of `BaseContext` this was necessary because they're being accessed in the classes functions. However, because they were being indirectly instantiated by the metaclass `ContextMeta`, the properties weren't actually known to exist. By adding declaring the properties on the `BaseContext`, we let mypy know they exist. * Remove bare `invocations` of `@contextmember` and `@contextproperty`, and add typing to them Previously `contextmember` and `contextproperty` were 2-in-1 decorators. This meant they could be invoked either as `@contextmember` or `@contextmember('some_string')`. This was fine until we wanted to return typing to the functions. In the instance where the bare decorator was used (i.e. no `(...)` were present) an object was expected to be returned. However in the instance where parameters were passed on the invocation, a callable was expected to be returned. Putting a union of both in the return type made the invocations complain about each others' return type. To get around this we've dropped the bare invocation as acceptable. The parenthesis are now always required, but passing a string in them is optional.
Configuration menu - View commit details
-
Copy full SHA for e5e1a27 - Browse repository at this point
Copy the full SHA e5e1a27View commit details
Commits on Sep 1, 2023
-
ADAP-814: Add support for replacing materialized views with tables/vi…
…ews and vice versa (#8449) * first draft of adding in table - materialized view swap * table/view/materialized view can all replace each other * update renameable relations to a config * migrate relations macros from `macros/adapters/relations` to `macros/relations` so that generics are close to the relation specific macros that they reference; also aligns with adapter macro files structure, to look more familiar * move drop macro to drop macro file * align the behavior of get_drop_sql and drop_relation, adopt existing default from drop_relation * add explicit ddl for drop statements instead of inheriting the default from dbt-core * update replace macro dependent macros to align with naming standards * update type for mashumaro, update related test
Configuration menu - View commit details
-
Copy full SHA for adfa322 - Browse repository at this point
Copy the full SHA adfa322View commit details -
Configuration menu - View commit details
-
Copy full SHA for da779ac - Browse repository at this point
Copy the full SHA da779acView commit details -
[Automated] Merged prep-release/1.7.0b2_6049623160 into target main d…
…uring release process
Configuration menu - View commit details
-
Copy full SHA for 7eedfcd - Browse repository at this point
Copy the full SHA 7eedfcdView commit details
Commits on Sep 5, 2023
-
Support dbt-cloud config dict in dbt_project.yml (#8527)
* first pass at adding dbt-cloud config * changelog * fix test, add direct validation
Configuration menu - View commit details
-
Copy full SHA for a0e1356 - Browse repository at this point
Copy the full SHA a0e1356View commit details
Commits on Sep 6, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7e2a08f - Browse repository at this point
Copy the full SHA 7e2a08fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9aff3ca - Browse repository at this point
Copy the full SHA 9aff3caView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7578150 - Browse repository at this point
Copy the full SHA 7578150View commit details -
Fix #8544: Parse the correct schema version from manifest (#8551)
* Fix #8544: Parse the correct schema version from manifest * add changie * add comment
Configuration menu - View commit details
-
Copy full SHA for d66fe21 - Browse repository at this point
Copy the full SHA d66fe21View commit details -
Configuration menu - View commit details
-
Copy full SHA for ebeb0f1 - Browse repository at this point
Copy the full SHA ebeb0f1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 89f20d1 - Browse repository at this point
Copy the full SHA 89f20d1View commit details
Commits on Sep 7, 2023
-
Configuration menu - View commit details
-
Copy full SHA for e24a952 - Browse repository at this point
Copy the full SHA e24a952View commit details -
Preserve decimal places for dbt show (#8561)
* update `Number` class to handle integer values (#8306) * add show test for json data * oh changie my changie * revert unecessary cahnge to fixture * keep decimal class for precision methods, but return __int__ value * jerco updates * update integer type * update other tests * Update .changes/unreleased/Fixes-20230803-093502.yaml --------- Co-authored-by: Emily Rockman <emily.rockman@dbtlabs.com> * account for integer vs number on table merges * add tests for combining number with integer. * add unit test when nulls are added * cant none as an Integer * fix null tests --------- Co-authored-by: dave-connors-3 <73915542+dave-connors-3@users.noreply.github.com> Co-authored-by: Dave Connors <dave.connors@fishtownanalytics.com>
Configuration menu - View commit details
-
Copy full SHA for be94bf1 - Browse repository at this point
Copy the full SHA be94bf1View commit details -
Unskip and rename test_expression_metric (#8578)
* Add docstrings to `contracts/graph/metrics.py` functions to document what they do Used [#5607](#5607) for context on what the functions should do. * Add typing to `reverse_dag_parsing` and update function to work on 1.6+ metrics * Add typing to `parent_metrics` and `parent_metrics_names` * Add typing to `base_metric_dependency` and `derived_metric_dependency` and update functions to work on 1.6+ metrics * Simplify implementations of `basic_metric_dependency` and `derived_metric_dependnecy` * Add typing to `ResolvedMetricReference` initialization * Add typing to `derived_metric_dependency_graph` * Simplify conditional controls in `ResolvedMetricReference` functions The functions in `ResolvedMetricReference` use `manifest.metric.get(...)` which will only return either a `Metric` or `None`, never a different node type. Thus we don't need to check that the returned metric is a metric. * Don't recurse on over `depends_on` for non-derived metrics in `reverse_dag_parsing` The function `reverse_dag_parsing` only cares about derived metrics, that is metrics that depend on other metrics. Metrics only depend on other metrics if they are one of the `DERIVED_METRICS` types. Thus doing a recursive call to `reverse_dag_parsing` for non `DERIVED_METRICS` types is unnecessary. Previously we were iterating over a metric's `depends_on` property regardless of whether the metric was a `DERIVED_METRICS` type. Now we only do this work if the metric is of a `DERIVED_METRICS` type. * Simplify `parent_metrics_names` by having it call `parent_metrics` * Unskip `TestMetricHelperFunctions.test_derived_metric` and update fixture setup * Add changie doc for metric helper function updates * Get manifest in `test_derived_metric` from the parse dbt_run invocation * Remove `Relation` a intiatlization attribute for `ResolvedMetricReference` * Add return typing to class `__` functions of `ResolvedMetricReference` * Move from `manifest.metrics.get` to `manifest.expect` in metric helpers Previously with `manifest.metrics.get` we were just skipping when `None` was returned. Getting `None` back was expected in that `parent_unique_id`s that didn't belong to metrics should return `None` when calling `manifest.metrics.get`, and these are fine to skip. However, there's an edgecase where a `parent_unique_id` is supposed to be a metric, but isn't found, thus returning `None`. How likely this edge case could get hit, I'm not sure, but it's a possible edge case. Using `manifest.metrics.get` it we can't actually tell if we're in the edge case or not. By moving to `manifest.expect` we get the error handling built in, and the only trade off is that we need to change our conditional to skip returned nodes that aren't metrics.
Configuration menu - View commit details
-
Copy full SHA for b39eeb3 - Browse repository at this point
Copy the full SHA b39eeb3View commit details
Commits on Sep 11, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 6c6f245 - Browse repository at this point
Copy the full SHA 6c6f245View commit details -
ADAP-869: Support atomic replace in replace macro (#8539)
* move config changes into alter.sql in alignment with other adapters * move shared relations macros to relations root * move single models files to models root * add table to replace * move create file into relation directory * implement replace for postgres * move column specific macros into column directory * add unit test for can_be_replaced * update renameable_relations and replaceable_relations to frozensets to set defaults * fixed tests for new defaults
Configuration menu - View commit details
-
Copy full SHA for 9716690 - Browse repository at this point
Copy the full SHA 9716690View commit details
Commits on Sep 12, 2023
-
Configuration menu - View commit details
-
Copy full SHA for c93cba4 - Browse repository at this point
Copy the full SHA c93cba4View commit details