Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CT-3406] catalog.json file does not contain sources #9119

Closed
2 tasks done
tallamohan opened this issue Nov 18, 2023 · 8 comments · Fixed by #9159
Closed
2 tasks done

[CT-3406] catalog.json file does not contain sources #9119

tallamohan opened this issue Nov 18, 2023 · 8 comments · Fixed by #9159
Assignees
@aranke
Labels
backport 1.7.latest bug Something isn't working Highest Severity critical bug that must be resolved immediately regression

Comments

@tallamohan
Copy link

tallamohan commented Nov 18, 2023 •
edited
Loading

Is this a new bug in dbt-core?

  • I believe this is a new bug in dbt-core
  • I have searched the existing issues, and I could not find an existing issue for this bug

Current Behavior

The catalog.json file which is generated after "dbt docs generate" does not contain the "sources"

image

And we have made changes required for dbt-core 1.7.x
#8307

  • new capability support structure for adapters
  • Catalog fetch performance improvements

Expected Behavior

catalog.json file should contain "sources" details

Steps To Reproduce

  • Clone dbt-teradata from https://github.com/Teradata/dbt-teradata.git
  • Make changes in "setup.py" file at line no. 48. Make dbt-core==1.7.1
  • Change "requirements_dev.txt" at line number 6 and 9 with dbt-tests-adapter==1.7.1 and dbt-core==1.7.1
  • Run: pip install -r requirements_dev.txt
  • Run any functional testcase with : pytest -v .\tests\functional\adapter\teradata_dbt\test_validate_teradata_catalog.py

Relevant log output

{"data": {"conn_name": "_test", "conn_type": "teradata"}, "info": {"category": "", "code": "E005", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "Acquiring new teradata connection '_test'", "name": "NewConnection", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:48.010912Z"}}
{"data": {"relation": {"database": "dbt_test", "identifier": "", "schema": "dbt_test"}}, "info": {"category": "", "code": "E020", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "Creating schema \"database: \"dbt_test\"\nschema: \"dbt_test\"\n\"", "name": "SchemaCreation", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:48.011912Z"}}
{"data": {"conn_name": "_test", "conn_type": "teradata"}, "info": {"category": "", "code": "E015", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "Using teradata connection \"_test\"", "name": "ConnectionUsed", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:48.028883Z"}}
{"data": {"conn_name": "_test", "sql": ""}, "info": {"category": "", "code": "E016", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "On _test: ", "name": "SQLQuery", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:48.029883Z"}}
{"data": {"connection_state": "init"}, "info": {"category": "", "code": "E037", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "Opening a new connection, currently in state init", "name": "NewConnectionOpening", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:48.030882Z"}}
{"data": {"elapsed": 3.0, "status": "OK"}, "info": {"category": "", "code": "E017", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "SQL status: OK in 3.0 seconds", "name": "SQLQueryStatus", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:51.090486Z"}}
{"data": {"conn_name": "_test", "conn_type": "teradata"}, "info": {"category": "", "code": "E015", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "Using teradata connection \"_test\"", "name": "ConnectionUsed", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:51.092086Z"}}
{"data": {"conn_name": "_test", "sql": "CREATE DATABASE \"dbt_test\"\n    -- Teradata expects db sizing params on creation. This macro is probably\n    -- useful only for testing. For production scenrios, a properly sized\n    -- database (schema) will likely exist before dbt gets called\n    AS PERMANENT = 60e6, -- 60MB\n        SPOOL = 120e6; -- 120MB"}, "info": {"category": "", "code": "E016", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "On _test: CREATE DATABASE \"dbt_test\"\n    -- Teradata expects db sizing params on creation. This macro is probably\n    -- useful only for testing. For production scenrios, a properly sized\n    -- database (schema) will likely exist before dbt gets called\n    AS PERMANENT = 60e6, -- 60MB\n        SPOOL = 120e6; -- 120MB", "name": "SQLQuery", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:51.093412Z"}}
{"data": {"elapsed": 1.0, "status": "OK"}, "info": {"category": "", "code": "E017", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "SQL status: OK in 1.0 seconds", "name": "SQLQueryStatus", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:51.772172Z"}}
{"data": {"conn_name": "_test"}, "info": {"category": "", "code": "E018", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "On _test: COMMIT", "name": "SQLCommit", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:51.772172Z"}}
{"data": {"conn_name": "_test", "conn_type": "teradata"}, "info": {"category": "", "code": "E015", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "Using teradata connection \"_test\"", "name": "ConnectionUsed", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:51.772172Z"}}
{"data": {"conn_name": "_test", "sql": "COMMIT"}, "info": {"category": "", "code": "E016", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "On _test: COMMIT", "name": "SQLQuery", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:51.772172Z"}}
{"data": {"elapsed": 0.0, "status": "OK"}, "info": {"category": "", "code": "E017", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "SQL status: OK in 0.0 seconds", "name": "SQLQueryStatus", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:52.047523Z"}}
{"data": {"conn_name": "_test"}, "info": {"category": "", "code": "E010", "extra": {}, "invocation_id": "04b9f748-2b51-42dd-8ed7-c91b660b7fe4", "level": "debug", "msg": "On _test: Close", "name": "ConnectionClosed", "pid": 30888, "thread": "MainThread", "ts": "2023-11-18T02:59:52.051872Z"}}


============================== 08:29:52.422628 | 4d505208-88e3-4f56-9b2e-63635bc7fdb1 ==============================
�[0m08:29:52.422628 [info ] [MainThread]: Running with dbt=1.7.0
�[0m08:29:52.424629 [debug] [MainThread]: running dbt with arguments {'printer_width': '80', 'indirect_selection': 'eager', 'write_json': 'True', 'log_cache_events': 'False', 'partial_parse': 'True', 'cache_selected_only': 'False', 'profiles_dir': 'C:\\Users\\mt255026\\AppData\\Local\\Temp\\pytest-of-mt255026\\pytest-41\\profile0', 'fail_fast': 'False', 'debug': 'False', 'log_path': 'C:\\dbt-teradata\\logs\\17002763692874284009', 'version_check': 'True', 'warn_error': 'None', 'use_colors': 'True', 'use_experimental_parser': 'False', 'no_print': 'None', 'quiet': 'False', 'log_format': 'default', 'invocation_command': 'dbt -v .\\tests\\functional\\adapter\\teradata_dbt\\test_validate_teradata_catalog.py', 'introspect': 'True', 'static_parser': 'True', 'target_path': 'None', 'warn_error_options': 'WarnErrorOptions(include=[], exclude=[])', 'send_anonymous_usage_stats': 'False'}
�[0m08:29:52.426629 [debug] [MainThread]: Connection '_test' was properly closed.
�[0m08:29:52.529624 [info ] [MainThread]: Registered adapter: teradata=1.0.0
�[0m08:29:52.539627 [debug] [MainThread]: checksum: 8434eacd4ffdf0ca3ab22bf0e2d55b45306c9599613e842b959405abc489e606, vars: {}, profile: , target: , version: 1.7.0
�[0m08:29:52.542661 [info ] [MainThread]: Unable to do partial parsing because saved manifest not found. Starting full parse.
�[0m08:29:53.964482 [debug] [MainThread]: 1699: static parser successfully parsed table_from_source_for_catalog_test.sql
�[0m08:29:53.985440 [debug] [MainThread]: 1699: static parser successfully parsed view_from_source_for_catalog_test.sql
�[0m08:29:54.385568 [info ] [MainThread]: Found 2 models, 1 seed, 1 source, 0 exposures, 0 metrics, 408 macros, 0 groups, 0 semantic models
�[0m08:29:54.446601 [info ] [MainThread]: 
�[0m08:29:54.449578 [debug] [MainThread]: Acquiring new teradata connection 'master'
�[0m08:29:54.453608 [debug] [ThreadPool]: Acquiring new teradata connection 'list_schemas'
�[0m08:29:54.470607 [debug] [ThreadPool]: Using teradata connection "list_schemas"
�[0m08:29:54.471607 [debug] [ThreadPool]: On list_schemas: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "connection_name": "list_schemas"} */
SELECT DatabaseName AS schema_name
        FROM DBC.DatabasesV
�[0m08:29:54.473578 [debug] [ThreadPool]: Opening a new connection, currently in state init
�[0m08:29:58.105651 [debug] [ThreadPool]: SQL status: OK in 4.0 seconds
�[0m08:29:58.120228 [debug] [ThreadPool]: On list_schemas: Close
�[0m08:29:58.405927 [debug] [ThreadPool]: Acquiring new teradata connection 'list_None_dbt_test'
�[0m08:29:58.432500 [debug] [ThreadPool]: Using teradata connection "list_None_dbt_test"
�[0m08:29:58.436512 [debug] [ThreadPool]: On list_None_dbt_test: 
�[0m08:29:58.438522 [debug] [ThreadPool]: Opening a new connection, currently in state init
�[0m08:30:01.343737 [debug] [ThreadPool]: SQL status: OK in 3.0 seconds
�[0m08:30:01.347297 [debug] [ThreadPool]: Using teradata connection "list_None_dbt_test"
�[0m08:30:01.349987 [debug] [ThreadPool]: On list_None_dbt_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "connection_name": "list_None_dbt_test"} */
SELECT
      NULL AS "database",
      TableName AS name,
      DatabaseName AS "schema",
      CASE WHEN TableKind = 'T' THEN 'table'
        WHEN TableKind = 'O' THEN 'table'
        WHEN TableKind = 'V' THEN 'view'
        ELSE TableKind
      END AS table_type
    FROM DBC.TablesV
    WHERE DatabaseName = 'dbt_test' (NOT CASESPECIFIC)
      AND TableKind IN ('T', 'V', 'O')

  
�[0m08:30:01.971599 [debug] [ThreadPool]: SQL status: OK in 1.0 seconds
�[0m08:30:01.978581 [debug] [ThreadPool]: On list_None_dbt_test: ROLLBACK
�[0m08:30:02.343893 [debug] [ThreadPool]: On list_None_dbt_test: Close
�[0m08:30:02.652869 [debug] [MainThread]: Using teradata connection "master"
�[0m08:30:02.655241 [debug] [MainThread]: On master: 
�[0m08:30:02.656321 [debug] [MainThread]: Opening a new connection, currently in state init
�[0m08:30:05.846529 [debug] [MainThread]: SQL status: OK in 3.0 seconds
�[0m08:30:05.849573 [debug] [MainThread]: On master: COMMIT
�[0m08:30:05.852573 [debug] [MainThread]: Using teradata connection "master"
�[0m08:30:05.855574 [debug] [MainThread]: On master: COMMIT
�[0m08:30:06.145706 [debug] [MainThread]: SQL status: OK in 0.0 seconds
�[0m08:30:06.148705 [debug] [MainThread]: On master: Close
�[0m08:30:06.429488 [info ] [MainThread]: Concurrency: 1 threads (target='default')
�[0m08:30:06.432424 [info ] [MainThread]: 
�[0m08:30:06.440024 [debug] [Thread-1  ]: Began running node seed.validate_teradata_testcases.test_table
�[0m08:30:06.442028 [info ] [Thread-1  ]: 1 of 1 START seed file dbt_test.test_table ..................................... [RUN]
�[0m08:30:06.444028 [debug] [Thread-1  ]: Acquiring new teradata connection 'seed.validate_teradata_testcases.test_table'
�[0m08:30:06.445028 [debug] [Thread-1  ]: Began compiling node seed.validate_teradata_testcases.test_table
�[0m08:30:06.447027 [debug] [Thread-1  ]: Timing info for seed.validate_teradata_testcases.test_table (compile): 08:30:06.446030 => 08:30:06.446030
�[0m08:30:06.449040 [debug] [Thread-1  ]: Began executing node seed.validate_teradata_testcases.test_table
�[0m08:30:06.501024 [debug] [Thread-1  ]: model : {'schema': 'dbt_test', 'name': 'test_table', 'resource_type': 'seed', 'package_name': 'validate_teradata_testcases', 'path': 'test_table.csv', 'original_file_path': 'seeds\\test_table.csv', 'unique_id': 'seed.validate_teradata_testcases.test_table', 'fqn': ['validate_teradata_testcases', 'test_table'], 'alias': 'test_table', 'checksum': {'name': 'sha256', 'checksum': 'cf5b4aaa453cfe296aab02678977b87653ab1bd0df322db64b15a257d3d973ef'}, 'config': {'enabled': True, 'tags': [], 'meta': {}, 'materialized': 'seed', 'persist_docs': {}, 'post-hook': [], 'pre-hook': [], 'quoting': {}, 'column_types': {}, 'on_schema_change': 'ignore', 'on_configuration_change': 'apply', 'grants': {}, 'packages': [], 'docs': {'show': True}, 'contract': {'enforced': False, 'alias_types': True}, 'delimiter': ','}, 'tags': [], 'description': '', 'columns': {}, 'meta': {}, 'docs': {'show': True}, 'deferred': False, 'unrendered_config': {}, 'created_at': 1700276394.1270213, 'config_call_dict': {}, 'relation_name': '"dbt_test"."test_table"', 'raw_code': '', 'root_path': 'C:\\Users\\mt255026\\AppData\\Local\\Temp\\pytest-of-mt255026\\pytest-41\\project0', 'depends_on': {'macros': []}}
�[0m08:30:06.504024 [debug] [Thread-1  ]: Using teradata connection "seed.validate_teradata_testcases.test_table"
�[0m08:30:06.505025 [debug] [Thread-1  ]: On seed.validate_teradata_testcases.test_table: 
�[0m08:30:06.506024 [debug] [Thread-1  ]: Opening a new connection, currently in state init
�[0m08:30:09.265903 [debug] [Thread-1  ]: SQL status: OK in 3.0 seconds
�[0m08:30:09.269183 [debug] [Thread-1  ]: Using teradata connection "seed.validate_teradata_testcases.test_table"
�[0m08:30:09.272626 [debug] [Thread-1  ]: On seed.validate_teradata_testcases.test_table: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "seed.validate_teradata_testcases.test_table"} */

    
    CREATE  TABLE "dbt_test"."test_table"
    
    ("id" INTEGER,"attrA" LONG VARCHAR,"attrB" LONG VARCHAR)
    ;

  
�[0m08:30:09.924187 [debug] [Thread-1  ]: SQL status: OK in 1.0 seconds
�[0m08:30:09.953530 [debug] [Thread-1  ]: Using teradata connection "seed.validate_teradata_testcases.test_table"
�[0m08:30:09.955538 [debug] [Thread-1  ]: On seed.validate_teradata_testcases.test_table: insert into "dbt_test"."test_table" ("id", "attrA", "attrB") values
                (?,?,?)
        ...
�[0m08:30:10.508799 [debug] [Thread-1  ]: SQL status: OK in 1.0 seconds
�[0m08:30:10.514887 [debug] [Thread-1  ]: Writing runtime SQL for node "seed.validate_teradata_testcases.test_table"
�[0m08:30:10.526265 [debug] [Thread-1  ]: On seed.validate_teradata_testcases.test_table: COMMIT
�[0m08:30:10.526265 [debug] [Thread-1  ]: Using teradata connection "seed.validate_teradata_testcases.test_table"
�[0m08:30:10.526265 [debug] [Thread-1  ]: On seed.validate_teradata_testcases.test_table: COMMIT
�[0m08:30:10.825411 [debug] [Thread-1  ]: SQL status: OK in 0.0 seconds
�[0m08:30:10.828621 [debug] [Thread-1  ]: Timing info for seed.validate_teradata_testcases.test_table (execute): 08:30:06.450024 => 08:30:10.828041
�[0m08:30:10.829781 [debug] [Thread-1  ]: On seed.validate_teradata_testcases.test_table: Close
�[0m08:30:11.114983 [info ] [Thread-1  ]: 1 of 1 OK loaded seed file dbt_test.test_table ................................. [�[32mINSERT 4�[0m in 4.67s]
�[0m08:30:11.119043 [debug] [Thread-1  ]: Finished running node seed.validate_teradata_testcases.test_table
�[0m08:30:11.122145 [debug] [MainThread]: Using teradata connection "master"
�[0m08:30:11.123228 [debug] [MainThread]: On master: 
�[0m08:30:11.124240 [debug] [MainThread]: Opening a new connection, currently in state closed
�[0m08:30:14.125121 [debug] [MainThread]: SQL status: OK in 3.0 seconds
�[0m08:30:14.129059 [debug] [MainThread]: On master: COMMIT
�[0m08:30:14.129596 [debug] [MainThread]: Using teradata connection "master"
�[0m08:30:14.130919 [debug] [MainThread]: On master: COMMIT
�[0m08:30:14.440436 [debug] [MainThread]: SQL status: OK in 0.0 seconds
�[0m08:30:14.443453 [debug] [MainThread]: On master: Close
�[0m08:30:14.752982 [debug] [MainThread]: Connection 'master' was properly closed.
�[0m08:30:14.755918 [debug] [MainThread]: Connection 'list_schemas' was properly closed.
�[0m08:30:14.758844 [debug] [MainThread]: Connection 'list_None_dbt_test' was properly closed.
�[0m08:30:14.761583 [debug] [MainThread]: Connection 'seed.validate_teradata_testcases.test_table' was properly closed.
�[0m08:30:14.762184 [info ] [MainThread]: 
�[0m08:30:14.763191 [info ] [MainThread]: Finished running 1 seed in 0 hours 0 minutes and 20.31 seconds (20.31s).
�[0m08:30:14.765224 [debug] [MainThread]: Command end result
�[0m08:30:14.781195 [info ] [MainThread]: 
�[0m08:30:14.782226 [info ] [MainThread]: �[32mCompleted successfully�[0m
�[0m08:30:14.784227 [info ] [MainThread]: 
�[0m08:30:14.785226 [info ] [MainThread]: Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1
�[0m08:30:14.788226 [debug] [MainThread]: Command `cli seed` succeeded at 08:30:14.788226 after 22.37 seconds
�[0m08:30:14.790226 [debug] [MainThread]: Flushing usage events


============================== 08:30:14.800227 | bbfa6400-617a-4ac9-96f3-71af04775b43 ==============================
�[0m08:30:14.800227 [info ] [MainThread]: Running with dbt=1.7.0
�[0m08:30:14.802228 [debug] [MainThread]: running dbt with arguments {'printer_width': '80', 'indirect_selection': 'eager', 'write_json': 'True', 'log_cache_events': 'False', 'partial_parse': 'True', 'cache_selected_only': 'False', 'profiles_dir': 'C:\\Users\\mt255026\\AppData\\Local\\Temp\\pytest-of-mt255026\\pytest-41\\profile0', 'fail_fast': 'False', 'debug': 'False', 'log_path': 'C:\\dbt-teradata\\logs\\17002763692874284009', 'version_check': 'True', 'warn_error': 'None', 'use_colors': 'True', 'use_experimental_parser': 'False', 'no_print': 'None', 'quiet': 'False', 'log_format': 'default', 'invocation_command': 'dbt -v .\\tests\\functional\\adapter\\teradata_dbt\\test_validate_teradata_catalog.py', 'introspect': 'True', 'static_parser': 'True', 'target_path': 'None', 'warn_error_options': 'WarnErrorOptions(include=[], exclude=[])', 'send_anonymous_usage_stats': 'False'}
�[0m08:30:14.885028 [info ] [MainThread]: Registered adapter: teradata=1.0.0
�[0m08:30:14.894028 [debug] [MainThread]: checksum: 8434eacd4ffdf0ca3ab22bf0e2d55b45306c9599613e842b959405abc489e606, vars: {}, profile: , target: , version: 1.7.0
�[0m08:30:15.071001 [debug] [MainThread]: Partial parsing enabled: 0 files deleted, 0 files added, 0 files changed.
�[0m08:30:15.071999 [debug] [MainThread]: Partial parsing enabled, no changes found, skipping parsing
�[0m08:30:15.104998 [info ] [MainThread]: Found 2 models, 1 seed, 1 source, 0 exposures, 0 metrics, 408 macros, 0 groups, 0 semantic models
�[0m08:30:15.106995 [info ] [MainThread]: 
�[0m08:30:15.109996 [debug] [MainThread]: Acquiring new teradata connection 'master'
�[0m08:30:15.111995 [debug] [ThreadPool]: Acquiring new teradata connection 'list_schemas'
�[0m08:30:15.116994 [debug] [ThreadPool]: Using teradata connection "list_schemas"
�[0m08:30:15.117995 [debug] [ThreadPool]: On list_schemas: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "connection_name": "list_schemas"} */
SELECT DatabaseName AS schema_name
        FROM DBC.DatabasesV
�[0m08:30:15.118995 [debug] [ThreadPool]: Opening a new connection, currently in state init
�[0m08:30:18.525781 [debug] [ThreadPool]: SQL status: OK in 3.0 seconds
�[0m08:30:18.538682 [debug] [ThreadPool]: On list_schemas: Close
�[0m08:30:18.834522 [debug] [ThreadPool]: Acquiring new teradata connection 'list_None_dbt_test'
�[0m08:30:18.840338 [debug] [ThreadPool]: Using teradata connection "list_None_dbt_test"
�[0m08:30:18.841473 [debug] [ThreadPool]: On list_None_dbt_test: 
�[0m08:30:18.842555 [debug] [ThreadPool]: Opening a new connection, currently in state init
�[0m08:30:21.762525 [debug] [ThreadPool]: SQL status: OK in 3.0 seconds
�[0m08:30:21.766013 [debug] [ThreadPool]: Using teradata connection "list_None_dbt_test"
�[0m08:30:21.768476 [debug] [ThreadPool]: On list_None_dbt_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "connection_name": "list_None_dbt_test"} */
SELECT
      NULL AS "database",
      TableName AS name,
      DatabaseName AS "schema",
      CASE WHEN TableKind = 'T' THEN 'table'
        WHEN TableKind = 'O' THEN 'table'
        WHEN TableKind = 'V' THEN 'view'
        ELSE TableKind
      END AS table_type
    FROM DBC.TablesV
    WHERE DatabaseName = 'dbt_test' (NOT CASESPECIFIC)
      AND TableKind IN ('T', 'V', 'O')

  
�[0m08:30:22.417770 [debug] [ThreadPool]: SQL status: OK in 1.0 seconds
�[0m08:30:22.426220 [debug] [ThreadPool]: On list_None_dbt_test: ROLLBACK
�[0m08:30:22.723632 [debug] [ThreadPool]: On list_None_dbt_test: Close
�[0m08:30:23.034298 [debug] [MainThread]: Using teradata connection "master"
�[0m08:30:23.037557 [debug] [MainThread]: On master: 
�[0m08:30:23.039188 [debug] [MainThread]: Opening a new connection, currently in state init
�[0m08:30:25.717822 [debug] [MainThread]: SQL status: OK in 3.0 seconds
�[0m08:30:25.721199 [debug] [MainThread]: On master: COMMIT
�[0m08:30:25.725246 [debug] [MainThread]: Using teradata connection "master"
�[0m08:30:25.729358 [debug] [MainThread]: On master: COMMIT
�[0m08:30:26.019053 [debug] [MainThread]: SQL status: OK in 0.0 seconds
�[0m08:30:26.020145 [debug] [MainThread]: On master: Close
�[0m08:30:26.302129 [info ] [MainThread]: Concurrency: 1 threads (target='default')
�[0m08:30:26.305747 [info ] [MainThread]: 
�[0m08:30:26.310278 [debug] [Thread-5  ]: Began running node model.validate_teradata_testcases.table_from_source_for_catalog_test
�[0m08:30:26.311808 [info ] [Thread-5  ]: 1 of 2 START sql table model dbt_test.table_from_source_for_catalog_test ....... [RUN]
�[0m08:30:26.313809 [debug] [Thread-5  ]: Acquiring new teradata connection 'model.validate_teradata_testcases.table_from_source_for_catalog_test'
�[0m08:30:26.314810 [debug] [Thread-5  ]: Began compiling node model.validate_teradata_testcases.table_from_source_for_catalog_test
�[0m08:30:26.329837 [debug] [Thread-5  ]: Writing injected SQL for node "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:26.334837 [debug] [Thread-5  ]: Timing info for model.validate_teradata_testcases.table_from_source_for_catalog_test (compile): 08:30:26.315809 => 08:30:26.333814
�[0m08:30:26.335843 [debug] [Thread-5  ]: Began executing node model.validate_teradata_testcases.table_from_source_for_catalog_test
�[0m08:30:26.399837 [debug] [Thread-5  ]: Writing runtime sql for node "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:26.403808 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:26.404840 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: 
�[0m08:30:26.405837 [debug] [Thread-5  ]: Opening a new connection, currently in state init
�[0m08:30:29.385107 [debug] [Thread-5  ]: SQL status: OK in 3.0 seconds
�[0m08:30:29.388265 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:29.391703 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "model.validate_teradata_testcases.table_from_source_for_catalog_test"} */

  
    
  

  
  CREATE  TABLE
  "dbt_test"."table_from_source_for_catalog_test__dbt_tmp"
  
    AS (
        
    SELECT * FROM "dbt_test"."test_table"
      ) WITH DATA
  
  ;


  
�[0m08:30:29.982303 [debug] [Thread-5  ]: SQL status: OK in 1.0 seconds
�[0m08:30:29.996632 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:29.997636 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "model.validate_teradata_testcases.table_from_source_for_catalog_test"} */

    DROP table /*+ IF EXISTS */ "dbt_test"."table_from_source_for_catalog_test";
  
�[0m08:30:30.274685 [debug] [Thread-5  ]: teradata adapter: Teradata error: [Version 17.20.0.32] [Session 95223] [Teradata Database] [Error 3807] Object 'dbt_test.table_from_source_for_catalog_test' does not exist.
 at gosqldriver/teradatasql.formatError ErrorUtil.go:89
 at gosqldriver/teradatasql.(*teradataConnection).formatDatabaseError ErrorUtil.go:217
 at gosqldriver/teradatasql.(*teradataConnection).makeChainedDatabaseError ErrorUtil.go:233
 at gosqldriver/teradatasql.(*teradataConnection).processErrorParcel TeradataConnection.go:827
 at gosqldriver/teradatasql.(*TeradataRows).processResponseBundle TeradataRows.go:2300
 at gosqldriver/teradatasql.(*TeradataRows).executeSQLRequest TeradataRows.go:867
 at gosqldriver/teradatasql.newTeradataRows TeradataRows.go:717
 at gosqldriver/teradatasql.(*teradataStatement).QueryContext TeradataStatement.go:122
 at gosqldriver/teradatasql.(*teradataConnection).QueryContext TeradataConnection.go:1338
 at database/sql.ctxDriverQuery ctxutil.go:48
 at database/sql.(*DB).queryDC.func1 sql.go:1757
 at database/sql.withLock sql.go:3439
 at database/sql.(*DB).queryDC sql.go:1752
 at database/sql.(*Conn).QueryContext sql.go:2011
 at main.createRows goside.go:783
 at main.goCreateRows goside.go:662
 at _cgoexp_2fd0e7537524_goCreateRows _cgo_gotypes.go:387
 at runtime.cgocallbackg1 cgocall.go:316
 at runtime.cgocallbackg cgocall.go:235
 at runtime.cgocallback asm_amd64.s:994
 at runtime.goexit asm_amd64.s:1594
�[0m08:30:30.279492 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: ROLLBACK
�[0m08:30:30.572537 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:30.575542 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: 
�[0m08:30:30.580543 [debug] [Thread-5  ]: SQL status: OK in 0.0 seconds
�[0m08:30:30.583547 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:30.587285 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "model.validate_teradata_testcases.table_from_source_for_catalog_test"} */

    RENAME table "dbt_test"."table_from_source_for_catalog_test__dbt_tmp" TO "dbt_test"."table_from_source_for_catalog_test"
  
�[0m08:30:31.183963 [debug] [Thread-5  ]: SQL status: OK in 1.0 seconds
�[0m08:30:31.212563 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: COMMIT
�[0m08:30:31.216576 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:31.220574 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: COMMIT
�[0m08:30:31.485334 [debug] [Thread-5  ]: SQL status: OK in 0.0 seconds
�[0m08:30:31.497469 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:31.499459 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "model.validate_teradata_testcases.table_from_source_for_catalog_test"} */
DROP table /*+ IF EXISTS */ "dbt_test"."table_from_source_for_catalog_test__dbt_backup";
�[0m08:30:31.777125 [debug] [Thread-5  ]: teradata adapter: Teradata error: [Version 17.20.0.32] [Session 95223] [Teradata Database] [Error 3807] Object 'dbt_test.table_from_source_for_catalog_test__dbt_backup' does not exist.
 at gosqldriver/teradatasql.formatError ErrorUtil.go:89
 at gosqldriver/teradatasql.(*teradataConnection).formatDatabaseError ErrorUtil.go:217
 at gosqldriver/teradatasql.(*teradataConnection).makeChainedDatabaseError ErrorUtil.go:233
 at gosqldriver/teradatasql.(*teradataConnection).processErrorParcel TeradataConnection.go:827
 at gosqldriver/teradatasql.(*TeradataRows).processResponseBundle TeradataRows.go:2300
 at gosqldriver/teradatasql.(*TeradataRows).executeSQLRequest TeradataRows.go:867
 at gosqldriver/teradatasql.newTeradataRows TeradataRows.go:717
 at gosqldriver/teradatasql.(*teradataStatement).QueryContext TeradataStatement.go:122
 at gosqldriver/teradatasql.(*teradataConnection).QueryContext TeradataConnection.go:1338
 at database/sql.ctxDriverQuery ctxutil.go:48
 at database/sql.(*DB).queryDC.func1 sql.go:1757
 at database/sql.withLock sql.go:3439
 at database/sql.(*DB).queryDC sql.go:1752
 at database/sql.(*Conn).QueryContext sql.go:2011
 at main.createRows goside.go:783
 at main.goCreateRows goside.go:662
 at _cgoexp_2fd0e7537524_goCreateRows _cgo_gotypes.go:387
 at runtime.cgocallbackg1 cgocall.go:316
 at runtime.cgocallbackg cgocall.go:235
 at runtime.cgocallback asm_amd64.s:994
 at runtime.goexit asm_amd64.s:1594
�[0m08:30:31.787587 [debug] [Thread-5  ]: Timing info for model.validate_teradata_testcases.table_from_source_for_catalog_test (execute): 08:30:26.336837 => 08:30:31.786299
�[0m08:30:31.791551 [debug] [Thread-5  ]: On model.validate_teradata_testcases.table_from_source_for_catalog_test: Close
�[0m08:30:32.079123 [info ] [Thread-5  ]: 1 of 2 OK created sql table model dbt_test.table_from_source_for_catalog_test .. [�[32mOK�[0m in 5.76s]
�[0m08:30:32.084543 [debug] [Thread-5  ]: Finished running node model.validate_teradata_testcases.table_from_source_for_catalog_test
�[0m08:30:32.087446 [debug] [Thread-5  ]: Began running node model.validate_teradata_testcases.view_from_source_for_catalog_test
�[0m08:30:32.091421 [info ] [Thread-5  ]: 2 of 2 START sql view model dbt_test.view_from_source_for_catalog_test ......... [RUN]
�[0m08:30:32.096416 [debug] [Thread-5  ]: Re-using an available connection from the pool (formerly model.validate_teradata_testcases.table_from_source_for_catalog_test, now model.validate_teradata_testcases.view_from_source_for_catalog_test)
�[0m08:30:32.100462 [debug] [Thread-5  ]: Began compiling node model.validate_teradata_testcases.view_from_source_for_catalog_test
�[0m08:30:32.116461 [debug] [Thread-5  ]: Writing injected SQL for node "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:32.123467 [debug] [Thread-5  ]: Timing info for model.validate_teradata_testcases.view_from_source_for_catalog_test (compile): 08:30:32.102462 => 08:30:32.121462
�[0m08:30:32.126471 [debug] [Thread-5  ]: Began executing node model.validate_teradata_testcases.view_from_source_for_catalog_test
�[0m08:30:32.200073 [debug] [Thread-5  ]: Writing runtime sql for node "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:32.202074 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:32.203072 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: 
�[0m08:30:32.205040 [debug] [Thread-5  ]: Opening a new connection, currently in state closed
�[0m08:30:35.134739 [debug] [Thread-5  ]: SQL status: OK in 3.0 seconds
�[0m08:30:35.137740 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:35.141740 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "model.validate_teradata_testcases.view_from_source_for_catalog_test"} */

  

  
  REPLACE VIEW "dbt_test"."view_from_source_for_catalog_test__dbt_tmp" AS
    
        SELECT * FROM "dbt_test"."test_table"


�[0m08:30:35.743872 [debug] [Thread-5  ]: SQL status: OK in 1.0 seconds
�[0m08:30:35.753225 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:35.754267 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "model.validate_teradata_testcases.view_from_source_for_catalog_test"} */

    DROP view /*+ IF EXISTS */ "dbt_test"."view_from_source_for_catalog_test";
  
�[0m08:30:36.039549 [debug] [Thread-5  ]: teradata adapter: Teradata error: [Version 17.20.0.32] [Session 95224] [Teradata Database] [Error 3807] Object 'dbt_test.view_from_source_for_catalog_test' does not exist.
 at gosqldriver/teradatasql.formatError ErrorUtil.go:89
 at gosqldriver/teradatasql.(*teradataConnection).formatDatabaseError ErrorUtil.go:217
 at gosqldriver/teradatasql.(*teradataConnection).makeChainedDatabaseError ErrorUtil.go:233
 at gosqldriver/teradatasql.(*teradataConnection).processErrorParcel TeradataConnection.go:827
 at gosqldriver/teradatasql.(*TeradataRows).processResponseBundle TeradataRows.go:2300
 at gosqldriver/teradatasql.(*TeradataRows).executeSQLRequest TeradataRows.go:867
 at gosqldriver/teradatasql.newTeradataRows TeradataRows.go:717
 at gosqldriver/teradatasql.(*teradataStatement).QueryContext TeradataStatement.go:122
 at gosqldriver/teradatasql.(*teradataConnection).QueryContext TeradataConnection.go:1338
 at database/sql.ctxDriverQuery ctxutil.go:48
 at database/sql.(*DB).queryDC.func1 sql.go:1757
 at database/sql.withLock sql.go:3439
 at database/sql.(*DB).queryDC sql.go:1752
 at database/sql.(*Conn).QueryContext sql.go:2011
 at main.createRows goside.go:783
 at main.goCreateRows goside.go:662
 at _cgoexp_2fd0e7537524_goCreateRows _cgo_gotypes.go:387
 at runtime.cgocallbackg1 cgocall.go:316
 at runtime.cgocallbackg cgocall.go:235
 at runtime.cgocallback asm_amd64.s:994
 at runtime.goexit asm_amd64.s:1594
�[0m08:30:36.043235 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: ROLLBACK
�[0m08:30:36.316645 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:36.320468 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: 
�[0m08:30:36.322097 [debug] [Thread-5  ]: SQL status: OK in 0.0 seconds
�[0m08:30:36.322675 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:36.324202 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "model.validate_teradata_testcases.view_from_source_for_catalog_test"} */

    RENAME view "dbt_test"."view_from_source_for_catalog_test__dbt_tmp" TO "dbt_test"."view_from_source_for_catalog_test"
  
�[0m08:30:36.982222 [debug] [Thread-5  ]: SQL status: OK in 1.0 seconds
�[0m08:30:36.985059 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: COMMIT
�[0m08:30:36.986173 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:36.987234 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: COMMIT
�[0m08:30:37.262650 [debug] [Thread-5  ]: SQL status: OK in 0.0 seconds
�[0m08:30:37.276942 [debug] [Thread-5  ]: Using teradata connection "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:37.279936 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "node_id": "model.validate_teradata_testcases.view_from_source_for_catalog_test"} */
DROP view /*+ IF EXISTS */ "dbt_test"."view_from_source_for_catalog_test__dbt_backup";
�[0m08:30:37.559470 [debug] [Thread-5  ]: teradata adapter: Teradata error: [Version 17.20.0.32] [Session 95224] [Teradata Database] [Error 3807] Object 'dbt_test.view_from_source_for_catalog_test__dbt_backup' does not exist.
 at gosqldriver/teradatasql.formatError ErrorUtil.go:89
 at gosqldriver/teradatasql.(*teradataConnection).formatDatabaseError ErrorUtil.go:217
 at gosqldriver/teradatasql.(*teradataConnection).makeChainedDatabaseError ErrorUtil.go:233
 at gosqldriver/teradatasql.(*teradataConnection).processErrorParcel TeradataConnection.go:827
 at gosqldriver/teradatasql.(*TeradataRows).processResponseBundle TeradataRows.go:2300
 at gosqldriver/teradatasql.(*TeradataRows).executeSQLRequest TeradataRows.go:867
 at gosqldriver/teradatasql.newTeradataRows TeradataRows.go:717
 at gosqldriver/teradatasql.(*teradataStatement).QueryContext TeradataStatement.go:122
 at gosqldriver/teradatasql.(*teradataConnection).QueryContext TeradataConnection.go:1338
 at database/sql.ctxDriverQuery ctxutil.go:48
 at database/sql.(*DB).queryDC.func1 sql.go:1757
 at database/sql.withLock sql.go:3439
 at database/sql.(*DB).queryDC sql.go:1752
 at database/sql.(*Conn).QueryContext sql.go:2011
 at main.createRows goside.go:783
 at main.goCreateRows goside.go:662
 at _cgoexp_2fd0e7537524_goCreateRows _cgo_gotypes.go:387
 at runtime.cgocallbackg1 cgocall.go:316
 at runtime.cgocallbackg cgocall.go:235
 at runtime.cgocallback asm_amd64.s:994
 at runtime.goexit asm_amd64.s:1594
�[0m08:30:37.563590 [debug] [Thread-5  ]: Timing info for model.validate_teradata_testcases.view_from_source_for_catalog_test (execute): 08:30:32.129417 => 08:30:37.563004
�[0m08:30:37.564772 [debug] [Thread-5  ]: On model.validate_teradata_testcases.view_from_source_for_catalog_test: Close
�[0m08:30:37.847479 [info ] [Thread-5  ]: 2 of 2 OK created sql view model dbt_test.view_from_source_for_catalog_test .... [�[32mOK�[0m in 5.75s]
�[0m08:30:37.850759 [debug] [Thread-5  ]: Finished running node model.validate_teradata_testcases.view_from_source_for_catalog_test
�[0m08:30:37.853754 [debug] [MainThread]: Using teradata connection "master"
�[0m08:30:37.855408 [debug] [MainThread]: On master: 
�[0m08:30:37.856418 [debug] [MainThread]: Opening a new connection, currently in state closed
�[0m08:30:40.982705 [debug] [MainThread]: SQL status: OK in 3.0 seconds
�[0m08:30:40.986175 [debug] [MainThread]: On master: COMMIT
�[0m08:30:40.989386 [debug] [MainThread]: Using teradata connection "master"
�[0m08:30:40.992627 [debug] [MainThread]: On master: COMMIT
�[0m08:30:41.363947 [debug] [MainThread]: SQL status: OK in 0.0 seconds
�[0m08:30:41.370000 [debug] [MainThread]: On master: Close
�[0m08:30:41.671423 [debug] [MainThread]: Connection 'master' was properly closed.
�[0m08:30:41.675110 [debug] [MainThread]: Connection 'list_schemas' was properly closed.
�[0m08:30:41.677961 [debug] [MainThread]: Connection 'list_None_dbt_test' was properly closed.
�[0m08:30:41.681254 [debug] [MainThread]: Connection 'model.validate_teradata_testcases.view_from_source_for_catalog_test' was properly closed.
�[0m08:30:41.684327 [info ] [MainThread]: 
�[0m08:30:41.687322 [info ] [MainThread]: Finished running 1 table model, 1 view model in 0 hours 0 minutes and 26.57 seconds (26.57s).
�[0m08:30:41.693321 [debug] [MainThread]: Command end result
�[0m08:30:41.733328 [info ] [MainThread]: 
�[0m08:30:41.736337 [info ] [MainThread]: �[32mCompleted successfully�[0m
�[0m08:30:41.739325 [info ] [MainThread]: 
�[0m08:30:41.743327 [info ] [MainThread]: Done. PASS=2 WARN=0 ERROR=0 SKIP=0 TOTAL=2
�[0m08:30:41.751282 [debug] [MainThread]: Command `cli run` succeeded at 08:30:41.750322 after 26.95 seconds
�[0m08:30:41.755280 [debug] [MainThread]: Flushing usage events


============================== 08:30:41.779308 | dd1834ff-19f4-487c-b5fb-02a4d49f822b ==============================
�[0m08:30:41.779308 [info ] [MainThread]: Running with dbt=1.7.0
�[0m08:30:41.781308 [debug] [MainThread]: running dbt with arguments {'printer_width': '80', 'indirect_selection': 'eager', 'write_json': 'True', 'log_cache_events': 'False', 'partial_parse': 'True', 'cache_selected_only': 'False', 'profiles_dir': 'C:\\Users\\mt255026\\AppData\\Local\\Temp\\pytest-of-mt255026\\pytest-41\\profile0', 'fail_fast': 'False', 'debug': 'False', 'log_path': 'C:\\dbt-teradata\\logs\\17002763692874284009', 'version_check': 'True', 'warn_error': 'None', 'use_colors': 'True', 'use_experimental_parser': 'False', 'no_print': 'None', 'quiet': 'False', 'log_format': 'default', 'invocation_command': 'dbt -v .\\tests\\functional\\adapter\\teradata_dbt\\test_validate_teradata_catalog.py', 'introspect': 'True', 'static_parser': 'True', 'target_path': 'None', 'warn_error_options': 'WarnErrorOptions(include=[], exclude=[])', 'send_anonymous_usage_stats': 'False'}
�[0m08:30:41.886064 [info ] [MainThread]: Registered adapter: teradata=1.0.0
�[0m08:30:41.902065 [debug] [MainThread]: checksum: 8434eacd4ffdf0ca3ab22bf0e2d55b45306c9599613e842b959405abc489e606, vars: {}, profile: , target: , version: 1.7.0
�[0m08:30:42.070023 [debug] [MainThread]: Partial parsing enabled: 0 files deleted, 0 files added, 0 files changed.
�[0m08:30:42.071024 [debug] [MainThread]: Partial parsing enabled, no changes found, skipping parsing
�[0m08:30:42.080035 [info ] [MainThread]: Found 2 models, 1 seed, 1 source, 0 exposures, 0 metrics, 408 macros, 0 groups, 0 semantic models
�[0m08:30:42.081027 [info ] [MainThread]: 
�[0m08:30:42.082996 [debug] [MainThread]: Acquiring new teradata connection 'master'
�[0m08:30:42.085024 [debug] [ThreadPool]: Acquiring new teradata connection 'list_None_dbt_test'
�[0m08:30:42.088024 [debug] [ThreadPool]: Using teradata connection "list_None_dbt_test"
�[0m08:30:42.089022 [debug] [ThreadPool]: On list_None_dbt_test: 
�[0m08:30:42.090029 [debug] [ThreadPool]: Opening a new connection, currently in state init
�[0m08:30:44.821759 [debug] [ThreadPool]: SQL status: OK in 3.0 seconds
�[0m08:30:44.825210 [debug] [ThreadPool]: Using teradata connection "list_None_dbt_test"
�[0m08:30:44.828323 [debug] [ThreadPool]: On list_None_dbt_test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "connection_name": "list_None_dbt_test"} */
SELECT
      NULL AS "database",
      TableName AS name,
      DatabaseName AS "schema",
      CASE WHEN TableKind = 'T' THEN 'table'
        WHEN TableKind = 'O' THEN 'table'
        WHEN TableKind = 'V' THEN 'view'
        ELSE TableKind
      END AS table_type
    FROM DBC.TablesV
    WHERE DatabaseName = 'dbt_test' (NOT CASESPECIFIC)
      AND TableKind IN ('T', 'V', 'O')

  
�[0m08:30:45.422905 [debug] [ThreadPool]: SQL status: OK in 1.0 seconds
�[0m08:30:45.431900 [debug] [ThreadPool]: On list_None_dbt_test: ROLLBACK
�[0m08:30:45.721086 [debug] [ThreadPool]: On list_None_dbt_test: Close
�[0m08:30:46.080782 [info ] [MainThread]: Concurrency: 1 threads (target='default')
�[0m08:30:46.084304 [info ] [MainThread]: 
�[0m08:30:46.095253 [debug] [Thread-9  ]: Began running node model.validate_teradata_testcases.table_from_source_for_catalog_test
�[0m08:30:46.100253 [debug] [Thread-9  ]: Acquiring new teradata connection 'model.validate_teradata_testcases.table_from_source_for_catalog_test'
�[0m08:30:46.103254 [debug] [Thread-9  ]: Began compiling node model.validate_teradata_testcases.table_from_source_for_catalog_test
�[0m08:30:46.122253 [debug] [Thread-9  ]: Writing injected SQL for node "model.validate_teradata_testcases.table_from_source_for_catalog_test"
�[0m08:30:46.130255 [debug] [Thread-9  ]: Timing info for model.validate_teradata_testcases.table_from_source_for_catalog_test (compile): 08:30:46.106253 => 08:30:46.128252
�[0m08:30:46.132250 [debug] [Thread-9  ]: Began executing node model.validate_teradata_testcases.table_from_source_for_catalog_test
�[0m08:30:46.135251 [debug] [Thread-9  ]: Timing info for model.validate_teradata_testcases.table_from_source_for_catalog_test (execute): 08:30:46.134249 => 08:30:46.134249
�[0m08:30:46.139250 [debug] [Thread-9  ]: Finished running node model.validate_teradata_testcases.table_from_source_for_catalog_test
�[0m08:30:46.142250 [debug] [Thread-9  ]: Began running node model.validate_teradata_testcases.view_from_source_for_catalog_test
�[0m08:30:46.145254 [debug] [Thread-9  ]: Re-using an available connection from the pool (formerly model.validate_teradata_testcases.table_from_source_for_catalog_test, now model.validate_teradata_testcases.view_from_source_for_catalog_test)
�[0m08:30:46.148251 [debug] [Thread-9  ]: Began compiling node model.validate_teradata_testcases.view_from_source_for_catalog_test
�[0m08:30:46.160037 [debug] [Thread-9  ]: Writing injected SQL for node "model.validate_teradata_testcases.view_from_source_for_catalog_test"
�[0m08:30:46.165036 [debug] [Thread-9  ]: Timing info for model.validate_teradata_testcases.view_from_source_for_catalog_test (compile): 08:30:46.150250 => 08:30:46.163048
�[0m08:30:46.167036 [debug] [Thread-9  ]: Began executing node model.validate_teradata_testcases.view_from_source_for_catalog_test
�[0m08:30:46.170034 [debug] [Thread-9  ]: Timing info for model.validate_teradata_testcases.view_from_source_for_catalog_test (execute): 08:30:46.169030 => 08:30:46.169030
�[0m08:30:46.174036 [debug] [Thread-9  ]: Finished running node model.validate_teradata_testcases.view_from_source_for_catalog_test
�[0m08:30:46.176037 [debug] [Thread-9  ]: Began running node seed.validate_teradata_testcases.test_table
�[0m08:30:46.179036 [debug] [Thread-9  ]: Re-using an available connection from the pool (formerly model.validate_teradata_testcases.view_from_source_for_catalog_test, now seed.validate_teradata_testcases.test_table)
�[0m08:30:46.182030 [debug] [Thread-9  ]: Began compiling node seed.validate_teradata_testcases.test_table
�[0m08:30:46.189036 [debug] [Thread-9  ]: Timing info for seed.validate_teradata_testcases.test_table (compile): 08:30:46.184037 => 08:30:46.188037
�[0m08:30:46.192035 [debug] [Thread-9  ]: Began executing node seed.validate_teradata_testcases.test_table
�[0m08:30:46.194045 [debug] [Thread-9  ]: Timing info for seed.validate_teradata_testcases.test_table (execute): 08:30:46.193036 => 08:30:46.193036
�[0m08:30:46.199044 [debug] [Thread-9  ]: Finished running node seed.validate_teradata_testcases.test_table
�[0m08:30:46.202004 [debug] [MainThread]: Connection 'master' was properly closed.
�[0m08:30:46.204999 [debug] [MainThread]: Connection 'list_None_dbt_test' was properly closed.
�[0m08:30:46.206997 [debug] [MainThread]: Connection 'seed.validate_teradata_testcases.test_table' was properly closed.
�[0m08:30:46.210995 [debug] [MainThread]: Command end result
�[0m08:30:46.543463 [debug] [MainThread]: Acquiring new teradata connection 'generate_catalog'
�[0m08:30:46.551616 [info ] [MainThread]: Building catalog
�[0m08:30:46.557607 [debug] [ThreadPool]: Acquiring new teradata connection 'None.information_schema'
�[0m08:30:46.570610 [debug] [ThreadPool]: use_qvci set to : false
�[0m08:30:46.581605 [debug] [ThreadPool]: Using teradata connection "None.information_schema"
�[0m08:30:46.582606 [debug] [ThreadPool]: On None.information_schema: 
�[0m08:30:46.583608 [debug] [ThreadPool]: Opening a new connection, currently in state init
�[0m08:30:49.563054 [debug] [ThreadPool]: SQL status: OK in 3.0 seconds
�[0m08:30:49.566053 [debug] [ThreadPool]: Using teradata connection "None.information_schema"
�[0m08:30:49.570064 [debug] [ThreadPool]: On None.information_schema: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "connection_name": "None.information_schema"} */
with tables as (
              SELECT			
        NULL AS table_database,
        DatabaseName AS table_schema,
        TableName AS table_name,
        CASE WHEN TableKind = 'T' THEN 'table'
            WHEN TableKind = 'O' THEN 'view'
            WHEN TableKind = 'V' THEN 'view'
            ELSE TableKind
        END AS table_type,
        NULL AS table_owner
    FROM DBC.tablesV
              where (
                (
                    upper("table_schema") = upper('dbt_test')
                    and upper("table_name") = upper('view_from_source_for_catalog_test')
                )
             or 
                (
                    upper("table_schema") = upper('dbt_test')
                    and upper("table_name") = upper('table_from_source_for_catalog_test')
                )
             or 
                (
                    upper("table_schema") = upper('dbt_test')
                    and upper("table_name") = upper('test_table')
                )
            )
          ),
          columns as (
              SELECT
        NULL AS table_database,
        DatabaseName AS table_schema,
        TableName AS table_name,
        NULL AS table_comment,		
        ColumnName AS column_name,
        ColumnID AS column_index,
        ColumnType AS column_type,
        CommentString AS column_comment
		
        FROM DBC.ColumnsV
        
              where (
                (
                    upper("table_schema") = upper('dbt_test')
                    and upper("table_name") = upper('view_from_source_for_catalog_test')
                )
             or 
                (
                    upper("table_schema") = upper('dbt_test')
                    and upper("table_name") = upper('table_from_source_for_catalog_test')
                )
             or 
                (
                    upper("table_schema") = upper('dbt_test')
                    and upper("table_name") = upper('test_table')
                )
            )
          )
          ,
    columns_transformed AS (
        SELECT
          table_database,
          table_schema,
          table_name,
          table_comment,
          column_name,
          column_index,
          CASE
            WHEN column_type = '++' THEN 'TD_ANYTYPE'
            WHEN column_type = 'A1' THEN 'ARRAY'
            WHEN column_type = 'AN' THEN 'ARRAY'
            WHEN column_type = 'I8' THEN 'BIGINT'
            WHEN column_type = 'BO' THEN 'BINARY LARGE OBJECT'
            WHEN column_type = 'BF' THEN 'BYTE'
            WHEN column_type = 'BV' THEN 'BYTE VARYING'
            WHEN column_type = 'I1' THEN 'BYTEINT'
            WHEN column_type = 'CF' THEN 'CHARACTER'
            WHEN column_type = 'CV' THEN 'CHARACTER'
            WHEN column_type = 'CO' THEN 'CHARACTER LARGE OBJECT'
            WHEN column_type = 'D' THEN 'DECIMAL'
            WHEN column_type = 'DA' THEN 'DATE'
            WHEN column_type = 'F' THEN 'DOUBLE PRECISION'
            WHEN column_type = 'I' THEN 'INTEGER'
            WHEN column_type = 'DY' THEN 'INTERVAL DAY'
            WHEN column_type = 'DH' THEN 'INTERVAL DAY TO HOUR'
            WHEN column_type = 'DM' THEN 'INTERVAL DAY TO MINUTE'
            WHEN column_type = 'DS' THEN 'INTERVAL DAY TO SECOND'
            WHEN column_type = 'HR' THEN 'INTERVAL HOUR'
            WHEN column_type = 'HM' THEN 'INTERVAL HOUR TO MINUTE'
            WHEN column_type = 'HS' THEN 'INTERVAL HOUR TO SECOND'
            WHEN column_type = 'MI' THEN 'INTERVAL MINUTE'
            WHEN column_type = 'MS' THEN 'INTERVAL MINUTE TO SECOND'
            WHEN column_type = 'MO' THEN 'INTERVAL MONTH'
            WHEN column_type = 'SC' THEN 'INTERVAL SECOND'
            WHEN column_type = 'YR' THEN 'INTERVAL YEAR'
            WHEN column_type = 'YM' THEN 'INTERVAL YEAR TO MONTH'
            WHEN column_type = 'N' THEN 'NUMBER'
            WHEN column_type = 'D' THEN 'NUMERIC'
            WHEN column_type = 'PD' THEN 'PERIOD(DATE)'
            WHEN column_type = 'PT' THEN 'PERIOD(TIME(n))'
            WHEN column_type = 'PZ' THEN 'PERIOD(TIME(n) WITH TIME ZONE)'
            WHEN column_type = 'PS' THEN 'PERIOD(TIMESTAMP(n))'
            WHEN column_type = 'PM' THEN 'PERIOD(TIMESTAMP(n) WITH TIME ZONE)'
            WHEN column_type = 'F' THEN 'REAL'
            WHEN column_type = 'I2' THEN 'SMALLINT'
            WHEN column_type = 'AT' THEN 'TIME'
            WHEN column_type = 'TS' THEN 'TIMESTAMP'
            WHEN column_type = 'TZ' THEN 'TIME WITH TIME ZONE'
            WHEN column_type = 'SZ' THEN 'TIMESTAMP WITH TIME ZONE'
            WHEN column_type = 'UT' THEN 'USER‑DEFINED TYPE'
            WHEN column_type = 'XM' THEN 'XML'
            ELSE 'N/A'
          END AS column_type,
          column_comment
        FROM columns
    ),
    joined AS (
      SELECT
          columns_transformed.table_database,
          columns_transformed.table_schema,
          columns_transformed.table_name,
          tables.table_type,
          columns_transformed.table_comment,
          tables.table_owner,
          columns_transformed.column_name,
          columns_transformed.column_index,
          columns_transformed.column_type,
          columns_transformed.column_comment
      FROM tables
      JOIN columns_transformed ON
        tables.table_schema = columns_transformed.table_schema
        AND tables.table_name = columns_transformed.table_name
    )
    SELECT *
    FROM joined
    ORDER BY table_schema, table_name, column_index
�[0m08:30:50.477757 [debug] [ThreadPool]: SQL status: OK in 1.0 seconds
�[0m08:30:50.501465 [debug] [ThreadPool]: On None.information_schema: ROLLBACK
�[0m08:30:50.780813 [debug] [ThreadPool]: On None.information_schema: Close
�[0m08:30:51.142059 [info ] [MainThread]: Catalog written to C:\Users\mt255026\AppData\Local\Temp\pytest-of-mt255026\pytest-41\project0\target\catalog.json
�[0m08:30:51.151059 [debug] [MainThread]: Command `cli docs generate` succeeded at 08:30:51.150061 after 9.37 seconds
�[0m08:30:51.154052 [debug] [MainThread]: Connection 'generate_catalog' was properly closed.
�[0m08:30:51.157007 [debug] [MainThread]: Connection 'None.information_schema' was properly closed.
�[0m08:30:51.161053 [debug] [MainThread]: Flushing usage events
�[0m08:30:51.779764 [debug] [MainThread]: Acquiring new teradata connection '_test'
�[0m08:30:51.780767 [debug] [MainThread]: Dropping schema "database: "dbt_test"
schema: "dbt_test"
".
�[0m08:30:51.789964 [debug] [MainThread]: Using teradata connection "_test"
�[0m08:30:51.790992 [debug] [MainThread]: On _test: 
�[0m08:30:51.791997 [debug] [MainThread]: Opening a new connection, currently in state init
�[0m08:30:54.815781 [debug] [MainThread]: SQL status: OK in 3.0 seconds
�[0m08:30:54.818670 [debug] [MainThread]: Using teradata connection "_test"
�[0m08:30:54.820901 [debug] [MainThread]: On _test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "connection_name": "_test"} */
DELETE DATABASE /*+ IF EXISTS */ "dbt_test" ALL;
�[0m08:30:55.522084 [debug] [MainThread]: SQL status: OK in 1.0 seconds
�[0m08:30:55.527078 [debug] [MainThread]: Using teradata connection "_test"
�[0m08:30:55.530079 [debug] [MainThread]: On _test: /* {"app": "dbt", "dbt_version": "1.7.0", "profile_name": "test", "target_name": "default", "connection_name": "_test"} */
DROP DATABASE /*+ IF EXISTS */ "dbt_test";
�[0m08:30:56.212529 [debug] [MainThread]: SQL status: OK in 1.0 seconds
�[0m08:30:56.217987 [debug] [MainThread]: On _test: COMMIT
�[0m08:30:56.221016 [debug] [MainThread]: Using teradata connection "_test"
�[0m08:30:56.223759 [debug] [MainThread]: On _test: COMMIT
�[0m08:30:56.534408 [debug] [MainThread]: SQL status: OK in 0.0 seconds
�[0m08:30:56.538055 [debug] [MainThread]: On _test: Close

Environment

- OS: Windows 10
- Python: 3.11
- dbt: 1.7.x

Which database adapter are you using with dbt?

other (mention it in "Additional Context")

Additional Context

dbt-teradata
@tallamohan tallamohan added bug Something isn't working triage labels Nov 18, 2023
@github-actions github-actions bot changed the title catalog.json file does not contain sources [CT-3406] catalog.json file does not contain sources Nov 18, 2023
@tallamohan tallamohan mentioned this issue Nov 18, 2023
Merged
@tallamohan
Copy link
Author

Hi @dbeatty10 , Can you please look into this issue?

@jtcohen6
Copy link
Contributor

I was able to reproduce this using dbt-postgres:

sources:
  - name: my_src
    tables:
      - name: my_tbl

Using v1.6, running dbt docs generate produces this catalog.json:

{"metadata": {"dbt_schema_version": "https://schemas.getdbt.com/dbt/catalog/v1.json", "dbt_version": "1.6.8", "generated_at": "2023-11-20T14:26:21.130444Z", "invocation_id": "9f22c469-d8ce-4be1-859c-10c76f28f0de", "env": {}}, "nodes": {}, "sources": {"source.my_dbt_project.my_src.my_tbl": {"metadata": {"type": "BASE TABLE", "schema": "my_src", "name": "my_tbl", "database": "jerco", "comment": null, "owner": "jerco"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "updated_at": {"type": "timestamp with time zone", "index": 2, "name": "updated_at", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.my_dbt_project.my_src.my_tbl"}}, "errors": null}

Using v1.7:

{"metadata": {"dbt_schema_version": "https://schemas.getdbt.com/dbt/catalog/v1.json", "dbt_version": "1.7.2", "generated_at": "2023-11-20T14:27:04.897413Z", "invocation_id": "2eb884eb-c212-47d3-a15d-6403e41f776e", "env": {}}, "nodes": {}, "sources": {}, "errors": null}

@graciegoheen graciegoheen added High Severity bug with significant impact that should be resolved in a reasonable timeframe Highest Severity critical bug that must be resolved immediately and removed High Severity bug with significant impact that should be resolved in a reasonable timeframe labels Nov 20, 2023
@graciegoheen
Copy link
Contributor

Notes from estimation:

@emmyoop emmyoop self-assigned this Nov 20, 2023
@aranke aranke assigned aranke and unassigned emmyoop Nov 21, 2023
@tallamohan
Copy link
Author

Hello @aranke , any update on this issue?
Please tell us an ETA for the fix? This is a blocker for dbt-teradata 1.7 release

@aranke
Copy link
Member

aranke commented Nov 27, 2023

Hi @tallamohan,

I'm working on this right now, should be merged in by the end of this week.

Thanks,
Kshitij

aranke added a commit that referenced this issue Nov 28, 2023
@aranke
Fix #9119: Get sources working again in dbt docs generate
5c16614
@aranke aranke mentioned this issue Nov 28, 2023
Merged
5 tasks
aranke added a commit that referenced this issue Nov 28, 2023
@aranke
Fix #9119: Get sources working again in dbt docs generate (#9159)
c836b75
github-actions bot pushed a commit that referenced this issue Nov 28, 2023
@aranke @github-actions
Fix #9119: Get sources working again in dbt docs generate (#9159)
ee5ebb5 
(cherry picked from commit c836b75)
@tallamohan
Copy link
Author

Hay @aranke , When can we expect the next release with this fix?

aranke added a commit that referenced this issue Nov 29, 2023
@github-actions @aranke
[Backport 1.7.latest] Fix #9119: Get sources working again in `dbt do…
cf3714d 
…cs generate` (#9163)

Co-authored-by: Kshitij Aranke <kshitij.aranke@dbtlabs.com>
@tlento tlento mentioned this issue Feb 26, 2024
Merged
@bdtoole
Copy link

bdtoole commented Feb 26, 2024

@aranke I know this issue is ~3 months old, but I just encountered this problem with dbt-postgres 1.7.8. I was able to revert to 1.6 and the sources were included in the catalog.json as expected, however moving back to 1.7.8 causes this problem to come back.

If this was resolved at one point within the past few months, could something have undone the fix?

@dbeatty10 dbeatty10 mentioned this issue Feb 27, 2024
Closed
@dbeatty10
Copy link
Contributor

@bdtoole I opened this issue to investigate further: #9678

One possibility here: #9678 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@aranke aranke

Labels
backport 1.7.latest bug Something isn't working Highest Severity critical bug that must be resolved immediately regression
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix #9119: Get sources working again in dbt docs generate dbt-labs/dbt-core
7 participants
@tallamohan @emmyoop @bdtoole @jtcohen6 @dbeatty10 @aranke @graciegoheen