Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add open collective funding data to event table #2185

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

Jabolol
Copy link
Contributor

@Jabolol Jabolol commented Sep 23, 2024

Closes #1971 by adding open collective staging models that feed into the universal event table.

Copy link

vercel bot commented Sep 23, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
kariba-network ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 25, 2024 8:29am
oso-www ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 25, 2024 8:29am

Copy link

@oso-prs oso-prs bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Auto-approved! please merge responsibly 😄

@oso-prs
Copy link

oso-prs bot commented Sep 23, 2024

Test deployment for PR #2185 failed on commit 476ff24889940ba0f174b268e74c401d13d99ff3. With error:

Error stack:

Error: Command failed: /home/runner/work/oso/oso/ops/external-prs/pr-clone/.venv/bin/dbt run --no-use-colors

    at genericNodeError (node:internal/errors:984:15)
    at wrappedFn (node:internal/errors:538:14)
    at ChildProcess.exithandler (node:child_process:422:12)
    at ChildProcess.emit (node:events:519:28)
    at ChildProcess.emit (node:domain:488:12)
    at maybeClose (node:internal/child_process:1105:16)
    at Socket.<anonymous> (node:internal/child_process:457:11)
    at Socket.emit (node:events:519:28)
    at Socket.emit (node:domain:488:12)
    at Pipe.<anonymous> (node:net:339:12)

DBT stdout:

08:29:22  Running with dbt=1.8.6
08:29:27  Registered adapter: bigquery=1.8.2
08:29:27  Unable to do partial parsing because saved manifest not found. Starting full parse.
08:29:30  Found 220 models, 116 sources, 501 macros
08:29:30  
08:29:31  Concurrency: 32 threads (target='playground')
08:29:31  
08:29:31  1 of 218 START sql view model pr_2185.int_time_intervals ....................... [RUN]
08:29:31  2 of 218 START sql table model pr_2185.rf4_repos_by_app ........................ [RUN]
08:29:31  3 of 218 START sql incremental model pr_2185.rf4_transactions_window ........... [RUN]
08:29:31  4 of 218 START sql incremental model pr_2185.stg_arbitrum__deployers ........... [RUN]
08:29:31  5 of 218 START sql incremental model pr_2185.stg_base__deployers ............... [RUN]
08:29:31  6 of 218 START sql incremental model pr_2185.stg_base__factories ............... [RUN]
08:29:31  7 of 218 START sql incremental model pr_2185.stg_base__first_time_addresses .... [RUN]
08:29:31  8 of 218 START sql table model pr_2185.stg_base__potential_bots ................ [RUN]
08:29:31  9 of 218 START sql incremental model pr_2185.stg_base__proxies ................. [RUN]
08:29:31  10 of 218 START sql incremental model pr_2185.stg_ethereum__deployers .......... [RUN]
08:29:31  12 of 218 START sql view model pr_2185.stg_farcaster__profiles ................. [RUN]
08:29:31  13 of 218 START sql incremental model pr_2185.stg_frax__deployers .............. [RUN]
08:29:31  14 of 218 START sql incremental model pr_2185.stg_frax__factories .............. [RUN]
08:29:31  15 of 218 START sql incremental model pr_2185.stg_frax__first_time_addresses ... [RUN]
08:29:31  16 of 218 START sql table model pr_2185.stg_frax__potential_bots ............... [RUN]
08:29:31  17 of 218 START sql incremental model pr_2185.stg_frax__proxies ................ [RUN]
08:29:31  18 of 218 START sql table model pr_2185.stg_karma3__globaltrust ................ [RUN]
08:29:31  19 of 218 START sql table model pr_2185.stg_karma3__localtrust ................. [RUN]
08:29:31  20 of 218 START sql view model pr_2185.stg_lens__owners ........................ [RUN]
08:29:31  11 of 218 START sql view model pr_2185.stg_farcaster__addresses ................ [RUN]
08:29:31  21 of 218 START sql view model pr_2185.stg_lens__profiles ...................... [RUN]
08:29:31  22 of 218 START sql incremental model pr_2185.stg_metal__deployers ............. [RUN]
08:29:31  23 of 218 START sql incremental model pr_2185.stg_metal__factories ............. [RUN]
08:29:31  24 of 218 START sql incremental model pr_2185.stg_metal__first_time_addresses .. [RUN]
08:29:31  25 of 218 START sql table model pr_2185.stg_metal__potential_bots .............. [RUN]
08:29:31  26 of 218 START sql incremental model pr_2185.stg_metal__proxies ............... [RUN]
08:29:31  27 of 218 START sql incremental model pr_2185.stg_mode__deployers .............. [RUN]
08:29:31  28 of 218 START sql incremental model pr_2185.stg_mode__factories .............. [RUN]
08:29:31  29 of 218 START sql incremental model pr_2185.stg_mode__first_time_addresses ... [RUN]
08:29:31  30 of 218 START sql table model pr_2185.stg_mode__potential_bots ............... [RUN]
08:29:31  31 of 218 START sql incremental model pr_2185.stg_mode__proxies ................ [RUN]
08:29:31  32 of 218 START sql view model pr_2185.stg_open_collective__deposits ........... [RUN]
08:29:33  1 of 218 OK created sql view model pr_2185.int_time_intervals .................. [CREATE VIEW (0 processed) in 2.16s]
08:29:33  33 of 218 START sql view model pr_2185.stg_open_collective__expenses ........... [RUN]
08:29:34  32 of 218 ERROR creating sql view model pr_2185.stg_open_collective__deposits .. [ERROR in 2.38s]
08:29:34  34 of 218 START sql table model pr_2185.stg_optimism__airdrop_addresses ........ [RUN]
08:29:34  11 of 218 OK created sql view model pr_2185.stg_farcaster__addresses ........... [CREATE VIEW (0 processed) in 2.67s]
08:29:34  35 of 218 START sql incremental model pr_2185.stg_optimism__deployers .......... [RUN]
08:29:34  12 of 218 OK created sql view model pr_2185.stg_farcaster__profiles ............ [CREATE VIEW (0 processed) in 2.83s]
08:29:34  36 of 218 START sql incremental model pr_2185.stg_optimism__factories .......... [RUN]
08:29:34  20 of 218 OK created sql view model pr_2185.stg_lens__owners ................... [CREATE VIEW (0 processed) in 2.83s]
08:29:34  37 of 218 START sql incremental model pr_2185.stg_optimism__first_time_addresses  [RUN]
08:29:34  33 of 218 OK created sql view model pr_2185.stg_open_collective__expenses ...... [CREATE VIEW (0 processed) in 0.89s]
08:29:34  38 of 218 START sql table model pr_2185.stg_optimism__potential_bots ........... [RUN]
08:29:34  21 of 218 OK created sql view model pr_2185.stg_lens__profiles ................. [CREATE VIEW (0 processed) in 3.17s]
08:29:34  39 of 218 START sql incremental model pr_2185.stg_optimism__proxies ............ [RUN]
08:29:36  2 of 218 OK created sql table model pr_2185.rf4_repos_by_app ................... [CREATE TABLE (821.0 rows, 705.0 KiB processed) in 4.62s]
08:29:36  40 of 218 START sql view model pr_2185.stg_ossd__current_collections ........... [RUN]
08:29:36  25 of 218 OK created sql table model pr_2185.stg_metal__potential_bots ......... [CREATE TABLE (0.0 rows, 0 processed) in 4.58s]
08:29:36  41 of 218 START sql view model pr_2185.stg_ossd__current_projects .............. [RUN]
08:29:36  16 of 218 OK created sql table model pr_2185.stg_frax__potential_bots .......... [CREATE TABLE (0.0 rows, 0 processed) in 4.62s]
08:29:36  42 of 218 START sql view model pr_2185.stg_ossd__current_repositories .......... [RUN]
08:29:37  42 of 218 OK created sql view model pr_2185.stg_ossd__current_repositories ..... [CREATE VIEW (0 processed) in 0.89s]
08:29:37  43 of 218 START sql view model pr_2185.stg_passport__scores .................... [RUN]
08:29:37  41 of 218 OK created sql view model pr_2185.stg_ossd__current_projects ......... [CREATE VIEW (0 processed) in 1.04s]
08:29:37  44 of 218 START sql incremental model pr_2185.stg_pgn__deployers ............... [RUN]
08:29:37  40 of 218 OK created sql view model pr_2185.stg_ossd__current_collections ...... [CREATE VIEW (0 processed) in 1.26s]
08:29:37  45 of 218 START sql incremental model pr_2185.stg_pgn__factories ............... [RUN]
08:29:37  30 of 218 OK created sql table model pr_2185.stg_mode__potential_bots .......... [CREATE TABLE (14.0 rows, 4.9 MiB processed) in 5.82s]
08:29:37  46 of 218 START sql incremental model pr_2185.stg_pgn__first_time_addresses .... [RUN]
08:29:37  43 of 218 OK created sql view model pr_2185.stg_passport__scores ............... [CREATE VIEW (0 processed) in 0.73s]
08:29:37  47 of 218 START sql table model pr_2185.stg_pgn__potential_bots ................ [RUN]
08:29:39  18 of 218 OK created sql table model pr_2185.stg_karma3__globaltrust ........... [CREATE TABLE (24.0m rows, 733.7 MiB processed) in 7.85s]
08:29:39  48 of 218 START sql incremental model pr_2185.stg_pgn__proxies ................. [RUN]
08:29:39  34 of 218 OK created sql table model pr_2185.stg_optimism__airdrop_addresses ... [CREATE TABLE (611.5k rows, 38.6 MiB processed) in 5.50s]
08:29:39  49 of 218 START sql table model pr_2185.stg_utility__calendar .................. [RUN]
08:29:40  4 of 218 OK created sql incremental model pr_2185.stg_arbitrum__deployers ...... [SCRIPT (0 processed) in 8.62s]
08:29:40  50 of 218 START sql incremental model pr_2185.stg_zora__deployers .............. [RUN]
08:29:40  5 of 218 OK created sql incremental model pr_2185.stg_base__deployers .......... [SCRIPT (0 processed) in 8.98s]
08:29:40  51 of 218 START sql incremental model pr_2185.stg_zora__factories .............. [RUN]
08:29:40  6 of 218 OK created sql incremental model pr_2185.stg_base__factories .......... [SCRIPT (0 processed) in 9.16s]
08:29:40  52 of 218 START sql incremental model pr_2185.stg_zora__first_time_addresses ... [RUN]
08:29:40  7 of 218 OK created sql incremental model pr_2185.stg_base__first_time_addresses  [SCRIPT (0 processed) in 9.37s]
08:29:40  53 of 218 START sql table model pr_2185.stg_zora__potential_bots ............... [RUN]
08:29:41  17 of 218 OK created sql incremental model pr_2185.stg_frax__proxies ........... [SCRIPT (0 processed) in 9.39s]
08:29:41  54 of 218 START sql incremental model pr_2185.stg_zora__proxies ................ [RUN]
08:29:41  13 of 218 OK created sql incremental model pr_2185.stg_frax__deployers ......... [SCRIPT (0 processed) in 9.71s]
08:29:41  55 of 218 SKIP relation pr_2185.stg_open_collective__events .................... [SKIP]
08:29:41  56 of 218 START sql view model pr_2185.int_users ............................... [RUN]
08:29:41  47 of 218 OK created sql table model pr_2185.stg_pgn__potential_bots ........... [CREATE TABLE (0.0 rows, 11.8 KiB processed) in 3.51s]
08:29:41  57 of 218 START sql incremental model pr_2185.stg_github__events ............... [RUN]
08:29:41  22 of 218 OK created sql incremental model pr_2185.stg_metal__deployers ........ [SCRIPT (0 processed) in 10.01s]
08:29:41  58 of 218 START sql view model pr_2185.int_artifacts_in_ossd_by_project ........ [RUN]
08:29:41  15 of 218 OK created sql incremental model pr_2185.stg_frax__first_time_addresses  [SCRIPT (0 processed) in 10.12s]
08:29:41  59 of 218 START sql view model pr_2185.int_projects ............................ [RUN]
08:29:41  9 of 218 OK created sql incremental model pr_2185.stg_base__proxies ............ [SCRIPT (367.8 KiB processed) in 10.21s]
08:29:41  60 of 218 START sql view model pr_2185.int_collections ......................... [RUN]
08:29:41  14 of 218 OK created sql incremental model pr_2185.stg_frax__factories ......... [SCRIPT (0 processed) in 10.30s]
08:29:41  61 of 218 START sql view model pr_2185.int_projects_by_collection .............. [RUN]
08:29:41  26 of 218 OK created sql incremental model pr_2185.stg_metal__proxies .......... [SCRIPT (0 processed) in 10.34s]
08:29:41  62 of 218 START sql table model pr_2185.rf4_trusted_users ...................... [RUN]
08:29:42  3 of 218 OK created sql incremental model pr_2185.rf4_transactions_window ...... [MERGE (11.5m rows, 2.6 GiB processed) in 10.58s]
08:29:42  27 of 218 OK created sql incremental model pr_2185.stg_mode__deployers ......... [SCRIPT (0 processed) in 10.44s]
08:29:42  56 of 218 OK created sql view model pr_2185.int_users .......................... [CREATE VIEW (0 processed) in 0.85s]
08:29:42  63 of 218 START sql table model pr_2185.users_v1 ............................... [RUN]
08:29:42  28 of 218 OK created sql incremental model pr_2185.stg_mode__factories ......... [SCRIPT (0 processed) in 10.61s]
08:29:42  31 of 218 OK created sql incremental model pr_2185.stg_mode__proxies ........... [SCRIPT (0 processed) in 10.65s]
08:29:42  23 of 218 OK created sql incremental model pr_2185.stg_metal__factories ........ [SCRIPT (0 processed) in 10.76s]
08:29:42  24 of 218 OK created sql incremental model pr_2185.stg_metal__first_time_addresses  [SCRIPT (0 processed) in 10.71s]
08:29:42  58 of 218 OK created sql view model pr_2185.int_artifacts_in_ossd_by_project ... [CREATE VIEW (0 processed) in 0.86s]
08:29:42  35 of 218 OK created sql incremental model pr_2185.stg_optimism__deployers ..... [SCRIPT (0 processed) in 8.21s]
08:29:42  60 of 218 OK created sql view model pr_2185.int_collections .................... [CREATE VIEW (0 processed) in 1.01s]
08:29:42  64 of 218 START sql table model pr_2185.collections_v1 ......................... [RUN]
08:29:42  37 of 218 OK created sql incremental model pr_2185.stg_optimism__first_time_addresses  [SCRIPT (0 processed) in 8.47s]
08:29:42  29 of 218 OK created sql incremental model pr_2185.stg_mode__first_time_addresses  [SCRIPT (0 processed) in 11.27s]
08:29:43  61 of 218 OK created sql view model pr_2185.int_projects_by_collection ......... [CREATE VIEW (0 processed) in 1.13s]
08:29:43  65 of 218 START sql table model pr_2185.projects_by_collection_v1 .............. [RUN]
08:29:43  10 of 218 OK created sql incremental model pr_2185.stg_ethereum__deployers ..... [SCRIPT (128.3 KiB processed) in 11.74s]
08:29:43  59 of 218 OK created sql view model pr_2185.int_projects ....................... [CREATE VIEW (0 processed) in 1.54s]
08:29:43  66 of 218 START sql table model pr_2185.projects_v1 ............................ [RUN]
08:29:43  39 of 218 OK created sql incremental model pr_2185.stg_optimism__proxies ....... [SCRIPT (14.0 KiB processed) in 8.55s]
08:29:43  36 of 218 OK created sql incremental model pr_2185.stg_optimism__factories ..... [SCRIPT (0 processed) in 9.21s]
08:29:44  44 of 218 OK created sql incremental model pr_2185.stg_pgn__deployers .......... [SCRIPT (0 processed) in 7.33s]
08:29:44  45 of 218 OK created sql incremental model pr_2185.stg_pgn__factories .......... [SCRIPT (0 processed) in 7.48s]
08:29:45  64 of 218 OK created sql table model pr_2185.collections_v1 .................... [CREATE TABLE (21.0 rows, 893.0 Bytes processed) in 3.04s]
08:29:45  66 of 218 OK created sql table model pr_2185.projects_v1 ....................... [CREATE TABLE (9.0 rows, 762.0 Bytes processed) in 2.63s]
08:29:45  67 of 218 START sql view model pr_2185.int_oss_funding_grants_to_project ....... [RUN]
08:29:45  65 of 218 OK created sql table model pr_2185.projects_by_collection_v1 ......... [CREATE TABLE (66.0 rows, 40.5 KiB processed) in 2.94s]
08:29:46  46 of 218 OK created sql incremental model pr_2185.stg_pgn__first_time_addresses  [SCRIPT (0 processed) in 8.55s]
08:29:46  38 of 218 OK created sql table model pr_2185.stg_optimism__potential_bots ...... [CREATE TABLE (1.2k rows, 1.9 GiB processed) in 11.75s]
08:29:46  8 of 218 OK created sql table model pr_2185.stg_base__potential_bots ........... [CREATE TABLE (9.3k rows, 3.7 GiB processed) in 15.20s]
08:29:46  67 of 218 OK created sql view model pr_2185.int_oss_funding_grants_to_project .. [CREATE VIEW (0 processed) in 0.91s]
08:29:46  50 of 218 OK created sql incremental model pr_2185.stg_zora__deployers ......... [SCRIPT (0 processed) in 6.85s]
08:29:46  68 of 218 START sql table model pr_2185.int_deployers .......................... [RUN]
08:29:46  69 of 218 START sql view model pr_2185.int_deployers_by_project ................ [RUN]
08:29:47  52 of 218 OK created sql incremental model pr_2185.stg_zora__first_time_addresses  [SCRIPT (0 processed) in 6.52s]
08:29:47  70 of 218 START sql view model pr_2185.int_first_time_addresses ................ [RUN]
08:29:47  48 of 218 OK created sql incremental model pr_2185.stg_pgn__proxies ............ [SCRIPT (0 processed) in 7.80s]
08:29:47  51 of 218 OK created sql incremental model pr_2185.stg_zora__factories ......... [SCRIPT (0 processed) in 7.25s]
08:29:47  71 of 218 START sql table model pr_2185.int_factories .......................... [RUN]
08:29:47  70 of 218 OK created sql view model pr_2185.int_first_time_addresses ........... [CREATE VIEW (0 processed) in 0.71s]
08:29:47  72 of 218 START sql view model pr_2185.int_artifacts_by_address ................ [RUN]
08:29:47  57 of 218 OK created sql incremental model pr_2185.stg_github__events .......... [SCRIPT (0 processed) in 6.64s]
08:29:47  73 of 218 START sql view model pr_2185.stg_github__comments .................... [RUN]
08:29:47  74 of 218 START sql view model pr_2185.stg_github__issues ...................... [RUN]
08:29:47  75 of 218 START sql view model pr_2185.stg_github__pull_request_merge_events ... [RUN]
08:29:47  76 of 218 START sql view model pr_2185.stg_github__pull_requests ............... [RUN]
08:29:47  77 of 218 START sql view model pr_2185.stg_github__push_events ................. [RUN]
08:29:47  78 of 218 START sql view model pr_2185.stg_github__releases .................... [RUN]
08:29:47  79 of 218 START sql view model pr_2185.stg_github__stars_and_forks ............. [RUN]
08:29:48  69 of 218 OK created sql view model pr_2185.int_deployers_by_project ........... [CREATE VIEW (0 processed) in 1.06s]
08:29:48  63 of 218 OK created sql table model pr_2185.users_v1 .......................... [CREATE TABLE (1.2m rows, 85.4 MiB processed) in 6.34s]
08:29:48  74 of 218 OK created sql view model pr_2185.stg_github__issues ................. [CREATE VIEW (0 processed) in 0.89s]
08:29:48  72 of 218 OK created sql view model pr_2185.int_artifacts_by_address ........... [CREATE VIEW (0 processed) in 1.10s]
08:29:49  79 of 218 OK created sql view model pr_2185.stg_github__stars_and_forks ........ [CREATE VIEW (0 processed) in 1.20s]
08:29:49  76 of 218 OK created sql view model pr_2185.stg_github__pull_requests .......... [CREATE VIEW (0 processed) in 1.24s]
08:29:49  54 of 218 OK created sql incremental model pr_2185.stg_zora__proxies ........... [SCRIPT (0 processed) in 8.14s]
08:29:49  80 of 218 START sql view model pr_2185.int_proxies ............................. [RUN]
08:29:49  81 of 218 START sql table model pr_2185.int_safes .............................. [RUN]
08:29:49  73 of 218 OK created sql view model pr_2185.stg_github__comments ............... [CREATE VIEW (0 processed) in 1.44s]
08:29:49  78 of 218 OK created sql view model pr_2185.stg_github__releases ............... [CREATE VIEW (0 processed) in 1.44s]
08:29:49  77 of 218 OK created sql view model pr_2185.stg_github__push_events ............ [CREATE VIEW (0 processed) in 1.44s]
08:29:49  82 of 218 START sql view model pr_2185.stg_github__commits ..................... [RUN]
08:29:49  68 of 218 OK created sql table model pr_2185.int_deployers ..................... [CREATE TABLE (0.0 rows, 0 processed) in 2.66s]
08:29:49  75 of 218 OK created sql view model pr_2185.stg_github__pull_request_merge_events  [CREATE VIEW (0 processed) in 1.75s]
08:29:49  53 of 218 OK created sql table model pr_2185.stg_zora__potential_bots .......... [CREATE TABLE (1.4k rows, 852.9 MiB processed) in 9.09s]
08:29:49  83 of 218 START sql view model pr_2185.int_potential_bots ...................... [RUN]
08:29:50  82 of 218 OK created sql view model pr_2185.stg_github__commits ................ [CREATE VIEW (0 processed) in 0.91s]
08:29:50  84 of 218 START sql view model pr_2185.stg_github__distinct_main_commits ....... [RUN]
08:29:50  83 of 218 OK created sql view model pr_2185.int_potential_bots ................. [CREATE VIEW (0 processed) in 0.85s]
08:29:50  85 of 218 START sql view model pr_2185.int_addresses_by_user ................... [RUN]
08:29:50  71 of 218 OK created sql table model pr_2185.int_factories ..................... [CREATE TABLE (0.0 rows, 0 processed) in 3.15s]
08:29:51  84 of 218 OK created sql view model pr_2185.stg_github__distinct_main_commits .. [CREATE VIEW (0 processed) in 1.13s]
08:29:51  86 of 218 START sql view model pr_2185.stg_github__distinct_commits_resolved_mergebot  [RUN]
08:29:51  80 of 218 OK created sql view model pr_2185.int_proxies ........................ [CREATE VIEW (0 processed) in 2.36s]
08:29:51  87 of 218 START sql view model pr_2185.int_derived_contracts ................... [RUN]
08:29:51  85 of 218 OK created sql view model pr_2185.int_addresses_by_user .............. [CREATE VIEW (0 processed) in 1.06s]
08:29:51  88 of 218 START sql view model pr_2185.int_superchain_trusted_users ............ [RUN]
08:29:52  81 of 218 OK created sql table model pr_2185.int_safes ......................... [CREATE TABLE (639.0 rows, 127.6 KiB processed) in 3.25s]
08:29:52  49 of 218 OK created sql table model pr_2185.stg_utility__calendar ............. [CREATE TABLE (31.8k rows, 0 processed) in 13.07s]
08:29:52  86 of 218 OK created sql view model pr_2185.stg_github__distinct_commits_resolved_mergebot  [CREATE VIEW (0 processed) in 1.12s]
08:29:52  87 of 218 OK created sql view model pr_2185.int_derived_contracts .............. [CREATE VIEW (0 processed) in 1.00s]
08:29:52  89 of 218 START sql incremental model pr_2185.stg_base__addresses_gas_and_usage  [RUN]
08:29:52  90 of 218 START sql incremental model pr_2185.stg_frax__addresses_gas_and_usage  [RUN]
08:29:52  91 of 218 START sql incremental model pr_2185.stg_metal__addresses_gas_and_usage  [RUN]
08:29:52  92 of 218 START sql incremental model pr_2185.stg_mode__addresses_gas_and_usage  [RUN]
08:29:52  93 of 218 START sql incremental model pr_2185.stg_optimism__addresses_gas_and_usage  [RUN]
08:29:52  94 of 218 START sql incremental model pr_2185.stg_pgn__addresses_gas_and_usage . [RUN]
08:29:52  95 of 218 START sql incremental model pr_2185.stg_zora__addresses_gas_and_usage  [RUN]
08:29:52  96 of 218 START sql table model pr_2185.contracts_v0 ........................... [RUN]
08:29:52  97 of 218 START sql table model pr_2185.int_contracts_by_project ............... [RUN]
08:29:52  98 of 218 START sql table model pr_2185.rf4_agora_contract_discovery ........... [RUN]
08:29:52  99 of 218 START sql table model pr_2185.rf4_oso_contract_discovery ............. [RUN]
08:29:53  62 of 218 OK created sql table model pr_2185.rf4_trusted_users ................. [CREATE TABLE (3.0m rows, 213.5 MiB processed) in 11.27s]
08:29:53  88 of 218 OK created sql view model pr_2185.int_superchain_trusted_users ....... [CREATE VIEW (0 processed) in 1.34s]
08:29:56  96 of 218 OK created sql table model pr_2185.contracts_v0 ...................... [CREATE TABLE (0.0 rows, 110.1 KiB processed) in 3.73s]
08:29:56  98 of 218 OK created sql table model pr_2185.rf4_agora_contract_discovery ...... [CREATE TABLE (3.9k rows, 803.8 KiB processed) in 4.18s]
08:29:58  99 of 218 OK created sql table model pr_2185.rf4_oso_contract_discovery ........ [CREATE TABLE (327.0 rows, 537.3 KiB processed) in 5.30s]
08:29:58  100 of 218 START sql table model pr_2185.rf4_contracts_by_app .................. [RUN]
08:29:58  97 of 218 OK created sql table model pr_2185.int_contracts_by_project .......... [CREATE TABLE (366.0 rows, 131.6 KiB processed) in 5.73s]
08:29:58  101 of 218 START sql view model pr_2185.int_all_artifacts ...................... [RUN]
08:29:58  102 of 218 START sql table model pr_2185.rf4_network_share ..................... [RUN]
08:29:59  101 of 218 OK created sql view model pr_2185.int_all_artifacts ................. [CREATE VIEW (0 processed) in 1.12s]
08:29:59  103 of 218 START sql view model pr_2185.int_artifact_types ..................... [RUN]
08:29:59  104 of 218 START sql view model pr_2185.int_artifacts_by_collection ............ [RUN]
08:29:59  105 of 218 START sql view model pr_2185.int_artifacts_by_project ............... [RUN]
08:29:59  106 of 218 START sql incremental model pr_2185.int_base_traces ................. [RUN]
08:29:59  107 of 218 START sql incremental model pr_2185.int_base_transactions ........... [RUN]
08:29:59  108 of 218 START sql incremental model pr_2185.int_frax_traces ................. [RUN]
08:29:59  109 of 218 START sql incremental model pr_2185.int_frax_transactions ........... [RUN]
08:29:59  110 of 218 START sql incremental model pr_2185.int_metal_traces ................ [RUN]
08:29:59  111 of 218 START sql incremental model pr_2185.int_metal_transactions .......... [RUN]
08:29:59  112 of 218 START sql incremental model pr_2185.int_mode_traces ................. [RUN]
08:29:59  113 of 218 START sql incremental model pr_2185.int_mode_transactions ........... [RUN]
08:29:59  114 of 218 START sql incremental model pr_2185.int_optimism_traces ............. [RUN]
08:29:59  115 of 218 START sql incremental model pr_2185.int_optimism_transactions ....... [RUN]
08:29:59  116 of 218 START sql incremental model pr_2185.int_pgn_traces .................. [RUN]
08:29:59  117 of 218 START sql incremental model pr_2185.int_pgn_transactions ............ [RUN]
08:29:59  118 of 218 START sql incremental model pr_2185.int_zora_traces ................. [RUN]
08:29:59  119 of 218 START sql incremental model pr_2185.int_zora_transactions ........... [RUN]
08:29:59  92 of 218 OK created sql incremental model pr_2185.stg_mode__addresses_gas_and_usage  [SCRIPT (0 processed) in 7.11s]
08:30:00  95 of 218 OK created sql incremental model pr_2185.stg_zora__addresses_gas_and_usage  [SCRIPT (0 processed) in 7.51s]
08:30:00  93 of 218 OK created sql incremental model pr_2185.stg_optimism__addresses_gas_and_usage  [SCRIPT (0 processed) in 7.60s]
08:30:00  90 of 218 OK created sql incremental model pr_2185.stg_frax__addresses_gas_and_usage  [SCRIPT (0 processed) in 7.70s]
08:30:00  100 of 218 OK created sql table model pr_2185.rf4_contracts_by_app ............. [CREATE TABLE (3.1k rows, 617.6 KiB processed) in 2.75s]
08:30:00  120 of 218 START sql table model pr_2185.rf4_transactions_by_app ............... [RUN]
08:30:00  94 of 218 OK created sql incremental model pr_2185.stg_pgn__addresses_gas_and_usage  [SCRIPT (0 processed) in 8.15s]
08:30:00  19 of 218 OK created sql table model pr_2185.stg_karma3__localtrust ............ [CREATE TABLE (237.0m rows, 8.8 GiB processed) in 29.31s]
08:30:01  89 of 218 OK created sql incremental model pr_2185.stg_base__addresses_gas_and_usage  [SCRIPT (0 processed) in 8.45s]
08:30:01  105 of 218 OK created sql view model pr_2185.int_artifacts_by_project .......... [CREATE VIEW (0 processed) in 1.91s]
08:30:01  121 of 218 START sql table model pr_2185.artifacts_by_project_v1 ............... [RUN]
08:30:01  104 of 218 OK created sql view model pr_2185.int_artifacts_by_collection ....... [CREATE VIEW (0 processed) in 1.98s]
08:30:01  122 of 218 START sql table model pr_2185.artifacts_by_collection_v1 ............ [RUN]
08:30:01  103 of 218 OK created sql view model pr_2185.int_artifact_types ................ [CREATE VIEW (0 processed) in 2.30s]
08:30:01  91 of 218 OK created sql incremental model pr_2185.stg_metal__addresses_gas_and_usage  [SCRIPT (0 processed) in 9.26s]
08:30:01  123 of 218 START sql view model pr_2185.int_addresses_usage .................... [RUN]
08:30:02  123 of 218 OK created sql view model pr_2185.int_addresses_usage ............... [CREATE VIEW (0 processed) in 0.81s]
08:30:03  102 of 218 OK created sql table model pr_2185.rf4_network_share ................ [CREATE TABLE (412.1k rows, 2.3 GiB processed) in 4.62s]
08:30:08  121 of 218 OK created sql table model pr_2185.artifacts_by_project_v1 .......... [CREATE TABLE (1.4k rows, 192.9 KiB processed) in 6.33s]
08:30:08  124 of 218 START sql table model pr_2185.rf4_4337_events ....................... [RUN]
08:30:08  122 of 218 OK created sql table model pr_2185.artifacts_by_collection_v1 ....... [CREATE TABLE (8.9k rows, 233.3 KiB processed) in 6.50s]
08:30:08  120 of 218 OK created sql table model pr_2185.rf4_transactions_by_app .......... [CREATE TABLE (6.9m rows, 4.4 GiB processed) in 7.43s]
08:30:08  125 of 218 START sql table model pr_2185.rf4_onchain_eligibility_checks ........ [RUN]
08:30:08  109 of 218 OK created sql incremental model pr_2185.int_frax_transactions ...... [SCRIPT (0 processed) in 8.75s]
08:30:08  126 of 218 START sql incremental model pr_2185.int_frax_contract_invocation_events  [RUN]
08:30:08  119 of 218 OK created sql incremental model pr_2185.int_zora_transactions ...... [SCRIPT (0 processed) in 8.95s]
08:30:08  127 of 218 START sql incremental model pr_2185.int_zora_contract_invocation_events  [RUN]
08:30:08  108 of 218 OK created sql incremental model pr_2185.int_frax_traces ............ [SCRIPT (0 processed) in 9.07s]
08:30:09  117 of 218 OK created sql incremental model pr_2185.int_pgn_transactions ....... [SCRIPT (0 processed) in 9.08s]
08:30:09  116 of 218 OK created sql incremental model pr_2185.int_pgn_traces ............. [SCRIPT (0 processed) in 9.19s]
08:30:09  112 of 218 OK created sql incremental model pr_2185.int_mode_traces ............ [SCRIPT (0 processed) in 9.22s]
08:30:09  106 of 218 OK created sql incremental model pr_2185.int_base_traces ............ [SCRIPT (0 processed) in 9.29s]
08:30:09  128 of 218 START sql incremental model pr_2185.int_pgn_contract_invocation_events  [RUN]
08:30:09  107 of 218 OK created sql incremental model pr_2185.int_base_transactions ...... [SCRIPT (0 processed) in 9.39s]
08:30:09  129 of 218 START sql incremental model pr_2185.int_base_contract_invocation_events  [RUN]
08:30:09  115 of 218 OK created sql incremental model pr_2185.int_optimism_transactions .. [SCRIPT (0 processed) in 9.57s]
08:30:09  130 of 218 START sql incremental model pr_2185.int_optimism_contract_invocation_events  [RUN]
08:30:09  118 of 218 OK created sql incremental model pr_2185.int_zora_traces ............ [SCRIPT (0 processed) in 9.84s]
08:30:10  114 of 218 OK created sql incremental model pr_2185.int_optimism_traces ........ [SCRIPT (0 processed) in 10.23s]
08:30:10  110 of 218 OK created sql incremental model pr_2185.int_metal_traces ........... [SCRIPT (0 processed) in 10.24s]
08:30:10  113 of 218 OK created sql incremental model pr_2185.int_mode_transactions ...... [SCRIPT (0 processed) in 10.61s]
08:30:10  131 of 218 START sql incremental model pr_2185.int_mode_contract_invocation_events  [RUN]
08:30:10  111 of 218 OK created sql incremental model pr_2185.int_metal_transactions ..... [SCRIPT (0 processed) in 10.77s]
08:30:10  132 of 218 START sql incremental model pr_2185.int_metal_contract_invocation_events  [RUN]
08:30:11  124 of 218 OK created sql table model pr_2185.rf4_4337_events .................. [CREATE TABLE (0.0 rows, 121.1 KiB processed) in 3.69s]
08:30:16  126 of 218 OK created sql incremental model pr_2185.int_frax_contract_invocation_events  [SCRIPT (0 processed) in 7.81s]
08:30:16  128 of 218 OK created sql incremental model pr_2185.int_pgn_contract_invocation_events  [SCRIPT (0 processed) in 7.31s]
08:30:16  127 of 218 OK created sql incremental model pr_2185.int_zora_contract_invocation_events  [SCRIPT (0 processed) in 7.75s]
08:30:16  129 of 218 OK created sql incremental model pr_2185.int_base_contract_invocation_events  [SCRIPT (0 processed) in 7.43s]
08:30:16  130 of 218 OK created sql incremental model pr_2185.int_optimism_contract_invocation_events  [SCRIPT (0 processed) in 7.47s]
08:30:17  132 of 218 OK created sql incremental model pr_2185.int_metal_contract_invocation_events  [SCRIPT (0 processed) in 7.14s]
08:30:18  131 of 218 OK created sql incremental model pr_2185.int_mode_contract_invocation_events  [SCRIPT (0 processed) in 7.65s]
08:30:18  133 of 218 SKIP relation pr_2185.int_events .................................... [SKIP]
08:30:18  134 of 218 SKIP relation pr_2185.event_types_v1 ................................ [SKIP]
08:30:18  135 of 218 SKIP relation pr_2185.int_artifacts_by_user ......................... [SKIP]
08:30:18  136 of 218 SKIP relation pr_2185.int_artifacts_history ......................... [SKIP]
08:30:18  137 of 218 SKIP relation pr_2185.int_events_daily_to_artifact .................. [SKIP]
08:30:18  138 of 218 SKIP relation pr_2185.int_events_to_project ......................... [SKIP]
08:30:18  139 of 218 SKIP relation pr_2185.oso_events_v0 ................................. [SKIP]
08:30:18  140 of 218 SKIP relation pr_2185.superchain_metric__daily_active_addresses_avg_6_months  [SKIP]
08:30:18  141 of 218 SKIP relation pr_2185.superchain_metric__gas_fees_sum_6_months ...... [SKIP]
08:30:18  142 of 218 SKIP relation pr_2185.superchain_metric__monthly_active_addresses_avg_6_months  [SKIP]
08:30:18  143 of 218 SKIP relation pr_2185.superchain_metric__transactions_sum_6_months .. [SKIP]
08:30:18  144 of 218 SKIP relation pr_2185.superchain_metric__trusted_daily_active_users_avg_6_months  [SKIP]
08:30:18  145 of 218 SKIP relation pr_2185.superchain_metric__trusted_monthly_active_users_avg_6_months  [SKIP]
08:30:18  146 of 218 SKIP relation pr_2185.superchain_metric__trusted_transactions_sum_6_months  [SKIP]
08:30:18  147 of 218 SKIP relation pr_2185.superchain_metric__trusted_users_onboarded_sum_6_months  [SKIP]
08:30:18  148 of 218 SKIP relation pr_2185.timeseries_events_by_artifact_v0 .............. [SKIP]
08:30:18  149 of 218 SKIP relation pr_2185.artifacts_by_user_v1 .......................... [SKIP]
08:30:18  150 of 218 SKIP relation pr_2185.int_artifacts ................................. [SKIP]
08:30:18  151 of 218 SKIP relation pr_2185.events_daily_to_artifact ...................... [SKIP]
08:30:18  152 of 218 SKIP relation pr_2185.events_daily_to_project ....................... [SKIP]
08:30:18  153 of 218 SKIP relation pr_2185.events_daily_to_project_by_source ............. [SKIP]
08:30:18  154 of 218 SKIP relation pr_2185.int_addresses_to_project ...................... [SKIP]
08:30:18  155 of 218 SKIP relation pr_2185.int_contributors_to_project ................... [SKIP]
08:30:18  156 of 218 SKIP relation pr_2185.int_events_daily_to_project ................... [SKIP]
08:30:18  157 of 218 SKIP relation pr_2185.int_events_to_collection ...................... [SKIP]
08:30:18  158 of 218 SKIP relation pr_2185.int_repo_metrics_by_project ................... [SKIP]
08:30:18  159 of 218 SKIP relation pr_2185.int_timeseries_superchain_metrics__all ........ [SKIP]
08:30:18  160 of 218 SKIP relation pr_2185.artifacts_v1 .................................. [SKIP]
08:30:18  161 of 218 SKIP relation pr_2185.event_indexing_status_by_project_v1 ........... [SKIP]
08:30:18  162 of 218 SKIP relation pr_2185.events_monthly_to_artifact .................... [SKIP]
08:30:18  163 of 218 SKIP relation pr_2185.events_monthly_to_project ..................... [SKIP]
08:30:18  164 of 218 SKIP relation pr_2185.events_monthly_to_project_by_source ........... [SKIP]
08:30:18  165 of 218 SKIP relation pr_2185.events_weekly_to_artifact ..................... [SKIP]
08:30:18  166 of 218 SKIP relation pr_2185.events_weekly_to_project ...................... [SKIP]
08:30:18  167 of 218 SKIP relation pr_2185.events_weekly_to_project_by_source ............ [SKIP]
08:30:18  168 of 218 SKIP relation pr_2185.int_address_rfm_segments_by_project ........... [SKIP]
08:30:18  169 of 218 SKIP relation pr_2185.int_addresses_daily_activity .................. [SKIP]
08:30:18  170 of 218 SKIP relation pr_2185.int_code_metric__active_developers ............ [SKIP]
08:30:18  171 of 218 SKIP relation pr_2185.int_code_metric__commits_prs_issues ........... [SKIP]
08:30:18  172 of 218 SKIP relation pr_2185.int_code_metric__contributors ................. [SKIP]
08:30:18  173 of 218 SKIP relation pr_2185.int_code_metric__new_contributors ............. [SKIP]
08:30:18  174 of 218 SKIP relation pr_2185.int_developer_status_monthly_by_project ....... [SKIP]
08:30:18  175 of 218 SKIP relation pr_2185.int_events_alltime_to_project ................. [SKIP]
08:30:18  176 of 218 SKIP relation pr_2185.int_events_monthly_to_project ................. [SKIP]
08:30:18  177 of 218 SKIP relation pr_2185.int_first_last_event_by_artifact .............. [SKIP]
08:30:18  178 of 218 SKIP relation pr_2185.int_onchain_metric__active_addresses .......... [SKIP]
08:30:18  179 of 218 SKIP relation pr_2185.int_onchain_metric__active_contracts .......... [SKIP]
08:30:18  180 of 218 SKIP relation pr_2185.int_onchain_metric__days_since_first_transaction  [SKIP]
08:30:18  181 of 218 SKIP relation pr_2185.int_onchain_metric__gas_fees .................. [SKIP]
08:30:18  182 of 218 SKIP relation pr_2185.int_onchain_metric__high_low_activity_addresses  [SKIP]
08:30:18  183 of 218 SKIP relation pr_2185.int_onchain_metric__multi_project_addresses ... [SKIP]
08:30:18  184 of 218 SKIP relation pr_2185.int_onchain_metric__new_addresses ............. [SKIP]
08:30:18  185 of 218 SKIP relation pr_2185.int_onchain_metric__returning_addresses ....... [SKIP]
08:30:18  186 of 218 SKIP relation pr_2185.int_onchain_metric__transactions .............. [SKIP]
08:30:18  187 of 218 SKIP relation pr_2185.int_timeseries_code_metrics__developers ....... [SKIP]
08:30:18  188 of 218 SKIP relation pr_2185.events_daily_to_collection .................... [SKIP]
08:30:18  189 of 218 SKIP relation pr_2185.events_daily_to_collection_by_source .......... [SKIP]
08:30:18  190 of 218 SKIP relation pr_2185.rf4_repo_stats_by_project ..................... [SKIP]
08:30:18  191 of 218 SKIP relation pr_2185.rf4_events_daily_to_project ................... [SKIP]
08:30:18  192 of 218 SKIP relation pr_2185.int_active_addresses_daily_to_project ......... [SKIP]
08:30:18  193 of 218 SKIP relation pr_2185.int_active_addresses_monthly_to_project ....... [SKIP]
08:30:18  194 of 218 SKIP relation pr_2185.int_address_totals_by_project ................. [SKIP]
08:30:18  195 of 218 SKIP relation pr_2185.int_code_metric__bus_factor ................... [SKIP]
08:30:18  196 of 218 SKIP relation pr_2185.int_onchain_metrics_by_project ................ [SKIP]
08:30:18  197 of 218 SKIP relation pr_2185.events_monthly_to_collection .................. [SKIP]
08:30:18  198 of 218 SKIP relation pr_2185.events_weekly_to_collection ................... [SKIP]
08:30:18  199 of 218 SKIP relation pr_2185.int_code_metric__fulltime_developers_average .. [SKIP]
08:30:18  200 of 218 SKIP relation pr_2185.events_monthly_to_collection_by_source ........ [SKIP]
08:30:18  201 of 218 SKIP relation pr_2185.events_weekly_to_collection_by_source ......... [SKIP]
08:30:18  202 of 218 SKIP relation pr_2185.rf4_daily_active_addresses .................... [SKIP]
08:30:18  203 of 218 SKIP relation pr_2185.rf4_gas_fees .................................. [SKIP]
08:30:18  204 of 218 SKIP relation pr_2185.rf4_monthly_active_addresses .................. [SKIP]
08:30:18  205 of 218 SKIP relation pr_2185.rf4_openrank_trusted_users_count .............. [SKIP]
08:30:18  206 of 218 SKIP relation pr_2185.rf4_power_user_addresses ...................... [SKIP]
08:30:18  207 of 218 SKIP relation pr_2185.rf4_recurring_addresses ....................... [SKIP]
08:30:18  208 of 218 SKIP relation pr_2185.rf4_transactions .............................. [SKIP]
08:30:18  209 of 218 SKIP relation pr_2185.rf4_trusted_daily_active_users ................ [SKIP]
08:30:18  210 of 218 SKIP relation pr_2185.rf4_trusted_monthly_active_users .............. [SKIP]
08:30:18  211 of 218 SKIP relation pr_2185.rf4_trusted_recurring_users ................... [SKIP]
08:30:18  212 of 218 SKIP relation pr_2185.rf4_trusted_transaction_count ................. [SKIP]
08:30:18  213 of 218 SKIP relation pr_2185.rf4_trusted_users_onboarded ................... [SKIP]
08:30:18  214 of 218 SKIP relation pr_2185.rf4_trusted_users_share_of_transactions ....... [SKIP]
08:30:18  215 of 218 SKIP relation pr_2185.onchain_metrics_by_project_v1 ................. [SKIP]
08:30:18  216 of 218 SKIP relation pr_2185.int_code_metrics_by_project ................... [SKIP]
08:30:18  217 of 218 SKIP relation pr_2185.rf4_impact_metrics_by_project ................. [SKIP]
08:30:18  218 of 218 SKIP relation pr_2185.code_metrics_by_project_v1 .................... [SKIP]
08:30:21  125 of 218 OK created sql table model pr_2185.rf4_onchain_eligibility_checks ... [CREATE TABLE (462.0 rows, 791.6 MiB processed) in 13.23s]
08:30:21  
08:30:21  Finished running 73 view models, 85 table models, 60 incremental models in 0 hours 0 minutes and 50.76 seconds (50.76s).
08:30:21  
08:30:21  Completed with 1 error and 0 warnings:
08:30:21  
08:30:21    Runtime Error in model stg_open_collective__deposits (warehouse/dbt/models/staging/open-collective/stg_open_collective__deposits.sql)
  404 Not found: Table opensource-observer:open_collective.deposits was not found in location US; reason: notFound, message: Not found: Table opensource-observer:open_collective.deposits was not found in location US
  
  Location: US
  Job ID: 8796b7ef-8c40-4e85-ac2e-cfa9820017ad
  
08:30:21  
08:30:21  Done. PASS=130 WARN=0 ERROR=1 SKIP=87 TOTAL=218

DBT stderr:


@Jabolol
Copy link
Contributor Author

Jabolol commented Sep 23, 2024

FYI, still need to re-materialize Open Collective tables, not merging still

@ravenac95
Copy link
Member

ravenac95 commented Sep 23, 2024

@Jabolol you would generally also need to set the dataset to public. I just did if for you as i noticed the issue. Here's the how to: https://www.loom.com/share/9bac12213a6a483585c907fa95b667df

@Jabolol
Copy link
Contributor Author

Jabolol commented Sep 24, 2024

As discussed, we are going to filter out Open Collective transactions that are not USD for the moment, to keep the data consistent. Issue to keep track of this: #2195

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Normalize/clean all funding datasets to feed into the event table as FUNDING events
2 participants