Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(dbt): adds source and staging models for arb1 events #2197

Merged
merged 6 commits into from
Sep 25, 2024
Merged

feat(dbt): adds source and staging models for arb1 events #2197

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
f13ccdb
feat(dbt): adds source and staging models for arb1 events
ccerv1 Sep 24, 2024
b282572
fix: update int_arbitrum_one_traces
ccerv1 Sep 24, 2024
2c9309b
Update int_arbitrum_one_transactions.sql
ccerv1 Sep 24, 2024
1f4cda6
Adds gas_price conversion
ravenac95 Sep 25, 2024
f017fc0
make sure the playgrounds work
ravenac95 Sep 25, 2024
e81c6c0
Reduce the need for 80 char line length
ravenac95 Sep 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions warehouse/dbt/models/arbitrum_one_sources.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
sources:
- name: arbitrum_one
database: opensource-observer
schema: arbitrum_one
tables:
- name: transactions
identifier: arbitrum_transactions

- name: blocks
identifier: arbitrum_blocks

- name: traces
identifier: arbitrum_traces
15 changes: 0 additions & 15 deletions warehouse/dbt/models/arbitrum_sources.yml
View file
Open in desktop

This file was deleted.

2 changes: 1 addition & 1 deletion warehouse/dbt/models/intermediate/blockchain_artifacts/int_deployers.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
)
}}

{% set networks = ["optimism", "base", "frax", "metal", "mode", "zora"] %}
{% set networks = ["optimism", "base", "frax", "metal", "mode", "zora", "arbitrum_one"] %}

{% set union_queries = [] %}

Expand Down
2 changes: 1 addition & 1 deletion warehouse/dbt/models/intermediate/blockchain_artifacts/int_factories.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
)
}}

{% set networks = ["optimism", "base", "frax", "metal", "mode", "zora"] %}
{% set networks = ["optimism", "base", "frax", "metal", "mode", "zora", "arbitrum_one"] %}

{% set union_queries = [] %}

Expand Down
2 changes: 1 addition & 1 deletion warehouse/dbt/models/intermediate/blockchain_artifacts/int_proxies.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{# any from address coming out of a proxy #}

{% set networks = ["optimism", "base", "frax", "metal", "mode", "zora"] %}
{% set networks = ["optimism", "base", "frax", "metal", "mode", "zora", "arbitrum_one"] %}

{% set union_queries = [] %}

Expand Down
2 changes: 1 addition & 1 deletion warehouse/dbt/models/intermediate/blockchain_artifacts/int_safes.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
)
}}

{% set networks = ["optimism", "base", "frax", "metal", "mode", "zora"] %}
{% set networks = ["optimism", "base", "frax", "metal", "mode", "zora", "arbitrum_one"] %}

{% set union_queries = [] %}

Expand Down
19 changes: 19 additions & 0 deletions ...dbt/models/intermediate/blockchain_events/int_arbitrum_one_contract_invocation_events.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
{{
config(
materialized='incremental',
partition_by={
"field": "time",
"data_type": "timestamp",
"granularity": "day",
},
unique_id="id",
on_schema_change="append_new_columns",
incremental_strategy="insert_overwrite"
)
}}
{% if is_incremental() %}
{% set start = "TIMESTAMP_SUB(_dbt_max_partition, INTERVAL 1 DAY)" %}
{% else %}
{% set start = "'1970-01-01'" %}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ravenac95 check for gas logic

{% endif %}
{{ contract_invocation_events_with_l1("arbitrum_one", start) }}
14 changes: 14 additions & 0 deletions warehouse/dbt/models/intermediate/blockchain_events/int_arbitrum_one_traces.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
{{
config(
materialized='incremental',
partition_by={
"field": "block_timestamp",
"data_type": "timestamp",
"granularity": "day",
},
unique_id="id",
on_schema_change="append_new_columns",
incremental_strategy="insert_overwrite"
)
}}
{{ filtered_blockchain_events("BASE", "base", "traces") }}
ccerv1 marked this conversation as resolved.
Show resolved Hide resolved
14 changes: 14 additions & 0 deletions warehouse/dbt/models/intermediate/blockchain_events/int_arbitrum_one_transactions.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
{{
config(
materialized='incremental',
partition_by={
"field": "block_timestamp",
"data_type": "timestamp",
"granularity": "day",
},
unique_id="id",
on_schema_change="append_new_columns",
incremental_strategy="insert_overwrite"
)
}}
{{ filtered_blockchain_events("arbitrum_one", "base", "transactions") }}
ccerv1 marked this conversation as resolved.
Show resolved Hide resolved
2 changes: 2 additions & 0 deletions warehouse/dbt/models/intermediate/events/int_events.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -212,6 +212,8 @@ all_events as (
select * from {{ ref('int_pgn_contract_invocation_events') }}
union all
select * from {{ ref('int_zora_contract_invocation_events') }}
union all
select * from {{ ref('int_arbitrum_one_contract_invocation_events') }}
)
union all
select
Expand Down
14 changes: 14 additions & 0 deletions warehouse/dbt/models/staging/arbitrum_one/stg_arbitrum_one__deployers.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
{{
config(
materialized='incremental',
partition_by={
"field": "block_timestamp",
"data_type": "timestamp",
"granularity": "day",
},
unique_id="transaction_hash",
on_schema_change="append_new_columns",
incremental_strategy="insert_overwrite"
)
}}
{{ transactions_with_receipts_deployers("arbitrum_one") }}
4 changes: 2 additions & 2 deletions ...ging/arbitrum/stg_arbitrum__deployers.sql → ...itrum_one/stg_arbitrum_one__factories.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,6 @@
unique_id="transaction_hash",
on_schema_change="append_new_columns",
incremental_strategy="insert_overwrite"
)
)
}}
{{ goog_blockchain_deployers("arbitrum") }}
{{ factory_deployments("arbitrum_one") }}
19 changes: 19 additions & 0 deletions warehouse/dbt/models/staging/arbitrum_one/stg_arbitrum_one__proxies.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
{{
config(
materialized='incremental',
partition_by={
"field": "block_timestamp",
"data_type": "timestamp",
"granularity": "day",
},
unique_key="id",
on_schema_change="append_new_columns",
incremental_strategy="insert_overwrite"
)
}}
{% if is_incremental() %}
{% set start = "TIMESTAMP_SUB(_dbt_max_partition, INTERVAL 1 DAY)" %}
{% else %}
{% set start = "'1970-01-01'" %}
{% endif %}
{{ known_proxies("arbitrum_one", start) }}
Loading