Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Introduce TableLastModifiedMetadataBatch and implement BaseAdapter.calculate_freshness_from_metadata_batch #127

Merged
merged 29 commits into from
Apr 12, 2024
Merged

Introduce TableLastModifiedMetadataBatch and implement BaseAdapter.calculate_freshness_from_metadata_batch #127

merged 29 commits into from
Apr 12, 2024

Commits on Mar 1, 2024

  1. extend RelationConfig and MaterializationConfig

    @MichelleArk
    MichelleArk committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    2beba0b View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    151b131 View commit details
    Browse the repository at this point in the history

  2. first pass

    @MichelleArk
    MichelleArk committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    727093c View commit details
    Browse the repository at this point in the history

  3. accept information schema in calculate_freshness_from_metadata_batch

    @MichelleArk
    MichelleArk committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    ffaf808 View commit details
    Browse the repository at this point in the history

  4. implement calculate_freshness_from_metadata in terms of calculate_fre… 

    …shness_from_metadata_batch
    @MichelleArk
    MichelleArk committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    b66644a View commit details
    Browse the repository at this point in the history

  5. add TableLastModifiedMetadataBatch capability

    @MichelleArk
    MichelleArk committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    54670e0 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. return batched freshness results keyed by (schema, identifier)

    @MichelleArk
    MichelleArk committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    8046a3e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk authored Mar 13, 2024
    Configuration menu
    Copy the full SHA
    1dbf3e9 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk authored Mar 14, 2024
    Configuration menu
    Copy the full SHA
    2c28576 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk authored Mar 22, 2024
    Configuration menu
    Copy the full SHA
    a9cffcd View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. handle queries across information_schema in calculate_freshness_from_… 

    …metadata_batch
    @MichelleArk
    MichelleArk committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    9af8c85 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk authored Mar 25, 2024
    Configuration menu
    Copy the full SHA
    82d8217 View commit details
    Browse the repository at this point in the history

  3. refactor _create_freshness_response

    @MichelleArk
    MichelleArk committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    ed81529 View commit details
    Browse the repository at this point in the history

  4. make schema_identifier_to_source type-safe

    @MichelleArk
    MichelleArk committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    c44779a View commit details
    Browse the repository at this point in the history

  5. update TableLastModifiedMetadataBatch description

    @MichelleArk
    MichelleArk committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    62be8df View commit details
    Browse the repository at this point in the history

  6. changelog entry

    @MichelleArk
    MichelleArk committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    9a6c829 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. refactor to _get_catalog_relations_by_info_schema, _parse_freshness_row

    @MichelleArk
    MichelleArk committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    17701ad View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. sanitize raw_relation for freshness batch calculation

    @MichelleArk
    MichelleArk committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    511cf14 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. ensure a connection is open if possible prior to executing macro

    @MichelleArk
    MichelleArk committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    01f27a5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk authored Apr 4, 2024
    Configuration menu
    Copy the full SHA
    05c7149 View commit details
    Browse the repository at this point in the history

  3. fix agate typing

    @MichelleArk
    MichelleArk committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    154e066 View commit details
    Browse the repository at this point in the history

  4. lazy load agate_helper

    @MichelleArk
    MichelleArk committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    8c707cc View commit details
    Browse the repository at this point in the history

  5. add needs_conn to BaseAdapter.execute_macro

    @MichelleArk
    MichelleArk committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    8a1deac View commit details
    Browse the repository at this point in the history

  6. docstring

    @MichelleArk
    MichelleArk committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    f3dcac2 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk authored Apr 5, 2024
    Configuration menu
    Copy the full SHA
    ebee880 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Merge branch 'main' into batch-metadata-freshness

    @colin-rogers-dbt
    colin-rogers-dbt authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    02988c8 View commit details
    Browse the repository at this point in the history

  2. cleanup adapter_responses parsing in calculate_freshness_from_metadat… 

    …a_batch
    @MichelleArk
    MichelleArk committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    0bbf7ed View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk authored Apr 12, 2024
    Configuration menu
    Copy the full SHA
    a43f04c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into batch-metadata-freshness

    @MichelleArk
    MichelleArk authored Apr 12, 2024
    Configuration menu
    Copy the full SHA
    7cf501e View commit details
    Browse the repository at this point in the history