Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Infer min and max timestamps from entity_df to limit data read from BQ source #1665

Merged
merged 11 commits into from
Jul 8, 2021
Merged

Infer min and max timestamps from entity_df to limit data read from BQ source #1665

merged 11 commits into from
Jul 8, 2021

Commits on Jun 23, 2021

  1. filter data read by timestamp inferred from entity_df when querying B… 

    …Q source

Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jun 23, 2021
    Configuration menu
    Copy the full SHA
    008819a View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2021

  1. timestamps inferred in SQL query rather than from pandas df when quer… 

    …ying BQ source

Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jun 25, 2021
    Configuration menu
    Copy the full SHA
    57a9bcf View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2021

  1. timestamps inferred in separate SQL query to avoid recomputin, and ke… 

    …ep retrieval query simple

Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jul 2, 2021
    Configuration menu
    Copy the full SHA
    8d590a7 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2021

  1. Added an integration test for _get_entity_df_timestamp_bounds 

    Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jul 5, 2021
    Configuration menu
    Copy the full SHA
    1216506 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into infer-timestamp

    @Mwad22
    Mwad22 authored Jul 5, 2021
    Configuration menu
    Copy the full SHA
    bdcb2f8 View commit details
    Browse the repository at this point in the history

  3. Linted and reformatted after merge conflict 

    Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jul 5, 2021
    Configuration menu
    Copy the full SHA
    e8a361f View commit details
    Browse the repository at this point in the history

  4. removed redundant function upload_entity_df_into_bigquery from histor… 

    …ical retrieval test

Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jul 5, 2021
    Configuration menu
    Copy the full SHA
    80e5810 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2021

  1. Explicitly set retrieved timestamps to same timezone when testing min… 

    …/max timestamp inference

Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    12daf01 View commit details
    Browse the repository at this point in the history

  2. typo fix, comparing object references instead of values 

    Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jul 6, 2021
    Configuration menu
    Copy the full SHA
    2292e97 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2021

  1. Merge branch 'master' into infer-timestamp

    @Mwad22
    Mwad22 authored Jul 8, 2021
    Configuration menu
    Copy the full SHA
    f204603 View commit details
    Browse the repository at this point in the history

  2. fixed python linter issues, should be good to go 

    Signed-off-by: Mwad22 <51929507+Mwad22@users.noreply.github.com>
    @Mwad22
    Mwad22 committed Jul 8, 2021
    Configuration menu
    Copy the full SHA
    c3a77dc View commit details
    Browse the repository at this point in the history