Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

implement 1s1t DATs for destination-bigquery #27852

Merged
merged 54 commits into from
Jul 13, 2023
Merged

implement 1s1t DATs for destination-bigquery #27852

merged 54 commits into from
Jul 13, 2023

Commits on Jul 3, 2023

  1. intiial implementation

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    448dd28 View commit details
    Browse the repository at this point in the history

  2. Automated Commit - Formatting Changes

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    639f77a View commit details
    Browse the repository at this point in the history

  3. add second sync to test

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    3653da4 View commit details
    Browse the repository at this point in the history

  4. do concurrent things

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    a4ba44a View commit details
    Browse the repository at this point in the history

  5. Automated Commit - Formatting Changes

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    8298bff View commit details
    Browse the repository at this point in the history

  6. clarify comment

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    24d0ca4 View commit details
    Browse the repository at this point in the history

  7. minor tweaks

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    d23ba3f View commit details
    Browse the repository at this point in the history

  8. more stuff

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    665fb3a View commit details
    Browse the repository at this point in the history

  9. Automated Commit - Formatting Changes

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    bd61d13 View commit details
    Browse the repository at this point in the history

  10. minor cleanup

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    9911b5b View commit details
    Browse the repository at this point in the history

  11. lots of fixes 

    * handle sql vs json null better
* verify extra columns
* only check deleted_at if in DEDUP mode and the column exists
* add full refresh append test case
    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    f06815e View commit details
    Browse the repository at this point in the history

  12. Automated Commit - Formatting Changes

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    d05365a View commit details
    Browse the repository at this point in the history

  13. add tests for the remaining sync modes

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    5588768 View commit details
    Browse the repository at this point in the history

  14. Automated Commit - Formatting Changes

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    80f8d90 View commit details
    Browse the repository at this point in the history

  15. readability stuff

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    73b9e90 View commit details
    Browse the repository at this point in the history

  16. Automated Commit - Formatting Changes

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    a40935b View commit details
    Browse the repository at this point in the history

  17. add test for gcs mode

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    7bb4b2c View commit details
    Browse the repository at this point in the history

  18. remove static fields

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    4da21d1 View commit details
    Browse the repository at this point in the history

  19. Automated Commit - Formatting Changes

    @octavia-approvington @edgao
    octavia-approvington authored and edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    a8fa7d4 View commit details
    Browse the repository at this point in the history

  20. add more test cases, tweak test scaffold

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    067ee0d View commit details
    Browse the repository at this point in the history

  21. cleanup

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    c008915 View commit details
    Browse the repository at this point in the history

  22. Automated Commit - Formatting Changes

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    1b376a2 View commit details
    Browse the repository at this point in the history

  23. extract recorddiffer

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    d86dd30 View commit details
    Browse the repository at this point in the history

  24. and use it in the sql generator test

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    9c136f7 View commit details
    Browse the repository at this point in the history

  25. fix

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    844bba6 View commit details
    Browse the repository at this point in the history

  26. comment

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    0f1e7ab View commit details
    Browse the repository at this point in the history

  27. naming+comment

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    dc5ab24 View commit details
    Browse the repository at this point in the history

  28. one more comment

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    a607793 View commit details
    Browse the repository at this point in the history

  29. better assert

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    84c387d View commit details
    Browse the repository at this point in the history

  30. remove unnecessary thing

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    ffa9df0 View commit details
    Browse the repository at this point in the history

  31. one last thing

    @edgao
    edgao committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    ffd3e3f View commit details
    Browse the repository at this point in the history

  32. Automated Commit - Formatting Changes

    @edgao @octavia-squidington-iii
    edgao authored and octavia-squidington-iii committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    3dbaa16 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. enable concurrent execution on all java integration tests

    @edgao
    edgao committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    97f8c19 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'edgao/1s1t_redeploy' into edgao/1s1t/dats

    @edgao
    edgao committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    0796dae View commit details
    Browse the repository at this point in the history

  3. Merge branch 'edgao/1s1t_redeploy' into edgao/1s1t/dats

    @edgao
    edgao authored Jul 5, 2023
    Configuration menu
    Copy the full SHA
    8bd8fd1 View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. add test for default namespace

    @edgao
    edgao committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    9934901 View commit details
    Browse the repository at this point in the history

  2. Automated Commit - Formatting Changes

    @edgao @octavia-squidington-iii
    edgao authored and octavia-squidington-iii committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    760f829 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2023

  1. implement a 2-stream test

    @edgao
    edgao committed Jul 7, 2023
    Configuration menu
    Copy the full SHA
    c82cadc View commit details
    Browse the repository at this point in the history

  2. Automated Commit - Formatting Changes

    @edgao @octavia-squidington-iii
    edgao authored and octavia-squidington-iii committed Jul 7, 2023
    Configuration menu
    Copy the full SHA
    0fdea84 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'edgao/1s1t_redeploy' into edgao/1s1t/dats

    @edgao
    edgao authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    984fb1f View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2023

  1. extract methods

    @edgao
    edgao committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    4442b06 View commit details
    Browse the repository at this point in the history

  2. invert jsonNodesNotEquivalent

    @edgao
    edgao committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    6d437da View commit details
    Browse the repository at this point in the history

  3. Automated Commit - Formatting Changes

    @edgao @octavia-squidington-iii
    edgao authored and octavia-squidington-iii committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    de3c2e9 View commit details
    Browse the repository at this point in the history

  4. fix conditional

    @edgao
    edgao committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    58e5d10 View commit details
    Browse the repository at this point in the history

  5. pull out diffSingleRecord

    @edgao
    edgao committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    6ef65b1 View commit details
    Browse the repository at this point in the history

  6. Automated Commit - Formatting Changes

    @edgao @octavia-squidington-iii
    edgao authored and octavia-squidington-iii committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    797b60f View commit details
    Browse the repository at this point in the history

  7. handle nulls correctly

    @edgao
    edgao committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    060d30f View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. remove raw-specific handling; break up methods

    @edgao
    edgao committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    7539094 View commit details
    Browse the repository at this point in the history

  2. Automated Commit - Formatting Changes

    @edgao @octavia-squidington-iii
    edgao authored and octavia-squidington-iii committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    144970b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'edgao/1s1t_redeploy' into edgao/1s1t/dats

    @edgao
    edgao committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    c751f7e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'edgao/1s1t_redeploy' into edgao/1s1t/dats

    @edgao
    edgao authored Jul 11, 2023
    Configuration menu
    Copy the full SHA
    d9fd22a View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2023

  1. Merge branch 'edgao/1s1t_redeploy' into edgao/1s1t/dats

    @edgao
    edgao authored Jul 12, 2023
    Configuration menu
    Copy the full SHA
    4efa242 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'edgao/1s1t_redeploy' into edgao/1s1t/dats

    @edgao
    edgao committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    9d3275a View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. Merge branch 'edgao/1s1t_redeploy' into edgao/1s1t/dats

    @edgao
    edgao committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    b32f17a View commit details
    Browse the repository at this point in the history