Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate doc ID in build index job for idempotency #1803

Merged
merged 5 commits into from
Jul 11, 2023

Commits on Jun 29, 2023

  1. Add doc id to DF by Spark built-in sha1 function

    Signed-off-by: Chen Dai <daichen@amazon.com>
    dai-chen committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    d358a39 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2023

  1. Add UT

    Signed-off-by: Chen Dai <daichen@amazon.com>
    dai-chen committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    692b9b7 View commit details
    Browse the repository at this point in the history
  2. Fix broken IT

    Signed-off-by: Chen Dai <daichen@amazon.com>
    dai-chen committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    0bbfe8f View commit details
    Browse the repository at this point in the history
  3. Change id column name to avoid conflict with user data

    Signed-off-by: Chen Dai <daichen@amazon.com>
    dai-chen committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    d7bff3e View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. Configuration menu
    Copy the full SHA
    adeed60 View commit details
    Browse the repository at this point in the history