Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SO-4122: Implement index schema migrators #1250

Merged
merged 14 commits into from
Dec 12, 2023
Merged

SO-4122: Implement index schema migrators #1250

merged 14 commits into from
Dec 12, 2023

Commits on Dec 11, 2023

  1. fix(index): fix issues with index schema migration 

    - use proper mapping parameter for doCreateIndex()
- add more verbose logging for the whole migration process
- change the naming pattern of temporary index to
`<index>-migrate-to-v<version-number>`
- use small batch size when handling Commit documents
- log reindex results upon successful execution
- add more scenarios to automatically retry reindex operation if
Elasticsearch rejects the attempt due to too many requests
    @nagyo
    nagyo committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    fdde0eb View commit details
    Browse the repository at this point in the history

  2. fix(index): add schema migrator for Commit documents

    @nagyo
    nagyo committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    43b5283 View commit details
    Browse the repository at this point in the history

  3. fix(index): export index.migrate package

    @nagyo
    nagyo committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    f956eb8 View commit details
    Browse the repository at this point in the history

  4. fix(index): add schema migrator to RevisionBranch

    @nagyo
    nagyo committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    60f2da1 View commit details
    Browse the repository at this point in the history

  5. fix(index): add schema migrator to ValidationIssue

    @nagyo
    nagyo committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    03920c8 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. fix(index): pass in object mapper to DocumentMappingMigrator 

    - fall back to v1 for mappings where there is no _meta field present
- use the schema version for the temporary index
    @nagyo
    nagyo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    5031582 View commit details
    Browse the repository at this point in the history

  2. refactor(index): properly migrate revision documents by using... 

    ...the revision ID field value which ensures that we override the
existing document and not create a new one
    @cmark
    cmark committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    06c2244 View commit details
    Browse the repository at this point in the history

  3. fix(index): skip generating doc ids during schema migration

    @nagyo
    nagyo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    a9d0ae6 View commit details
    Browse the repository at this point in the history

  4. feat(resource): add schema migrator for resources-resource v9.0

    @nagyo
    nagyo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    167d379 View commit details
    Browse the repository at this point in the history

  5. feat(version): add resources-version schema migrator for v9.0

    @nagyo
    nagyo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    d87168e View commit details
    Browse the repository at this point in the history

  6. fix(resource): do not migrate dependencies for already existing values

    @nagyo
    nagyo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    0928599 View commit details
    Browse the repository at this point in the history

  7. fix(index): improve logging of the entire index initialization process

    @nagyo
    nagyo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    63b868b View commit details
    Browse the repository at this point in the history

  8. fix(index): use equals to detect duplicate mappings

    @cmark
    cmark committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    e9ee0c8 View commit details
    Browse the repository at this point in the history

  9. fix(index): always reset log indentation

    @nagyo
    nagyo committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    6a19449 View commit details
    Browse the repository at this point in the history