Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RFC: Improve saved object migrations #66056

Merged
merged 38 commits into from
Sep 29, 2020
+745 −0
Merged

RFC: Improve saved object migrations #66056

Changes from 27 commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
089e0b0
RFC: Improve saved object migrations
rudolf May 11, 2020
82280bc
Added rolling upgrades as alternative
rudolf May 12, 2020
39ec98c
Clarify advantage of re-using index for avoiding max shards open errors
rudolf May 15, 2020
148e80f
Add more detail about how dry run migrations and invalid document exp…
rudolf May 15, 2020
f88c4ba
Add separate section to highlight assumptions and tradeoffs
rudolf May 15, 2020
9fa0ee3
Apply nits from code review
rudolf May 19, 2020
cfd710b
Move 'Single node migrations coordinated through a lease/lock' under …
rudolf May 19, 2020
db021c4
Fix 5.2.2 document lock algorithm step 3.2
rudolf May 19, 2020
39b980e
Minor clarificiations
rudolf May 19, 2020
116db68
Minimizing data loss with mixed Kibana versions: move 7.x algorithm i…
rudolf May 19, 2020
821e0d1
Adds impact idempotent restrictions have on upcoming/requested migrat…
rudolf May 25, 2020
60a5949
nit: clarify 4.3.1.2.3
rudolf May 27, 2020
f28b066
Update 4.5.2: we need only one version-specific alias, not separate r…
rudolf May 28, 2020
94d2516
Add 4.0.4 the assumption that a saved object type will only ever be r…
rudolf May 28, 2020
c8551dd
Updates 4.3.1.2: Adds mappings compatibility check, adds soft deletes…
rudolf May 28, 2020
832e839
Merge branch 'rfc-saved-object-migrations' of https://github.com/rudo…
rudolf May 28, 2020
2480909
Don't try to minimize data loss for unsupported configurations, updat…
rudolf May 29, 2020
7cbe768
Flesh out upgrade and rollback procedure with gracefull shutdown
rudolf Jun 9, 2020
8727754
Merge branch 'master' into rfc-saved-object-migrations
rudolf Jun 12, 2020
e36ea17
New migration algorithm, upgrade procedure based on index cloning and…
rudolf Jun 17, 2020
7239124
Minor: clarify that index cloning algorithm solves (2.6) but (2.7) is…
rudolf Jun 17, 2020
8281e20
Merge branch 'master' into rfc-saved-object-migrations
rudolf Jun 23, 2020
e5992f4
Move 'Tag objects as invalid if their transformation fails' to the al…
rudolf Jun 23, 2020
823a51b
Don't migrate when there's orphan documents so that rollback is alway…
rudolf Jun 24, 2020
469eab3
Link to new Elasticsearch features required for the implementation
rudolf Jun 24, 2020
13c33f2
4.2.1.2 Clarify the purpose of the target index postfix
rudolf Jun 24, 2020
eb3f3ce
Add open questions around mappings growing over time. Fix rollback in…
rudolf Jun 26, 2020
1ce6759
Merge branch 'master' into rfc-saved-object-migrations
rudolf Jun 30, 2020
c576b01
minor: fix formatting
rudolf Jun 30, 2020
d02cebc
Merge branch 'master' into rfc-saved-object-migrations
rudolf Jul 19, 2020
a45ffd4
Update assumptions and tradeoffs to match latest algorithm
rudolf Jul 24, 2020
1863ee1
Review feedback
rudolf Sep 14, 2020
f35583a
Merge branch 'master' into rfc-saved-object-migrations
rudolf Sep 14, 2020
63db2d0
More alternatives for 4.2.1.4 Handling documents that belong to a dis…
rudolf Sep 15, 2020
7ab70fc
Merge branch 'master' into rfc-saved-object-migrations
rudolf Sep 21, 2020
81b1ead
Merge branch 'master' into rfc-saved-object-migrations
rudolf Sep 23, 2020
c4e6b32
Handle new ES cluster without any indices. Fix clone API parameters
rudolf Sep 23, 2020
8f10cf2
Update 4.2.1.2: transform outdated documents on every startup, only f…
rudolf Sep 24, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading