Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add RemoveCorruptedShardDataCommand #32281

Merged
merged 93 commits into from
Sep 19, 2018
Merged

add RemoveCorruptedShardDataCommand #32281

merged 93 commits into from
Sep 19, 2018

Commits on Jul 27, 2018

  1. drop index.shard.check_on_startup: fix 

    Relates elastic#31389
    Vladimir Dolzhenko committed Jul 27, 2018
    Configuration menu
    Copy the full SHA
    843f977 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2018

  1. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Jul 31, 2018
    Configuration menu
    Copy the full SHA
    4f01609 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2018

  1. add RemoveCorruptedSegmentsCommand; merge elasticsearch-translog and … 

    …elasticsearch-shard
    Vladimir Dolzhenko committed Aug 20, 2018
    Configuration menu
    Copy the full SHA
    a8f1488 View commit details
    Browse the repository at this point in the history

  2. fix test with ClusterAllocationExplanation

    Vladimir Dolzhenko committed Aug 20, 2018
    Configuration menu
    Copy the full SHA
    5f6b084 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2018

  1. fix test with ClusterAllocationExplanation

    Vladimir Dolzhenko committed Aug 21, 2018
    Configuration menu
    Copy the full SHA
    1fc72e9 View commit details
    Browse the repository at this point in the history

  2. create corrupted marker on check_on_startup: true; split testIndexC… 

    …heckChecksum into two tests: testIndexCheckOnStartup, testShardDoesNotStartIfCorruptedMarkerIsPresent; clean up
    Vladimir Dolzhenko committed Aug 21, 2018
    Configuration menu
    Copy the full SHA
    153e4f2 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Aug 21, 2018
    Configuration menu
    Copy the full SHA
    2964fef View commit details
    Browse the repository at this point in the history

  4. create manually corruption marker (but don't corrupt index files) to … 

    …check shard does not start if corruption marker is there; drop unnecessary new lines
    Vladimir Dolzhenko committed Aug 21, 2018
    Configuration menu
    Copy the full SHA
    c71e306 View commit details
    Browse the repository at this point in the history

  5. checkstyle fix

    Vladimir Dolzhenko committed Aug 21, 2018
    Configuration menu
    Copy the full SHA
    a7668d6 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2018

  1. merge into ResolveShardCorruptionCommand

    Vladimir Dolzhenko committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    6ee74a0 View commit details
    Browse the repository at this point in the history

  2. check is _state folder exist before reading state

    Vladimir Dolzhenko committed Aug 22, 2018
    Configuration menu
    Copy the full SHA
    ee955b0 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2018

  1. merge two commands into a single remove-corrupted-segments

    Vladimir Dolzhenko committed Aug 24, 2018
    Configuration menu
    Copy the full SHA
    918ce41 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Aug 24, 2018
    Configuration menu
    Copy the full SHA
    97fa399 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'remotes/origin/fix/31389_1' into fix/31… 

    …389_2
    Vladimir Dolzhenko committed Aug 24, 2018
    Configuration menu
    Copy the full SHA
    ebef6d2 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2018

  1. fixes after merge with remote-tracking branch 'remotes/origin/fix/313… 

    …89_1'
    Vladimir Dolzhenko committed Aug 25, 2018
    Configuration menu
    Copy the full SHA
    5cddefb View commit details
    Browse the repository at this point in the history

  2. move corruptIndex to CorruptionUtils

    Vladimir Dolzhenko committed Aug 25, 2018
    Configuration menu
    Copy the full SHA
    fd407bb View commit details
    Browse the repository at this point in the history

  3. reworked resolveShardPath

    Vladimir Dolzhenko committed Aug 25, 2018
    Configuration menu
    Copy the full SHA
    4bc9c95 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2018

  1. split testShardLock; testCorruptedBothIndexAndTranslog is added

    Vladimir Dolzhenko committed Aug 26, 2018
    Configuration menu
    Copy the full SHA
    b29aa9a View commit details
    Browse the repository at this point in the history

  2. simplified test

    Vladimir Dolzhenko committed Aug 26, 2018
    Configuration menu
    Copy the full SHA
    9ceeaf4 View commit details
    Browse the repository at this point in the history

  3. test code cleanup

    Vladimir Dolzhenko committed Aug 26, 2018
    Configuration menu
    Copy the full SHA
    addb03f View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2018

  1. test code cleanup

    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    0f29f0f View commit details
    Browse the repository at this point in the history

  2. checkstyle

    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    e6c6d70 View commit details
    Browse the repository at this point in the history

  3. addressed unit test comments

    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    c155b36 View commit details
    Browse the repository at this point in the history

  4. keep fix for 6.x branch

    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    85b7eef View commit details
    Browse the repository at this point in the history

  5. drop unused class

    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    7f292e3 View commit details
    Browse the repository at this point in the history

  6. remove-corrupted-data subcommand instead of remove-corrupted-segments

    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    43ae3a1 View commit details
    Browse the repository at this point in the history

  7. remove-corrupted-data subcommand instead of remove-corrupted-segments… 

    …; user has to manually change to `accept_data_loss: true`; doc clean up
    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    087d558 View commit details
    Browse the repository at this point in the history

  8. dropped index.shard.check_on_startup: fix - it has to go with anoth… 

    …er PR
    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    ad819ec View commit details
    Browse the repository at this point in the history

  9. amendment on a CLI tool name

    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    75fcafa View commit details
    Browse the repository at this point in the history

  10. a bit of clean up + show translog file names in sorted order instead … 

    …of full path in a random order
    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    cf6837f View commit details
    Browse the repository at this point in the history

  11. keep node lock on shard shamanizing; fix allocate empty primary; inst… 

    …ruction intentionally goes with `accept_data_lost: false`; text and comments improvements; read maxSeqNo with SequenceNumbers
    Vladimir Dolzhenko committed Aug 27, 2018
    Configuration menu
    Copy the full SHA
    260a5f4 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2018

  1. fix node lock scope

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    3de84e2 View commit details
    Browse the repository at this point in the history

  2. renamed to RemoveCorruptedShardDataCommand

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    073d29f View commit details
    Browse the repository at this point in the history

  3. added test for multi-node layout for a single env

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    03bbc5f View commit details
    Browse the repository at this point in the history

  4. added fix deprecation log message + test

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    3231803 View commit details
    Browse the repository at this point in the history

  5. dropped dry-run

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    64c29db View commit details
    Browse the repository at this point in the history

  6. keep elasticsearch-translog for 6.x

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    d1805d6 View commit details
    Browse the repository at this point in the history

  7. added fix deprecation log message + test

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    c2b5b8a View commit details
    Browse the repository at this point in the history

  8. adjusted fix deprecation log message

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    14e6175 View commit details
    Browse the repository at this point in the history

  9. dropped fix to avoid deprecation warnings

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    fee8a5b View commit details
    Browse the repository at this point in the history

  10. Merge remote-tracking branch 'remotes/origin/fix/31389_1' into fix/31… 

    …389_2
    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    e1808d6 View commit details
    Browse the repository at this point in the history

  11. set 755 to elasticsearch-shard, elasticsearch-translog

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    5b5d516 View commit details
    Browse the repository at this point in the history

  12. skip files added by Lucene's ExtrasFS

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    5cee2b9 View commit details
    Browse the repository at this point in the history

  13. skip files added by Lucene's ExtrasFS

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    b11670c View commit details
    Browse the repository at this point in the history

  14. skip files added by Lucene's ExtrasFS

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    e38238a View commit details
    Browse the repository at this point in the history

  15. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Aug 28, 2018
    Configuration menu
    Copy the full SHA
    ad62da0 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2018

  1. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Aug 29, 2018
    Configuration menu
    Copy the full SHA
    6f6ca5a View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Aug 29, 2018
    Configuration menu
    Copy the full SHA
    6763cf9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'fix/31389_1' into fix/31389_2

    Vladimir Dolzhenko committed Aug 29, 2018
    Configuration menu
    Copy the full SHA
    7f1f6f3 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2018

  1. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    5083e83 View commit details
    Browse the repository at this point in the history

  2. resolved conflicts on Merge remote-tracking branch 'remotes/origin/ma… 

    …ster' into fix/31389_1
    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    2a9dbeb View commit details
    Browse the repository at this point in the history

  3. Merge branch 'fix/31389_1' into fix/31389_2

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    d165a6c View commit details
    Browse the repository at this point in the history

  4. resolve conflict after Merge branch 'fix/31389_1' into fix/31389_2

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    f985de4 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    aa16487 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'remotes/origin/fix/31389_1' into fix/31… 

    …389_2
    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    f74c058 View commit details
    Browse the repository at this point in the history

  7. checkstyle

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    28c6a5a View commit details
    Browse the repository at this point in the history

  8. added comment on the reason to keep index lock

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    24bc3d4 View commit details
    Browse the repository at this point in the history

  9. dropped left-over

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    2d2dd2b View commit details
    Browse the repository at this point in the history

  10. addressed documentation review comments (links, clean up)

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    e196e9e View commit details
    Browse the repository at this point in the history

  11. removed misleading comments

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    4d89496 View commit details
    Browse the repository at this point in the history

  12. clean up; inlining of resolveShardPath; text adjustments

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    5bdb069 View commit details
    Browse the repository at this point in the history

  13. extracted lock logic from NodeEnvironment ctor into NodeLock; reused … 

    …it in RemoveCorruptedShardDataCommand
    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    5349c72 View commit details
    Browse the repository at this point in the history

  14. reworked resolve shard path

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    4286800 View commit details
    Browse the repository at this point in the history

  15. added Lucene.SOFT_DELETES_FIELD to IndexWriter

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    01be5af View commit details
    Browse the repository at this point in the history

  16. polish a bit NodeLock

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    af64fd4 View commit details
    Browse the repository at this point in the history

  17. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_1

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    d26fbfb View commit details
    Browse the repository at this point in the history

  18. Merge remote-tracking branch 'remotes/origin/fix/31389_1' into fix/31… 

    …389_2
    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    f8fd76a View commit details
    Browse the repository at this point in the history

  19. Merge branch 'remote/origin/master' into fix/31389_2

    Vladimir Dolzhenko committed Aug 31, 2018
    Configuration menu
    Copy the full SHA
    47fa3fa View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2018

  1. checkstyle

    Vladimir Dolzhenko committed Sep 1, 2018
    Configuration menu
    Copy the full SHA
    3a4916a View commit details
    Browse the repository at this point in the history

  2. dropped testCheckOnStartupDeprecatedValue due to wrong merge with master

    Vladimir Dolzhenko committed Sep 1, 2018
    Configuration menu
    Copy the full SHA
    9f3a7fb View commit details
    Browse the repository at this point in the history

  3. fix NodeEnvironment.NodeLock

    Vladimir Dolzhenko committed Sep 1, 2018
    Configuration menu
    Copy the full SHA
    abcff3c View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2018

  1. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_2

    Vladimir Dolzhenko committed Sep 4, 2018
    Configuration menu
    Copy the full SHA
    91dc295 View commit details
    Browse the repository at this point in the history

  2. improved message on delete marker

    Vladimir Dolzhenko committed Sep 4, 2018
    Configuration menu
    Copy the full SHA
    33f3a45 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2018

  1. minor test code style change

    Vladimir Dolzhenko committed Sep 5, 2018
    Configuration menu
    Copy the full SHA
    c796417 View commit details
    Browse the repository at this point in the history

  2. fix test

    Vladimir Dolzhenko committed Sep 5, 2018
    Configuration menu
    Copy the full SHA
    4181988 View commit details
    Browse the repository at this point in the history

  3. fix test

    Vladimir Dolzhenko committed Sep 5, 2018
    Configuration menu
    Copy the full SHA
    a1593e8 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2018

  1. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_2

    Vladimir Dolzhenko committed Sep 6, 2018
    Configuration menu
    Copy the full SHA
    185adc9 View commit details
    Browse the repository at this point in the history

  2. move shard-tool doc next to other docs

    Vladimir Dolzhenko committed Sep 6, 2018
    Configuration menu
    Copy the full SHA
    f5cf90a View commit details
    Browse the repository at this point in the history

  3. fix [float] Removing a corrupted data files header

    Vladimir Dolzhenko committed Sep 6, 2018
    Configuration menu
    Copy the full SHA
    8de0ae5 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2018

  1. Merge remote-tracking branch 'remotes/origin/master' into fix/31716_2

    Vladimir Dolzhenko committed Sep 10, 2018
    Configuration menu
    Copy the full SHA
    5b29ad0 View commit details
    Browse the repository at this point in the history

  2. after merge fixes

    Vladimir Dolzhenko committed Sep 10, 2018
    Configuration menu
    Copy the full SHA
    8242bbb View commit details
    Browse the repository at this point in the history

  3. Tweaks to docs

    @DaveCTurner
    DaveCTurner committed Sep 10, 2018
    Configuration menu
    Copy the full SHA
    418c922 View commit details
    Browse the repository at this point in the history

  4. dropped unrelated checkIndexOnStartup = fix setting

    Vladimir Dolzhenko committed Sep 10, 2018
    Configuration menu
    Copy the full SHA
    674d1ba View commit details
    Browse the repository at this point in the history

  5. nodeEnv code style clean up

    Vladimir Dolzhenko committed Sep 10, 2018
    Configuration menu
    Copy the full SHA
    53b404a View commit details
    Browse the repository at this point in the history

  6. do not expose node lock; code style adjustment; text comment adjustment

    Vladimir Dolzhenko committed Sep 10, 2018
    Configuration menu
    Copy the full SHA
    24ffdd1 View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_2

    Vladimir Dolzhenko committed Sep 10, 2018
    Configuration menu
    Copy the full SHA
    2a3f58d View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2018

  1. tiny doc amendment

    Vladimir Dolzhenko committed Sep 13, 2018
    Configuration menu
    Copy the full SHA
    e1eb32f View commit details
    Browse the repository at this point in the history

  2. NodeEnvironment.NodeLock can skip node path if it is required

    Vladimir Dolzhenko committed Sep 13, 2018
    Configuration menu
    Copy the full SHA
    ee1f6a2 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'remotes/origin/master' into fix/31389_2

    Vladimir Dolzhenko committed Sep 13, 2018
    Configuration menu
    Copy the full SHA
    1df4685 View commit details
    Browse the repository at this point in the history

  4. after merge fix

    Vladimir Dolzhenko committed Sep 13, 2018
    Configuration menu
    Copy the full SHA
    844adaf View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2018

  1. after merge fix

    Vladimir Dolzhenko committed Sep 14, 2018
    Configuration menu
    Copy the full SHA
    8210f3b View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2018

  1. inline nodeLock

    Vladimir Dolzhenko committed Sep 18, 2018
    Configuration menu
    Copy the full SHA
    dab5125 View commit details
    Browse the repository at this point in the history

  2. add javadoc comment for pathFunction

    Vladimir Dolzhenko committed Sep 18, 2018
    Configuration menu
    Copy the full SHA
    54c4030 View commit details
    Browse the repository at this point in the history