Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adjust translog after versionType is removed in 7.0 #32020

Merged
merged 4 commits into from
Jul 17, 2018

Conversation

dnhatn
Copy link
Member

@dnhatn dnhatn commented Jul 13, 2018

With the presence of sequence number, we no longer use versionType to
resolve out of order collision and remove it in 7.0.

This PR adjusts translog to adapt that change.

Relates #31945

With the presence of sequence number, we no longer use versionType to
resolve out of order collision and remove it in 7.0.

This PR adjusts translog to adapt that change.

Relates elastic#31945
@dnhatn dnhatn added >enhancement :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. v6.4.0 labels Jul 13, 2018
@dnhatn dnhatn requested review from bleskes and ywelsch July 13, 2018 02:35
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed

Copy link
Contributor

@bleskes bleskes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Left one request

if (format <= FORMAT_SEQ_NO) {
this.versionType = VersionType.fromValue(in.readByte());
} else {
this.versionType = VersionType.EXTERNAL; // versionType is removed in 7.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if it's worth while to back port the format identifier here .. at very least add a comment and assert that we will never use the format id of 7.0 here if we end up changing the format in the 6.x life time.

@dnhatn
Copy link
Member Author

dnhatn commented Jul 17, 2018

@bleskes I've "backported" the format versions from 7.0. Can you please take another look?

@dnhatn dnhatn added the v6.3.1 label Jul 17, 2018
@dnhatn
Copy link
Member Author

dnhatn commented Jul 17, 2018

Thanks @bleskes

@dnhatn dnhatn merged commit 3c11b4e into elastic:6.x Jul 17, 2018
@dnhatn dnhatn deleted the relax-version-type6 branch July 17, 2018 20:01
dnhatn added a commit that referenced this pull request Jul 17, 2018
With the presence of sequence number, we no longer use versionType to
resolve out of order collision and remove it in 7.0.

This PR adjusts translog to adapt that change.

Relates #31945
dnhatn added a commit that referenced this pull request Jul 19, 2018
* 6.x:
  Fix rollup on date fields that don't support epoch_millis (#31890)
  Revert "Introduce a Hashing Processor (#31087)" (#32179)
  [test] use randomized runner in packaging tests (#32109)
  Painless: Fix caching bug and clean up addPainlessClass. (#32142)
  Fix BwC Tests looking for UUID Pre 6.4 (#32158) (#32169)
  Call setReferences() on custom referring tokenfilters in _analyze (#32157)
  Add more contexts to painless execute api (#30511)
  Add EC2 credential test for repository-s3 (#31918)
  Fix CP for namingConventions when gradle home has spaces (#31914)
  Convert Version to Java - clusterformation part1 (#32009)
  Fix Java 11 javadoc compile problem
  Improve docs for search preferences (#32098)
  Configurable password hashing algorithm/cost(#31234) (#32092)
  [DOCS] Update TLS on Docker for 6.3
  ESIndexLevelReplicationTestCase doesn't support replicated failures but it's good to know what they are
  Switch distribution to new style Requests (#30595)
  Build: Skip jar tests if jar disabled
  Build: Move shadow customizations into common code (#32014)
  Painless: Add PainlessClassBuilder (#32141)
  Fix accidental duplication of bwc test for script behavior
  Handle missing values in painless (#30975) (#31903)
  Build: Make additional test deps of check (#32015)
  Painless: Fix Bug with Duplicate PainlessClasses (#32110)
  Adjust translog after versionType removed in 7.0 (#32020)
  Disable C2 from using AVX-512 on JDK 10 (#32138)
  [Rollup] Add new capabilities endpoint for concrete rollup indices (#32111)
  Mute :qa:mixed-cluster indices.stats/10_index/Index - all’
  [ML] Wait for aliases in multi-node tests (#32086)
  Ensure to release translog snapshot in primary-replica resync (#32045)
  Docs: Fix missing example script quote (#32010)
  Add Index UUID to `/_stats` Response (#31871) (#32113)
  [ML] Move analyzer dependencies out of categorization config (#32123)
  [ML][DOCS] Add missing 6.3.0 release notes (#32099)
  Updates the build to gradle 4.9 (#32087)
  Update monitoring template version to 6040099 (#32088)
  Fix put mappings java API documentation (#31955)
  Add exclusion option to `keep_types` token filter (#32012)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. >enhancement v6.3.1 v6.4.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants