Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump rocksdb to version 8.6.7 #1794

Merged
merged 1 commit into from
Oct 7, 2023

Conversation

aleksraiden
Copy link
Contributor

A new release, Rocksdb 8.6.7. This is an bug-fix release. A full changelog - https://github.com/facebook/rocksdb/releases/tag/v8.6.7

Bug-fix

  • Fix bug with an error if user have a large number of levels
  • Add a fix for async_io where during seek, when reading a block for seeking a target key in a file without any readahead, the iterator aligned the read on a page boundary and reading more than necessary. This increased the storage read bandwidth usage
  • Fix a bug where iterator may return incorrect result for DeleteRange
  • Fix a bug where if there is an error reading from offset 0 of a file from L1+ and that the file is not the first file in the sorted run
  • Fixed a bug where rocksdb.file.read.verify.file.checksums.micros is not populated
  • Fix a bug with atomic_flush=true that can cause DB
  • Fix a bug where RocksDB (with atomic_flush=false) can delete output SST files of pending flushes when a previous concurrent flush fails
  • Fix bug with compressed secondary cache
  • Fixed a bug where compaction read under non direct IO still falls back to RocksDB internal prefetching

Behavior Changes

  • For Universal Compaction users, periodic compaction (option periodic_compaction_seconds) will be set to 30 days by default if block based table is used
  • Mark Options::access_hint_on_compaction_start related APIs as deprecated
  • Add a column family option default_temperature that is used for file reading accounting purpose, such as io statistics, for files that don't have an explicitly set temperature.

New

  • compaction_readahead_size 's default value is changed from 0 to 2MB.
  • Added enhanced data integrity checking on SST files
  • Add support to allow enabling / disabling user-defined timestamps feature for an existing column family in combination with the in-Memtable only feature.
  • Add a new compression option CompressionOptions::checksum for enabling ZSTD's checksum feature to detect corruption during decompression

Bump rocksdb to 8.6.7
@mapleFU
Copy link
Member

mapleFU commented Oct 6, 2023

Description below is incomplete:

Fix a bug with atomic_flush=true that can cause DB to stuck after a flush fails (https://github.com/facebook/rocksdb/pull/11872).

Rest LGTM

@aleksraiden
Copy link
Contributor Author

Description below is incomplete:

Fix a bug with atomic_flush=true that can cause DB to stuck after a flush fails (https://github.com/facebook/rocksdb/pull/11872).

Rest LGTM

You are right, my mistake, I try to shorter a desc for PR.

@mapleFU
Copy link
Member

mapleFU commented Oct 6, 2023

General looks good to me. I'm on the way, I'll review a round carefully when I get home tonight :-)

@mapleFU
Copy link
Member

mapleFU commented Oct 6, 2023

Statistics rocksdb.sst.read.micros now includes time spent on multi read and async read into the file

Since this can help our statistics if we use this. (But seems that this is unused)

Other changes in rocksdb changelog seems doesn't have any risks.

@aleksraiden
Copy link
Contributor Author

Statistics rocksdb.sst.read.micros now includes time spent on multi read and async read into the file

Since this can help our statistics if we use this. (But seems that this is unused)

In all latest release, as I see, a rocksdb team has an intensive work about extending stats and added a lot of new metrics.

@PragmaTwice PragmaTwice changed the title (Deps) Bump rocksdb to 8.6.7 Bump rocksdb to 8.6.7 Oct 7, 2023
@PragmaTwice PragmaTwice changed the title Bump rocksdb to 8.6.7 Bump rocksdb to version 8.6.7 Oct 7, 2023
@PragmaTwice PragmaTwice merged commit 42623c1 into apache:unstable Oct 7, 2023
27 checks passed
@aleksraiden aleksraiden deleted the rocksdb-8.6.7 branch February 13, 2024 17:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants