Skip to content

Commit

Permalink
Optimize segmentwise recompression
Browse files Browse the repository at this point in the history
With the recent change to compression schema, we can optimize
segmentwise recompression and target only batches which are
affected to be recompressed or compress tuples which don't
belong to any batch without any decompression. This means
narrowing down the amount of that we need to decompress
and recompress, ultimately speeding up the operation and
generating less bloat in the compressed chunk.
  • Loading branch information
antekresic committed Dec 19, 2024
1 parent 9a85dd9 commit 44dd49e
Show file tree
Hide file tree
Showing 10 changed files with 794 additions and 589 deletions.
1 change: 1 addition & 0 deletions .unreleased/pr_7482
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Implements: #7482 Optimize recompression of partially compressed chunks
1 change: 1 addition & 0 deletions tsl/src/compression/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@ set(SOURCES
${CMAKE_CURRENT_SOURCE_DIR}/compression_scankey.c
${CMAKE_CURRENT_SOURCE_DIR}/compression_storage.c
${CMAKE_CURRENT_SOURCE_DIR}/create.c
${CMAKE_CURRENT_SOURCE_DIR}/recompress.c
${CMAKE_CURRENT_SOURCE_DIR}/segment_meta.c)
target_sources(${TSL_LIBRARY_NAME} PRIVATE ${SOURCES})

Expand Down
Loading

0 comments on commit 44dd49e

Please sign in to comment.