Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bugfix: memory leak when call list_qsort. #4315

Merged
merged 1 commit into from
May 11, 2022

Conversation

zhuizhuhaomeng
Copy link
Contributor

No description provided.

@zhuizhuhaomeng zhuizhuhaomeng requested a review from a team as a code owner May 10, 2022 09:29
@zhuizhuhaomeng zhuizhuhaomeng requested review from afiskon and duncan-tsdb and removed request for a team May 10, 2022 09:29
@CLAassistant
Copy link

CLAassistant commented May 10, 2022

CLA assistant check
All committers have signed the CLA.

@zhuizhuhaomeng zhuizhuhaomeng force-pushed the mem_leak branch 2 times, most recently from 18241ce to 4a1b97c Compare May 11, 2022 06:36
@zhuizhuhaomeng
Copy link
Contributor Author

@afiskon waiting for your approval to run ci.

@mkindahl mkindahl requested review from mkindahl and removed request for duncan-tsdb May 11, 2022 06:53
@codecov
Copy link

codecov bot commented May 11, 2022

Codecov Report

Merging #4315 (35e18ec) into main (bb241ff) will increase coverage by 0.01%.
The diff coverage is 92.23%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #4315      +/-   ##
==========================================
+ Coverage   90.68%   90.70%   +0.01%     
==========================================
  Files         215      216       +1     
  Lines       39704    39808     +104     
==========================================
+ Hits        36005    36107     +102     
- Misses       3699     3701       +2     
Impacted Files Coverage Δ
src/chunk.h 100.00% <ø> (ø)
tsl/src/continuous_aggs/create.c 88.58% <0.00%> (ø)
src/chunk.c 94.21% <86.53%> (+0.05%) ⬆️
tsl/src/nodes/decompress_chunk/planner.c 93.78% <93.75%> (-2.02%) ⬇️
src/planner.c 95.03% <94.44%> (-0.20%) ⬇️
src/bgw/scheduler.c 83.09% <100.00%> (+0.04%) ⬆️
src/nodes/chunk_insert_state.c 97.62% <100.00%> (+<0.01%) ⬆️
src/telemetry/stats.c 97.69% <100.00%> (+0.01%) ⬆️
src/telemetry/telemetry.c 82.70% <100.00%> (+0.06%) ⬆️
src/ts_catalog/continuous_agg.h 100.00% <100.00%> (ø)
... and 9 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c73c5a7...35e18ec. Read the comment docs.

Copy link
Contributor

@mkindahl mkindahl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhuizhuhaomeng Thank you for the commit!

@svenklemm svenklemm merged commit b32ccd0 into timescale:main May 11, 2022
@svenklemm
Copy link
Member

Thanks for your contribution

svenklemm added a commit to svenklemm/timescaledb that referenced this pull request May 23, 2022
This release adds major new features since the 2.6.1 release.
We deem it moderate priority for upgrading.

This release includes these noteworthy features:

* Optimize continuous aggregate query performance and storage
* The following query clauses and functions can now be used in a continuous
  aggregate: FILTER, DISTINCT, ORDER BY as well as [Ordered-Set Aggregate](https://www.postgresql.org/docs/current/functions-aggregate.html#FUNCTIONS-ORDEREDSET-TABLE)
  and [Hypothetical-Set Aggregate](https://www.postgresql.org/docs/current/functions-aggregate.html#FUNCTIONS-HYPOTHETICAL-TABLE)
* Optimize now() query planning time
* Improve COPY insert performance
* Improve performance of UPDATE/DELETE on PG14 by excluding chunks

This release also includes several bug fixes.

If you are upgrading from a previous version and were using compression
with a non-default collation on a segmentby-column you should recompress
those hypertables.

**Features**
* timescale#4045 Custom origin's support in CAGGs
* timescale#4120 Add logging for retention policy
* timescale#4158 Allow ANALYZE command on a data node directly
* timescale#4169 Add support for chunk exclusion on DELETE to PG14
* timescale#4209 Add support for chunk exclusion on UPDATE to PG14
* timescale#4269 Continuous Aggregates finals form
* timescale#4301 Add support for bulk inserts in COPY operator
* timescale#4311 Support non-superuser move chunk operations
* timescale#4330 Add GUC "bgw_launcher_poll_time"
* timescale#4340 Enable now() usage in plan-time chunk exclusion

**Bugfixes**
* timescale#3899 Fix segfault in Continuous Aggregates
* timescale#4225 Fix TRUNCATE error as non-owner on hypertable
* timescale#4236 Fix potential wrong order of results for compressed hypertable with a non-default collation
* timescale#4249 Fix option "timescaledb.create_group_indexes"
* timescale#4251 Fix INSERT into compressed chunks with dropped columns
* timescale#4255 Fix option "timescaledb.create_group_indexes"
* timescale#4259 Fix logic bug in extension update script
* timescale#4269 Fix bad Continuous Aggregate view definition reported in timescale#4233
* timescale#4289 Support moving compressed chunks between data nodes
* timescale#4300 Fix refresh window cap for cagg refresh policy
* timescale#4315 Fix memory leak in scheduler
* timescale#4323 Remove printouts from signal handlers
* timescale#4342 Fix move chunk cleanup logic
* timescale#4349 Fix crashes in functions using AlterTableInternal
* timescale#4358 Fix crash and other issues in telemetry reporter

**Thanks**
* @abrownsword for reporting a bug in the telemetry reporter and testing the fix
* @jsoref for fixing various misspellings in code, comments and documentation
* @yalon for reporting an error with ALTER TABLE RENAME on distributed hypertables
* @zhuizhuhaomeng for reporting and fixing a memory leak in our scheduler
@svenklemm svenklemm mentioned this pull request May 23, 2022
svenklemm added a commit that referenced this pull request May 23, 2022
This release adds major new features since the 2.6.1 release.
We deem it moderate priority for upgrading.

This release includes these noteworthy features:

* Optimize continuous aggregate query performance and storage
* The following query clauses and functions can now be used in a continuous
  aggregate: FILTER, DISTINCT, ORDER BY as well as [Ordered-Set Aggregate](https://www.postgresql.org/docs/current/functions-aggregate.html#FUNCTIONS-ORDEREDSET-TABLE)
  and [Hypothetical-Set Aggregate](https://www.postgresql.org/docs/current/functions-aggregate.html#FUNCTIONS-HYPOTHETICAL-TABLE)
* Optimize now() query planning time
* Improve COPY insert performance
* Improve performance of UPDATE/DELETE on PG14 by excluding chunks

This release also includes several bug fixes.

If you are upgrading from a previous version and were using compression
with a non-default collation on a segmentby-column you should recompress
those hypertables.

**Features**
* #4045 Custom origin's support in CAGGs
* #4120 Add logging for retention policy
* #4158 Allow ANALYZE command on a data node directly
* #4169 Add support for chunk exclusion on DELETE to PG14
* #4209 Add support for chunk exclusion on UPDATE to PG14
* #4269 Continuous Aggregates finals form
* #4301 Add support for bulk inserts in COPY operator
* #4311 Support non-superuser move chunk operations
* #4330 Add GUC "bgw_launcher_poll_time"
* #4340 Enable now() usage in plan-time chunk exclusion

**Bugfixes**
* #3899 Fix segfault in Continuous Aggregates
* #4225 Fix TRUNCATE error as non-owner on hypertable
* #4236 Fix potential wrong order of results for compressed hypertable with a non-default collation
* #4249 Fix option "timescaledb.create_group_indexes"
* #4251 Fix INSERT into compressed chunks with dropped columns
* #4255 Fix option "timescaledb.create_group_indexes"
* #4259 Fix logic bug in extension update script
* #4269 Fix bad Continuous Aggregate view definition reported in #4233
* #4289 Support moving compressed chunks between data nodes
* #4300 Fix refresh window cap for cagg refresh policy
* #4315 Fix memory leak in scheduler
* #4323 Remove printouts from signal handlers
* #4342 Fix move chunk cleanup logic
* #4349 Fix crashes in functions using AlterTableInternal
* #4358 Fix crash and other issues in telemetry reporter

**Thanks**
* @abrownsword for reporting a bug in the telemetry reporter and testing the fix
* @jsoref for fixing various misspellings in code, comments and documentation
* @yalon for reporting an error with ALTER TABLE RENAME on distributed hypertables
* @zhuizhuhaomeng for reporting and fixing a memory leak in our scheduler
mfundul pushed a commit to mfundul/timescaledb that referenced this pull request May 24, 2022
This release adds major new features since the 2.6.1 release.
We deem it moderate priority for upgrading.

This release includes these noteworthy features:

* Optimize continuous aggregate query performance and storage
* The following query clauses and functions can now be used in a continuous
  aggregate: FILTER, DISTINCT, ORDER BY as well as [Ordered-Set Aggregate](https://www.postgresql.org/docs/current/functions-aggregate.html#FUNCTIONS-ORDEREDSET-TABLE)
  and [Hypothetical-Set Aggregate](https://www.postgresql.org/docs/current/functions-aggregate.html#FUNCTIONS-HYPOTHETICAL-TABLE)
* Optimize now() query planning time
* Improve COPY insert performance
* Improve performance of UPDATE/DELETE on PG14 by excluding chunks

This release also includes several bug fixes.

If you are upgrading from a previous version and were using compression
with a non-default collation on a segmentby-column you should recompress
those hypertables.

**Features**
* timescale#4045 Custom origin's support in CAGGs
* timescale#4120 Add logging for retention policy
* timescale#4158 Allow ANALYZE command on a data node directly
* timescale#4169 Add support for chunk exclusion on DELETE to PG14
* timescale#4209 Add support for chunk exclusion on UPDATE to PG14
* timescale#4269 Continuous Aggregates finals form
* timescale#4301 Add support for bulk inserts in COPY operator
* timescale#4311 Support non-superuser move chunk operations
* timescale#4330 Add GUC "bgw_launcher_poll_time"
* timescale#4340 Enable now() usage in plan-time chunk exclusion

**Bugfixes**
* timescale#3899 Fix segfault in Continuous Aggregates
* timescale#4225 Fix TRUNCATE error as non-owner on hypertable
* timescale#4236 Fix potential wrong order of results for compressed hypertable with a non-default collation
* timescale#4249 Fix option "timescaledb.create_group_indexes"
* timescale#4251 Fix INSERT into compressed chunks with dropped columns
* timescale#4255 Fix option "timescaledb.create_group_indexes"
* timescale#4259 Fix logic bug in extension update script
* timescale#4269 Fix bad Continuous Aggregate view definition reported in timescale#4233
* timescale#4289 Support moving compressed chunks between data nodes
* timescale#4300 Fix refresh window cap for cagg refresh policy
* timescale#4315 Fix memory leak in scheduler
* timescale#4323 Remove printouts from signal handlers
* timescale#4342 Fix move chunk cleanup logic
* timescale#4349 Fix crashes in functions using AlterTableInternal
* timescale#4358 Fix crash and other issues in telemetry reporter

**Thanks**
* @abrownsword for reporting a bug in the telemetry reporter and testing the fix
* @jsoref for fixing various misspellings in code, comments and documentation
* @yalon for reporting an error with ALTER TABLE RENAME on distributed hypertables
* @zhuizhuhaomeng for reporting and fixing a memory leak in our scheduler
@mfundul mfundul mentioned this pull request May 24, 2022
mfundul pushed a commit that referenced this pull request May 24, 2022
This release adds major new features since the 2.6.1 release.
We deem it moderate priority for upgrading.

This release includes these noteworthy features:

* Optimize continuous aggregate query performance and storage
* The following query clauses and functions can now be used in a continuous
  aggregate: FILTER, DISTINCT, ORDER BY as well as [Ordered-Set Aggregate](https://www.postgresql.org/docs/current/functions-aggregate.html#FUNCTIONS-ORDEREDSET-TABLE)
  and [Hypothetical-Set Aggregate](https://www.postgresql.org/docs/current/functions-aggregate.html#FUNCTIONS-HYPOTHETICAL-TABLE)
* Optimize now() query planning time
* Improve COPY insert performance
* Improve performance of UPDATE/DELETE on PG14 by excluding chunks

This release also includes several bug fixes.

If you are upgrading from a previous version and were using compression
with a non-default collation on a segmentby-column you should recompress
those hypertables.

**Features**
* #4045 Custom origin's support in CAGGs
* #4120 Add logging for retention policy
* #4158 Allow ANALYZE command on a data node directly
* #4169 Add support for chunk exclusion on DELETE to PG14
* #4209 Add support for chunk exclusion on UPDATE to PG14
* #4269 Continuous Aggregates finals form
* #4301 Add support for bulk inserts in COPY operator
* #4311 Support non-superuser move chunk operations
* #4330 Add GUC "bgw_launcher_poll_time"
* #4340 Enable now() usage in plan-time chunk exclusion

**Bugfixes**
* #3899 Fix segfault in Continuous Aggregates
* #4225 Fix TRUNCATE error as non-owner on hypertable
* #4236 Fix potential wrong order of results for compressed hypertable with a non-default collation
* #4249 Fix option "timescaledb.create_group_indexes"
* #4251 Fix INSERT into compressed chunks with dropped columns
* #4255 Fix option "timescaledb.create_group_indexes"
* #4259 Fix logic bug in extension update script
* #4269 Fix bad Continuous Aggregate view definition reported in #4233
* #4289 Support moving compressed chunks between data nodes
* #4300 Fix refresh window cap for cagg refresh policy
* #4315 Fix memory leak in scheduler
* #4323 Remove printouts from signal handlers
* #4342 Fix move chunk cleanup logic
* #4349 Fix crashes in functions using AlterTableInternal
* #4358 Fix crash and other issues in telemetry reporter

**Thanks**
* @abrownsword for reporting a bug in the telemetry reporter and testing the fix
* @jsoref for fixing various misspellings in code, comments and documentation
* @yalon for reporting an error with ALTER TABLE RENAME on distributed hypertables
* @zhuizhuhaomeng for reporting and fixing a memory leak in our scheduler
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants