Tsurugi 1.0.0-BETA4 - Release Notes

[akirakw]

1.0.0-BETA4

Overview

1.0.0-BETA4 resolves some major issues found since 1.0.0-BETA3.

• Serializability violations are not detected in certain cases involving conflicts of three or more LTX transactions.
• Server crashes if session creation fails due to exceeding OS resource limits.
• Some components do not work correctly when an IPC connection is made by a user different from the database startup user.
• Incorrect race result between INSERT OR REPLACE transaction and DELETE transaction in certain conditions.
• An invalid CC_OCC_PHANTOM_AVOIDANCE error occurs and the transaction terminates abnormally under certain circumstances.
• Errors may occur in the binary operation results of DECIMAL types with many digits.
• The comparison logic of floating-point NaN is not consistent between join conditions and others.
• Some cast conversions that should be possible according to the specifications result in errors.
  • https://github.com/project-tsurugi/tsurugidb/blob/master/docs/sql-features.md#cast-conversions
• Dumping tables or SQL result containing negative DECIMAL values generates wrong result for the DECIMAL field.

In addition, performance improvements have been made for the following cases.

• Optimization to reduce waiting time in situations where commit waiting occurs due to conflicts of multiple LTX transactions.
• Reduction of conflict error frequency by adjusting the timing of conflict error detection during OCC and LTX conflicts.
• Improved performance when adding records with INSERT OR REPLACE to tables with secondary indexes.
• Improved to select an appropriate execution plan when performing range-scan on columns with secondary indexes.
• Changed the default settings of the optimization function (waiting-bypass) for the transaction engine.
  • Although it is not recommended for users to change this setting directly, if this change causes problems in some workloads, you can change the setting according to the following document.
  • https://github.com/project-tsurugi/shirakami/blob/master/docs/environment_variables.md

As an operation management function, the transaction log maintenance command tglogutil has been added.

• https://github.com/project-tsurugi/limestone/blob/master/docs/tglogutil_ja.md

In addition, the following documents related to troubleshooting have been added.

• Error Code of Tsurugi Services
• Tsurugi Troubleshooting Guide

Other minor stability and operational improvements are also included.

Upgrade Notes

For general upgrade procedures from old versions, please refer to the following document.

• Tsurugi Upgrade Guide

Changelog

Features

• add config. parameter external_log_explain to enable explained plan output (0478c37)
• enhance cast among numeric/string data types (e961f12)
• jogasaki: implement altimeter integration (25f9d53)
• jogasaki: implement assignment conversion among numeric types for INSERT/UPDATE (c424911)
• limestone: introduce dblogutil command for maintenance ope (595539d)
• ogawayama: add ability to return the number of rows processed by execute_statement() (95cb336)
• tateyama-bootstrap: implement mocks for tgctl session/dbstats command (51ccfd3)
• tateyama,jogasaki: add new function to cancel requests to service (da386fe)
• tateyama: add session store, etc. (5b355de)
• tateyama: implement altimeter audit log output for backup and restore (733216d)
• tateyama: implement altimeter audit log output for db start and stop (09d8c4b)
• tateyama: implement session service and resource (4c0588a)
• tgsql: CliArgument.getScript(): Added check invalid parameter (4e71081)
• tgsql: Added check unknwon parameter (5a3b1b9)
• tsubakuro: add tsubakuro.diagnostic option to activate sessionInfoMBean (64071d9)

Bug Fixes

• about tsurugi issue344 (af1213f)
• compiler: revise index selectivity. (3806fa4)
• for occ inserting logic (c33b1bc), closes project-tsurugi/tsurugi-issues#361
• for recheck about ts (c78a3fa)
• gc for wp result (216fbed)
• improve comparison around emplace back for node set (80342e1), closes project-tsurugi/tsurugi-issues#525
• improve gc stats (15622ce), closes project-tsurugi/tsurugi-issues#344
• improve library code / cmake option and add test (a1b8ff2)
• improve read wait. (fa7507d)
• jogasaki: avoid build error with Arrow versions newer than supported (bb86066)
• jogasaki: avoid server crash with create table when integer specified for decimal column (c188d7d)
• jogasaki: better encoding for float4/float8 negative zeros (a78b59b)
• jogasaki: casting float to character had wrong precision or digits (dfd5c90)
• jogasaki: casting to integer truncates instead of rounding to nearest (f32c9f4)
• jogasaki: correct comparison with float NaN values (9d0c8b2)
• jogasaki: correct dump target type for char columns (23a276c)
• jogasaki: correctly convert the default value of type different from column (dd30d07)
• jogasaki: DML error with unspecified counter type (e2fbe42)
• jogasaki: error handling when dumping Arrow files (7161d70)
• jogasaki: error message with unsupported batch request (5a3c3c3)
• jogasaki: fill "parameter" field for stmt_start event log (6763bed)
• jogasaki: fill values for 'parameter' and 'fetched' for stmt_end log event (1970e29)
• jogasaki: fix length calculation used for decimal data internal representation (8a81cf9)
• jogasaki: incorrect calculation with large decimal values (92123d8)
• jogasaki: missing error handling when creating table with no primary key (1d93498)
• jogasaki: try insert first when upserting table with secondary index (1e70c3a)
• log level and prefix about (9b4f975), closes project-tsurugi/tsurugi-issues#344
• not use inserting flag for border node at inserting another node into it (144d213), closes project-tsurugi/tsurugi-issues#672
• occ write lock about insert and tests (e06f8ba)
• ogawayama: fix handling of decimal colomn without scale in create table (07dff8c)
• ogawayama: revise decimal encoding from takatori::decimal::triple to ::jogasaki::proto::sql::common::Decimal (50c8928)
• ogawayama: use boost/multiprecision to decimal encoding (582058b)
• order of ltx cleanup and calling callback (6c7c946)
• remove check_commit from public api (8fab318)
• sharksfin,jogasaki: treat concurrently inserted entries as not_found (8c04760)
• sharksfin: avoid assert failure at any occasion (2ff0a5a)
• shirakami: fix about ltx insert (d055a38), closes project-tsurugi/tsurugi-issues#707
• shirakami: fix about shared tombstone count for (6f5758f), closes project-tsurugi/tsurugi-issues#707
• shirakami: fix bug and add test for (2b94eaa), closes project-tsurugi/tsurugi-issues#665
• shirakami: to track occ read info by range read at not found in yakushima (26753b6), closes project-tsurugi/tsurugi-issues#714
• shirakami: to track read info at stx point read by no hit (a407d11)
• tateyama-bootstrap: fix an issue in regard to tgctl start --tomeout 0 (079de35)
• tateyama-bootstrap: handle an error in altimeter initialization (e2d7da4)
• tateyama-bootstrap: make tgctl start to display message on timeout (48bd670)
• tateyama: a large number of ipc_endpoint.threads can be specified (b9d04b6)
• tateyama: improve not to cause a problem when many sockets are opened (a8c8961)
• tateyama: make the operations on responses_ in endpoint::worker_common thread-safe (10b8c25)
• tateyama: reduce idle CPU consumption by the stream listener (61ffae1)
• tsubakuro, tateyama-bootstrap: enable to check tsurugidb's life and death from all users including OTHER (4bbca10)
• tune and refactor (a4ab208)
• update shirakami, improve test, local write range and logging (fcc6836)

Performance Improvements

• shirakami: disabled waiting-bypass by default (abfa455)
• tateyama: Revert "reduce idle CPU consumption by the stream listener" (d411ebb)

Documentation

• modify "Planned features" of SQL features doc (82e9b45)
• tateyama: design of safely client session termination. (2d60365)

Distribution

• change permission to harinoki log directory with root install (f35b260)
• exclude javadoc task in publising mavenLocal (1c7169a)
• suppress unnecessary warnings and redundant output in installer (1149289)

Styles

• jogasaki: simplify include directives (f7a4fe3)
• jogasaki: update code style to avoid server crash with internal error (eeba244)
• jogasaki: update coding style related with recent fixes (22423e7)
• sharksfin: modify internal code style (9db83bc)

Miscellaneous Chores

• jogasaki: add code formatter sample (1c49f5b)
• jogasaki: prepare new config. for testing data types (452d4a9)
• jogasaki: update doc comments, testcases, etc. (38c6469)
• jogasaki: update docs/testcases for type conversion (5630c8a)

Code Refactoring

• improve occ node verify (385eb7c), closes project-tsurugi/tsurugi-issues#525
• ogawayama: fix clang-tidy warnings (885fff3)

Tests

• add test about tsurugi issue 672 (73fccb1)
• add test for (190d733), closes project-tsurugi/tsurugi-issues#249
• fix assertion for (b4c6701), closes project-tsurugi/tsurugi-issues#665
• refactor tests (1163eb6)

Build System

• change project version to 1.0.0 (1f9db46)
• change project version to 1.0.0 (561331c)
• compiler: fix CMake project versions. (535beec)
• compiler: remove SOVERSION from lib. (7482f32)
• jogasaki: correct member for public headers (d3a2e2b)
• jogasaki: reorganize include directive and remove unnecessary dependencies (b4dcdce)
• sharksfin: add missing include directive (d0be3b2)

Continuous Integration

• bump actions/checkout to v4 (31e387c)
• bump actions/checkout to v4 in submodules (8fd26c9)
• tuning test parallel tasks on CI workflows (a9e040b)

---

This discussion was created from the release 1.0.0-BETA4.