Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

query failed after add index #28424

Closed
aytrack opened this issue Sep 27, 2021 · 2 comments · Fixed by #29323
Closed

query failed after add index #28424

aytrack opened this issue Sep 27, 2021 · 2 comments · Fixed by #29323
Assignees
Labels
affects-5.2 This bug affects 5.2.x versions. affects-5.3 This bug affects 5.3.x versions. severity/minor sig/planner SIG: Planner type/bug The issue is confirmed as a bug.

Comments

@aytrack
Copy link
Contributor

aytrack commented Sep 27, 2021

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

set time_zone='UTC';
drop table if exists t02;
create table t02(a timestamp);
select * from t02 where a != "2038-1-19 3:14:45";
alter table t02 add unique index (a);
select * from t02 where a != "2038-1-19 3:14:45";

2. What did you expect to see? (Required)

query successfully after adding index.

3. What did you see instead (Required)

ySQL root@127.0.0.1:test> set time_zone='UTC';
                       ->  drop table if exists t02;
                       ->  create table t02(a timestamp);
                       ->  select * from t02 where a != "2038-1-19 3:14:45";
                       ->  alter table t02 add unique index (a);
                       ->  select * from t02 where a != "2038-1-19 3:14:45";
Query OK, 0 rows affected
Time: 0.002s

Query OK, 0 rows affected
Time: 0.012s

Query OK, 0 rows affected
Time: 0.006s

+---+
| a |
+---+

0 rows in set
Time: 0.014s

Query OK, 0 rows affected
Time: 2.546s
(1292, "Incorrect timestamp value: '2038-01-19 03:14:45.000000'")
MySQL root@127.0.0.1:test>

4. What is your TiDB version? (Required)

master (76267b2)
v5.2.1

@aytrack aytrack added type/bug The issue is confirmed as a bug. sig/sql-infra SIG: SQL Infra severity/major labels Sep 27, 2021
@bb7133
Copy link
Member

bb7133 commented Oct 31, 2021

It is about the sql_mode when building the plan for a 'out-of-ranged' date:

A simplified case to reproduce it:

set time_zone='UTC';
create table t02(a timestamp key);
select * from t02 where a != "2038-1-19 3:14:45";

And the error stack:


[2021/10/31 23:29:10.774 +08:00] [INFO] [conn.go:1053] ["command dispatched failed"] [conn=3] [connInfo="id:3, addr:127.0.0.1:45598 status:10, collation:utf8_general_ci, user:root"] [command=Query] [status="inTxn:0, autocommit:1"] [sql="select * from t02 where a != \"2038-1-19 3:14:45\""] [txn_mode=OPTIMISTIC] [err="[types:1292]Incorrect timestamp value: '2038-01-19 03:14:45.000000'
github.com/pingcap/errors.AddStack
	/home/bb7133/Projects/gopath/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20210425183316-da1aaba5fb63/errors.go:174
github.com/pingcap/errors.(*Error).GenWithStackByArgs
	/home/bb7133/Projects/gopath/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20210425183316-da1aaba5fb63/normalize.go:159
github.com/pingcap/tidb/types.(*Datum).convertToMysqlTimestamp
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/types/datum.go:1135
github.com/pingcap/tidb/types.(*Datum).ConvertTo
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/types/datum.go:844
github.com/pingcap/tidb/util/ranger.convertPoint
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/util/ranger/ranger.go:95
github.com/pingcap/tidb/util/ranger.points2Ranges
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/util/ranger/ranger.go:63
github.com/pingcap/tidb/util/ranger.(*rangeDetacher).buildCNFIndexRange
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/util/ranger/ranger.go:376
github.com/pingcap/tidb/util/ranger.(*rangeDetacher).detachCNFCondAndBuildRangeForIndex
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/util/ranger/detacher.go:367
github.com/pingcap/tidb/util/ranger.(*rangeDetacher).detachCondAndBuildRangeForCols
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/util/ranger/detacher.go:791
github.com/pingcap/tidb/util/ranger.DetachCondAndBuildRangeForIndex
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/util/ranger/detacher.go:756
github.com/pingcap/tidb/planner/core.(*DataSource).fillIndexPath
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/planner/core/logical_plans.go:871
github.com/pingcap/tidb/planner/core.(*DataSource).DeriveStats
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/planner/core/stats.go:399
github.com/pingcap/tidb/planner/core.(*baseLogicalPlan).recursiveDeriveStats
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/planner/core/stats.go:131
github.com/pingcap/tidb/planner/core.(*baseLogicalPlan).recursiveDeriveStats
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/planner/core/stats.go:124
github.com/pingcap/tidb/planner/core.physicalOptimize
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/planner/core/optimizer.go:289
github.com/pingcap/tidb/planner/core.DoOptimize
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/planner/core/optimizer.go:164
github.com/pingcap/tidb/planner.optimize
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/planner/optimize.go:386
github.com/pingcap/tidb/planner.Optimize
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/planner/optimize.go:218
github.com/pingcap/tidb/executor.(*Compiler).Compile
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/executor/compiler.go:66
github.com/pingcap/tidb/session.(*session).ExecuteStmt
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/session/session.go:1555
github.com/pingcap/tidb/server.(*TiDBContext).ExecuteStmt
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/server/driver_tidb.go:219
github.com/pingcap/tidb/server.(*clientConn).handleStmt
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/server/conn.go:1893
github.com/pingcap/tidb/server.(*clientConn).handleQuery
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/server/conn.go:1762
github.com/pingcap/tidb/server.(*clientConn).dispatch
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/server/conn.go:1274
github.com/pingcap/tidb/server.(*clientConn).Run
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/server/conn.go:1031
github.com/pingcap/tidb/server.(*Server).onConn
	/home/bb7133/Projects/gopath/src/github.com/pingcap/tidb/server/server.go:550
runtime.goexit
	/home/bb7133/Softwares/go/src/runtime/asm_amd64.s:1371"]

I think it is a corner case(very rared scenario for 'out-of-ranged' date condition and MySQL treat it as a warning instead of error:

mysql> select * from t02 where a != "2038-1-19 3:14:45";
Empty set, 1 warning (0.00 sec)

mysql> show warnings;
+---------+------+-----------------------------------------------------------------------+
| Level   | Code | Message                                                               |
+---------+------+-----------------------------------------------------------------------+
| Warning | 1292 | Incorrect datetime value: '2038-1-19 3:14:45' for column 'a' at row 1 |
+---------+------+-----------------------------------------------------------------------+
1 row in set (0.00 sec)

I would treat it as 'minor' compatibility bug and we need to update the planner to fix it.

@bb7133 bb7133 added severity/minor sig/planner SIG: Planner and removed sig/sql-infra SIG: SQL Infra severity/major labels Oct 31, 2021
mjonss added a commit to mjonss/tidb that referenced this issue Nov 1, 2021
Two issues, convertToMysqlTimestamp did set out-of-range timestamp to
Zero, when it would still be a storable/comparable KindMysqlTime.
(we only artificially limit the range of Timestamp to be compatible
with MySQL).

When this change was done,
it broke pingcap#26584 (insert of invalid timestamp succeeded),
which needed a different change in handleZeroDatetime
@github-actions
Copy link

Please check whether the issue should be labeled with 'affects-x.y' or 'fixes-x.y.z', and then remove 'needs-more-info' label.

fengou1 added a commit that referenced this issue Dec 20, 2021
* executor: fix error msg of granting non-table level privilege (#29321)

* server: fix bug https://asktug.com/t/topic/213082/11 (#29577)

* *: replace compareDatum by compare (#30048)

* executor, store: replace compareDatum by compare (#30044)

* executor: migrate test-infra to testify for executor/write_test.go (#29953)

* planner: add sub plan info of shuffleReceiver when query explain analyze (#27992)

* expression: fix wrong flen for CastAsString funtion (#29563)

* br: migrate test-infra to testify for redact (#29747)

* ddl: stable create expression index test (#29990)

* *: replace compareDatum by compare (#30060)

* planner: fix the issue that binding cannot work when sql_select_limit is enabled  (#29789)

* br : migrate test-infra to testify for lightning/backend/tidb/tidb_test.go (#30042)

* *: fix unstable test in placement gc cases (#30045)

* lightning: let ignore columns be compatible with tidb backend (#27850)

* statistics: replace compareDatum by compare (#30052)

* br/pkg/mock: migrate test-infra to testify (#30034)

* ddl: forbit alter table cache in system db (#29998)

* topsql: distinguish the row and index operation type (#29044)

* ddl, util/codec: fix add index OOM and prevent panic in logging (#29925)

* br/pkg/utils: migrate tests to testify (#30032)

* expression, sessionctx: support rand_seed1 and rand_seed2 sysvar (#29936)

* *: track the memory usage of IndexJoin more accurate (#29068)

* br : migrate test-infra to testify for lightning/backend/importer (#30073)

* planner: fix panic when the join key is scalarFunction (#30002)

* ddl: fix none info of `alter table placement` (#29929)

* expression: cast charset according to the function's resulting charset (#29905)

* *: replace compareDatum by compare and fix compare (#30090)

* store/driver: Use BatchGet method supported in client-go. (#29860)

* privilege: disable role privilege when it is revoked from an user (#30028)

* partition: Show partition reformat (#29945)

* planner: fix the unstable test `TestPartitionWithVariedDatasources` (#30139)

* server: Add a `MockConn` to enable testing connections (#30119)

* *: skip unstable test (#29433)

* skip test

Signed-off-by: yisaer <disxiaofei@163.com>

* skip unstable test

Signed-off-by: yisaer <disxiaofei@163.com>

* table/tables: add `StateRemote` interface for the cached table (#29152)

* planner: rebuild range when the range is empty (#30003)

* planner: support dump file for trace plan statement (#30059)

* planner: make clear for MaybeOverOptimized4PlanCache (#29782)

* update: fix the updatable table name resolution in build update list (#30061)

* expression : prevent function DATE_ADD/SUB_STRING_XXX pushed down to TiFlash (#30154)

* *: remove unused profile memory tracker from global tracker (#30143)

* expression, util/codec: fix wrongly eliminated conditions caused by `HashCode()` collision (#30120)

* cmd, expression: fix convert binary string to gbk (#30004)

* sessionctx/variable: make lc_time_names read only (#30084)

* expression: fix misuse of datumsToConstants in GBK test (#30072)

* plugin: add more tests to cover audit logs (#30165)

* planner: consider prefix index column length in skyline pruning (#27527)

* server: support download optimize trace file (#30150)

* expression: add ut config (#30156)

* ddl/ddl_test.go: refactor testTableInfo to return error (#30069)

* *: skip a case in TestClusterTables/ForClusterServerInfo on mac M1 (#29933)

* planner: do not add extra limit when handle the execute stmt (#30152)

* ddl: migrate test-infra to testify for db_cache_test.go (#30117)

* tables: fix data race in mockStatRemoteData (#30180)

* server: Port missing in processlist (#30183)

* server: add build not race flag (#30184)

* unistore: get/batchGet/scan support read-through-lock (#29898)

* topsql: fix nil pointer panic in stmtctx (#30181)

* types: fix wrong str_to_date() microseconds with leading zeros are not converted correctly (#30122)

* dumpling: Add support for `Create Placement` (#29724)

* *: add cardinality estimation trace for `Selectivity` (#29883)

* *: replace compareDatum by compare and ignore warnings is collate is empty (#30105)

* planner: implement aggregation eliminate optimize trace (#30114)

* server: Combined fix for authentication issues (#29738)

* executer: fix data race (#30186)

* dumpling : add a function for the variable call of dm (#30033)

* planner: revise optimize trace logic (#30163)

* statistics: fix unstable test case TestTraceCE (#30235)

* lightning: avoid retry write rows and record duplicate rows in tidb backend (#30179)

* executor: send a task with error to the resultCh when panic happen (#30214)

* docs: update placement policy limits (#30202)

* expression: Support GBK for builtin function AesEncrypt. (#29946)

* executor: remove useless log (#30248)

* docs: Update 2021-09-29-secure-bootstrap.md (#30243)

* executor: fix unstable test of topsql (#30257)

* copr: add paging API for streaming-like process (#29612)

* *: forbid set TiFlash Replica for a table with unsupport charset (#30162)

* privilege, session, server: consistently map user login to identity (#30204)

* expression: fix flen for timestamp_add (#30213)

* types: check values equals to NaN or Inf when convert to float (#30148)

* parser: respect TiDB comment when DROP INDEX IF EXISTS (#30173)

* ddl: disallow change columns from zero int to time (#25728)

* * : statement summary should know the slow write is blocked on read lock lease (#30166)

* planner: regard NULL as point when accessing composite index (#30244)

* planner: Add trace for proj elimination rule (#30275)

* privilege,session: Match loopback connections to 'localhost' accounts (#29995) (#30189)

* ddltest: refactor logutil.InitLogger in ddltest to avoid data race (#30299)

* load data: fix bug if load data with long content (#29222)

* topsql: reduce data race of sql digest (#30296)

* ddl: Do not consider the clustered index when checking the length of the secondary index (#29660)

* *: update client-go to use resolveForRead (#30314)

* ddl/ddl_algorithm_test.go: migrate test-infra to testify (#30268)

* store: Add metrics for pd api call time (#30062)

* *: replace compareDatum by compare and fix wrong optimize order by (#30273)

* metrics/grafana: fix display for 'Start TSO Wait Duration' panel (#30311)

* ddl: migrate test-infra to testify for ddl/options_test.go (#30269)

* planner: fix inconsistent schema between UnionAll and child operator (#30231)

* test: fix incorrect regexp pattern during migrating test (#30080)

* br: add more precise check for lock file (#30218)

* executor: replace should not change other rows when auto ID is out of range (#30301)

* tidb-server: return 1 while failing to set cpu affinity (#30197)

* executor: migrate test-infra to testify for executor/index_lookup_join_test.go (#30260)

* expression: fix wrong result of greatest/least(mixed unsigned/signed int) (#30121)

* types: casting JSON literal `null` to number types should fail (#30278)

* executor: fix data race in oomtest (#30339)

* parser: fix missing charset and collation of handle column (#30320)

* expression: don't append null when param for char() is null (#30236)

* *: add warn log for stale read (#30340)

* parser:  support multi bracket for subquery (#29656)

* session, sessionctx/variable: fix validation recursion bug (#30293)

* planner: Add trace for agg pushdown rule (#30262)

* planner/core: fix a data race when building plan for cached table (#30355)

* executor: avoid sum from avg overflow (#30010)

* config: make EnableSlowLog atomic (#30346)

* *: fix goroutine leak in ddl intergration test (#30369)

* executor: make projection executor unparallel for insert/update/delete (#30290)

* executor, util: reset offsets and nullBitMap for MutRow when setting new values (#30265)

* expression: fix tidb can't alter table from other-type with null value to timestamp with NOT NULL attribute (#29664)

* dumpling: fix default collation with upstream when dump database and table (#30292)

* ddl: fix the enum default value by triming trailing space (#30356)

* expression: migrate test-infra to testify for flag_simplify_test.go (#30407)

* server: refine code logic in handleDownloadFile (#30422)

* refine logic

Signed-off-by: yisaer <disxiaofei@163.com>

* fix

Signed-off-by: yisaer <disxiaofei@163.com>

* ddl: migrate test-infra to testify for ddl/table_test.go (#30267)

* ddl: handle the error from `addBatchDDLJobs()` correctly (#30401)

* br: fix the integration tests (#30423)

* util, cmd: remove unused filesort (#30438)

* *: update client-go for small backoff time (#30436)

* server: Fix unstable tests with FakeAuthSwitch (#30287)

* dumpling: fix dump failed when sequence exists (#30164)

* *: replace compareDatum by compare (#30421)

* lightning: fix gcs max key limit (#30393)

* expression, parser: add built-in func is_uuid (#30318)

* expression: migrate test-infra to testify for constant_fold_test.go (#30424)

* executor: fix pipelined window invalid memory address (#30418)

* makefile: add gotestsum for verify ci (#29848)

* server: close sql rows to fix unstable test (#30306)

* Makefile: add coverage record for BR and Dumpling (#30457)

* executor: track the mem usage of IndexMergeReader (#30210)

* infosync: close body when ReadAll encounters error (#30462)

* planner: show accessed partition when explain mpp query over partition table (#30367)

* *: Fix use of user identity in SHOW GRANTS + error messages (#30294)

* ddl: add not null flag for auto_increment column  (#30477)

* expression: make some unstable test serial (#30323)

* expression: migrate test-infra to testify for constant_propagation_test.go (#30430)

* executor: stable test TestSetDDLReorgBatchSize and TestSetDDLReorgWorkerCnt (#30480)

* statistics, util/ranger: add cardinality estimation trace for `GetRowCountBy...` (#30321)

* *: skip mysql client goroutine leak detection in integration ddl (#30467)

* executor,util: write slow query to slow log no matter what log level (#30461)

* executor: enable index_merge used in transaction. (#29875)

* logutil: add testcase for SlowQueryLogger.MaxDays/MaxSize/MaxBackups (#30316)

* expression: fix data race in builtin_other_vec_generated_test.go (#30503)

* expression: fix data race in the collationInfo (#30490)

* planner/core, session: fix error message of wrong variable scope (#30510)

* lightning: support Re/ReregisterMySQL by different tls name (#30463)

* executor: TestBatchGetandPointGetwithHashPartition test typo (#29669) (#29671)

* mockstore: improve log to avoid panic for nil pointer (#30513)

* *: replace compareDatum by compare, PR 10 (#30456)

* planner: Disable dynamic partition prune mode for all non-autocommit (#27532) (#30505)

* expression: change the log level of an confusing log from warn to debug (#30484)

* br: Check crypter.key valid before backup (#29991)

* *: replace compareDatum by compare, PR 11 (#30465)

* dumpling: fix default column collation with upstream when dump table (#30531)

* server: fix prepared cursor select (#30285)

* executor: HashJoinExec checks the buildError even if the probeSide is empty (#30471)

* parser, expression: follow mysql, increase interval precedence (#30528)

* makefile: set timeout 25m for make race (#30555)

* planner: fix the unstable test TestAnalyzeGlobalStatsWithOpts/2 (#30576)

* expression,types: Adjusts UNIX_TIMESTAMP() for non-existing DST values (#28739) (#30405)

* br: add res.Body.close to avoid leak (#30545)

* lightning: add back integration test lightning_error_summary (#30547)

* sessionctx/variable: small refactor (split large file) (#30511)

* ddl: let `admin cancel ddl jobs` run in a new transaction (#30549)

* *: Retry when placement PutBundles failed (#30590)

* dumpling: delete unit test in github actions (#30562)

* *: support trace plan target='estimation' statement (#30491)

* expression: migrate test-infra to testify for integration_test.go (#30548)

* planner: support trace for min/max eliminate (#30441)

* support min/max trace

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>

* br: remove cdclog in br (#30573)

* *: show cmd to check if all needed histograms are loaded (#29672)

* expression: clone repertoire when clone the scalar function (#30602)

* *: use the real StateRemote interface implementation for cached table (#30066)

* *: query failed after add index / timestamp out-of-range (#28424) (#29323)

* planner: implement collecting predicate columns from logical plan (#29878)

* *: show PK name when decoding the clustered index row key (#30623)

* ddl/callback_test.go: migrate test-infra to testify (#30317)

* *: Rename some names of placement ddl operation (#30622)

* executor: fix data race in the index_lookup_hash_join (#30619)

* ddl: remove unnecessary locking when adding an index (#29772)

* server: try to make `TidbTestSuite` more stable (#30643)

* *: Add some PD tests for placement and fix some bug found (#30621)

* *: migrate sync.WaitGroup to util.WaitGroupWrapper (#30644)

* planner: add trace for join eliminate rule (#30343)

* executor: migrate test-infra to testify for executor/shuffle_test.go (#30514)

* planner: make (*AccessPath).OnlyPointRange more succinct (#30520)

* planner: add trace for join reorder (#30394)

* executor: migrate test-infra to testify for executor/union_scan_test.go (#30525)

* expression: make cast return error if cast binary literal to another character set (#30537)

* *: update tikv client (#30670)

* *: update sysutil in go.mod to fix panic when search log (#30523)

* topsql: shouldn't evict the SQL meta, since the evicted SQL can be appear on Other components (TiKV) TopN records (#27050)

* testify: migrate test-infra to testify for analyze_test.go (#30640)

* util: replace compareDatum by compare,  point part (#30575)

* test: make all the tests run in serial (#30692)

* statistics: add mutex for Handle.globalMap and Handle.feedback (#30550)

* executor: fix regular expression in json so that it could match identifer start with '$' (#29750)

* util/testkit/testkit.go: fix typo (#30638)

* planner: Introduce a new global variable to control the historical statistics feature (#30646)

* topsql: introduce datasink interface (#30662)

* planner: unify the argument of stats functions to use SessionCtx instead of StatementContext (#30668)

* metrics: fix the Max SafeTS Gap metrics (#30689)

* lightning: Add source dir existence check for s3 (#30674)

* golangci-lint: support durationcheck (#30027)

* executor: fix data race on IndexHashJoin.cancelFunc (#30701)

* sessionctx/variable: change tidb_store_limit to global only (#30522)

* statistics: remove reassignment of Handle.pool in NewHandle (#30675)

* br: fix some unstable unit test cases. (#30716)

* bindinfo: fix the comment typo (#30616)

* server: support decoding prepared string args to character_set_client (#30723)

* expression: fix enum type join binary get wrong result (#30445)

* cmd/explaintest: fix wrong result comparison for explain test (#30717)

* parallel create tables in br

* metrics: fix copr-cache metrics (#30712)

* test: merge executor's serial tests to other tests (#30711)

* statistics: avoid deadlock when create/drop extended stats and analyze at the same time (#30566)

* ddl: add batch create table api

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: add unit tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: typo

Co-authored-by: Arenatlx <ailinsilence4@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: rename to BatchCreateTableWithInfo

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: trace the error

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: comments

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancle the job right

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancel the job right 2

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error if entry too large

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error when table is duplicated

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: go fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* infoschema: improve batch memory perf

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: retain ID

Signed-off-by: xhe <xw897002528@gmail.com>

* sessionctx: fix the value of analyze_version when upgrading 4.x to 5.… (#30743)

* ddl: reduce log frequency

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* server: disable socket listener for `basicHTTPHandlerTestSuite` (#30680)

* planner: support the plan cache aware of bindings (#30169)

* planner: fix early set of plan's statisticsTable (#30754)

* *: implement renew write lock lease for cached table (#30206)

* *: Modify placement rule index to reserve some indexes for future work (#30737)

* executor: add an unit test case for unreasonable invoking Close (#30696)

* planner: fix wrong subquery's coercibility  (#30750)

Co-authored-by: unconsolable <chenzhipeng2012@gmail.com>
Co-authored-by: zhangguangchao <1614439+zgcbj@users.noreply.github.com>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
Co-authored-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: mmyj <mayj.hello@gmail.com>
Co-authored-by: Shenghui Wu <793703860@qq.com>
Co-authored-by: tison <wander4096@gmail.com>
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
Co-authored-by: xiaolunzhou <51695571+JayL-zxl@users.noreply.github.com>
Co-authored-by: 王超 <cclcwangchao@hotmail.com>
Co-authored-by: glorv <glorvs@163.com>
Co-authored-by: sylzd <liuzidong@xiaomi.com>
Co-authored-by: Yexiang Zhang <mornyx.z@gmail.com>
Co-authored-by: tangenta <tangenta@126.com>
Co-authored-by: Yujie Xia <xiayjchn@gmail.com>
Co-authored-by: Hangjie Mo <mohangjie1995@gmail.com>
Co-authored-by: HuaiyuXu <391585975@qq.com>
Co-authored-by: Song Gao <disxiaofei@163.com>
Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: WangDeng <DWang_Slam@163.com>
Co-authored-by: Mattias Jonsson <mjonss@users.noreply.github.com>
Co-authored-by: djshow832 <zhangming@pingcap.com>
Co-authored-by: tiancaiamao <tiancaiamao@gmail.com>
Co-authored-by: Chengpeng Yan <41809508+Reminiscent@users.noreply.github.com>
Co-authored-by: Arenatlx <314806019@qq.com>
Co-authored-by: Meng Xin <tregoldmeng@gmail.com>
Co-authored-by: Zhou Kunqin <25057648+time-and-fate@users.noreply.github.com>
Co-authored-by: Youra Cho <espresso98@users.noreply.github.com>
Co-authored-by: Yifan Xu <30385241+xuyifangreeneyes@users.noreply.github.com>
Co-authored-by: José Clovis Ramírez de la Rosa <clovis-@live.com>
Co-authored-by: Xiang Zhang <angwerzx@126.com>
Co-authored-by: Lei Zhao <zlwgx1023@gmail.com>
Co-authored-by: Daniël van Eeden <git@myname.nl>
Co-authored-by: docsir <73268456+docsir@users.noreply.github.com>
Co-authored-by: Morgan Tocker <tocker@gmail.com>
Co-authored-by: jakevin <30525741+jackwener@users.noreply.github.com>
Co-authored-by: 姬小野 <38575466+JameyWoo@users.noreply.github.com>
Co-authored-by: you06 <you1474600@gmail.com>
Co-authored-by: lance6716 <lance6716@gmail.com>
Co-authored-by: TonsnakeLin <87681388+TonsnakeLin@users.noreply.github.com>
Co-authored-by: imentu <imentu@foxmail.com>
Co-authored-by: Alkaid <38248129+jyz0309@users.noreply.github.com>
Co-authored-by: lvtu <37565148+tongtongyin@users.noreply.github.com>
Co-authored-by: 3pointer <luancheng@pingcap.com>
Co-authored-by: Zhuhe Fang <fzhedu@gmail.com>
Co-authored-by: WizardXiao <89761062+WizardXiao@users.noreply.github.com>
Co-authored-by: Jianjun Liao <36503113+Leavrth@users.noreply.github.com>
Co-authored-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Ryan Leung <rleungx@gmail.com>
Co-authored-by: xufei <xufei@pingcap.com>
Co-authored-by: Ehco <zh19960202@gmail.com>
Co-authored-by: Zak Zhao <57036248+joccau@users.noreply.github.com>
Co-authored-by: xhe <xw897002528@gmail.com>
Co-authored-by: Chunzhu Li <lichunzhu@stu.xjtu.edu.cn>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: Xiaoju Wu <wuxiaoju@pingcap.com>
Co-authored-by: JmPotato <ghzpotato@gmail.com>
Co-authored-by: Zach <51114270+zach030@users.noreply.github.com>
Co-authored-by: bb7133 <bb7133@gmail.com>
Co-authored-by: crazycs <crazycs520@gmail.com>
Co-authored-by: znhh6018 <44599853+znhh6018@users.noreply.github.com>
Co-authored-by: eddie lin <eddievim@foxmail.com>
Co-authored-by: dongjunduo <andj4cn@gmail.com>
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com>
Co-authored-by: wangggong <793160615@qq.com>
Co-authored-by: zhangjinpeng1987 <zhangjinpeng@pingcap.com>
Co-authored-by: Jack Yu <yusp@pingcap.com>
Co-authored-by: Arenatlx <ailinsilence4@gmail.com>
Co-authored-by: Yiding Cui <winoros@gmail.com>
@time-and-fate time-and-fate added affects-5.2 This bug affects 5.2.x versions. affects-5.3 This bug affects 5.3.x versions. and removed needs-more-info labels Dec 22, 2021
fengou1 added a commit that referenced this issue Dec 26, 2021
* executor: migrate test-infra to testify for executor/show_stats_test.go (#30000)

* ddl/table_split_test.go: migrate test-infra to testify (#29960)

* *: fix unstable test caused by TestRandomPanicAggConsume (#30035)

* ddl/ddl_test.go: refactor testSchemaInfo to return error #29964 (#30008)

* executor: remove useless parameter (#30043)

* executor: fix error msg of granting non-table level privilege (#29321)

* server: fix bug https://asktug.com/t/topic/213082/11 (#29577)

* *: replace compareDatum by compare (#30048)

* executor, store: replace compareDatum by compare (#30044)

* executor: migrate test-infra to testify for executor/write_test.go (#29953)

* planner: add sub plan info of shuffleReceiver when query explain analyze (#27992)

* expression: fix wrong flen for CastAsString funtion (#29563)

* br: migrate test-infra to testify for redact (#29747)

* ddl: stable create expression index test (#29990)

* *: replace compareDatum by compare (#30060)

* planner: fix the issue that binding cannot work when sql_select_limit is enabled  (#29789)

* br : migrate test-infra to testify for lightning/backend/tidb/tidb_test.go (#30042)

* *: fix unstable test in placement gc cases (#30045)

* lightning: let ignore columns be compatible with tidb backend (#27850)

* statistics: replace compareDatum by compare (#30052)

* br/pkg/mock: migrate test-infra to testify (#30034)

* ddl: forbit alter table cache in system db (#29998)

* topsql: distinguish the row and index operation type (#29044)

* ddl, util/codec: fix add index OOM and prevent panic in logging (#29925)

* br/pkg/utils: migrate tests to testify (#30032)

* expression, sessionctx: support rand_seed1 and rand_seed2 sysvar (#29936)

* *: track the memory usage of IndexJoin more accurate (#29068)

* br : migrate test-infra to testify for lightning/backend/importer (#30073)

* planner: fix panic when the join key is scalarFunction (#30002)

* ddl: fix none info of `alter table placement` (#29929)

* expression: cast charset according to the function's resulting charset (#29905)

* *: replace compareDatum by compare and fix compare (#30090)

* store/driver: Use BatchGet method supported in client-go. (#29860)

* privilege: disable role privilege when it is revoked from an user (#30028)

* partition: Show partition reformat (#29945)

* planner: fix the unstable test `TestPartitionWithVariedDatasources` (#30139)

* server: Add a `MockConn` to enable testing connections (#30119)

* *: skip unstable test (#29433)

* skip test

Signed-off-by: yisaer <disxiaofei@163.com>

* skip unstable test

Signed-off-by: yisaer <disxiaofei@163.com>

* table/tables: add `StateRemote` interface for the cached table (#29152)

* planner: rebuild range when the range is empty (#30003)

* planner: support dump file for trace plan statement (#30059)

* planner: make clear for MaybeOverOptimized4PlanCache (#29782)

* update: fix the updatable table name resolution in build update list (#30061)

* expression : prevent function DATE_ADD/SUB_STRING_XXX pushed down to TiFlash (#30154)

* *: remove unused profile memory tracker from global tracker (#30143)

* expression, util/codec: fix wrongly eliminated conditions caused by `HashCode()` collision (#30120)

* cmd, expression: fix convert binary string to gbk (#30004)

* sessionctx/variable: make lc_time_names read only (#30084)

* expression: fix misuse of datumsToConstants in GBK test (#30072)

* plugin: add more tests to cover audit logs (#30165)

* planner: consider prefix index column length in skyline pruning (#27527)

* server: support download optimize trace file (#30150)

* expression: add ut config (#30156)

* ddl/ddl_test.go: refactor testTableInfo to return error (#30069)

* *: skip a case in TestClusterTables/ForClusterServerInfo on mac M1 (#29933)

* planner: do not add extra limit when handle the execute stmt (#30152)

* ddl: migrate test-infra to testify for db_cache_test.go (#30117)

* tables: fix data race in mockStatRemoteData (#30180)

* server: Port missing in processlist (#30183)

* server: add build not race flag (#30184)

* unistore: get/batchGet/scan support read-through-lock (#29898)

* topsql: fix nil pointer panic in stmtctx (#30181)

* types: fix wrong str_to_date() microseconds with leading zeros are not converted correctly (#30122)

* dumpling: Add support for `Create Placement` (#29724)

* *: add cardinality estimation trace for `Selectivity` (#29883)

* *: replace compareDatum by compare and ignore warnings is collate is empty (#30105)

* planner: implement aggregation eliminate optimize trace (#30114)

* server: Combined fix for authentication issues (#29738)

* executer: fix data race (#30186)

* dumpling : add a function for the variable call of dm (#30033)

* planner: revise optimize trace logic (#30163)

* statistics: fix unstable test case TestTraceCE (#30235)

* lightning: avoid retry write rows and record duplicate rows in tidb backend (#30179)

* executor: send a task with error to the resultCh when panic happen (#30214)

* docs: update placement policy limits (#30202)

* expression: Support GBK for builtin function AesEncrypt. (#29946)

* executor: remove useless log (#30248)

* docs: Update 2021-09-29-secure-bootstrap.md (#30243)

* executor: fix unstable test of topsql (#30257)

* copr: add paging API for streaming-like process (#29612)

* *: forbid set TiFlash Replica for a table with unsupport charset (#30162)

* privilege, session, server: consistently map user login to identity (#30204)

* expression: fix flen for timestamp_add (#30213)

* types: check values equals to NaN or Inf when convert to float (#30148)

* parser: respect TiDB comment when DROP INDEX IF EXISTS (#30173)

* ddl: disallow change columns from zero int to time (#25728)

* * : statement summary should know the slow write is blocked on read lock lease (#30166)

* planner: regard NULL as point when accessing composite index (#30244)

* planner: Add trace for proj elimination rule (#30275)

* privilege,session: Match loopback connections to 'localhost' accounts (#29995) (#30189)

* ddltest: refactor logutil.InitLogger in ddltest to avoid data race (#30299)

* load data: fix bug if load data with long content (#29222)

* topsql: reduce data race of sql digest (#30296)

* ddl: Do not consider the clustered index when checking the length of the secondary index (#29660)

* *: update client-go to use resolveForRead (#30314)

* ddl/ddl_algorithm_test.go: migrate test-infra to testify (#30268)

* store: Add metrics for pd api call time (#30062)

* *: replace compareDatum by compare and fix wrong optimize order by (#30273)

* metrics/grafana: fix display for 'Start TSO Wait Duration' panel (#30311)

* ddl: migrate test-infra to testify for ddl/options_test.go (#30269)

* planner: fix inconsistent schema between UnionAll and child operator (#30231)

* test: fix incorrect regexp pattern during migrating test (#30080)

* br: add more precise check for lock file (#30218)

* executor: replace should not change other rows when auto ID is out of range (#30301)

* tidb-server: return 1 while failing to set cpu affinity (#30197)

* executor: migrate test-infra to testify for executor/index_lookup_join_test.go (#30260)

* expression: fix wrong result of greatest/least(mixed unsigned/signed int) (#30121)

* types: casting JSON literal `null` to number types should fail (#30278)

* executor: fix data race in oomtest (#30339)

* parser: fix missing charset and collation of handle column (#30320)

* expression: don't append null when param for char() is null (#30236)

* *: add warn log for stale read (#30340)

* parser:  support multi bracket for subquery (#29656)

* session, sessionctx/variable: fix validation recursion bug (#30293)

* planner: Add trace for agg pushdown rule (#30262)

* planner/core: fix a data race when building plan for cached table (#30355)

* executor: avoid sum from avg overflow (#30010)

* config: make EnableSlowLog atomic (#30346)

* *: fix goroutine leak in ddl intergration test (#30369)

* executor: make projection executor unparallel for insert/update/delete (#30290)

* executor, util: reset offsets and nullBitMap for MutRow when setting new values (#30265)

* expression: fix tidb can't alter table from other-type with null value to timestamp with NOT NULL attribute (#29664)

* dumpling: fix default collation with upstream when dump database and table (#30292)

* ddl: fix the enum default value by triming trailing space (#30356)

* expression: migrate test-infra to testify for flag_simplify_test.go (#30407)

* server: refine code logic in handleDownloadFile (#30422)

* refine logic

Signed-off-by: yisaer <disxiaofei@163.com>

* fix

Signed-off-by: yisaer <disxiaofei@163.com>

* ddl: migrate test-infra to testify for ddl/table_test.go (#30267)

* ddl: handle the error from `addBatchDDLJobs()` correctly (#30401)

* br: fix the integration tests (#30423)

* util, cmd: remove unused filesort (#30438)

* *: update client-go for small backoff time (#30436)

* server: Fix unstable tests with FakeAuthSwitch (#30287)

* dumpling: fix dump failed when sequence exists (#30164)

* *: replace compareDatum by compare (#30421)

* lightning: fix gcs max key limit (#30393)

* expression, parser: add built-in func is_uuid (#30318)

* expression: migrate test-infra to testify for constant_fold_test.go (#30424)

* executor: fix pipelined window invalid memory address (#30418)

* makefile: add gotestsum for verify ci (#29848)

* server: close sql rows to fix unstable test (#30306)

* Makefile: add coverage record for BR and Dumpling (#30457)

* executor: track the mem usage of IndexMergeReader (#30210)

* infosync: close body when ReadAll encounters error (#30462)

* planner: show accessed partition when explain mpp query over partition table (#30367)

* *: Fix use of user identity in SHOW GRANTS + error messages (#30294)

* ddl: add not null flag for auto_increment column  (#30477)

* expression: make some unstable test serial (#30323)

* expression: migrate test-infra to testify for constant_propagation_test.go (#30430)

* executor: stable test TestSetDDLReorgBatchSize and TestSetDDLReorgWorkerCnt (#30480)

* statistics, util/ranger: add cardinality estimation trace for `GetRowCountBy...` (#30321)

* *: skip mysql client goroutine leak detection in integration ddl (#30467)

* executor,util: write slow query to slow log no matter what log level (#30461)

* executor: enable index_merge used in transaction. (#29875)

* logutil: add testcase for SlowQueryLogger.MaxDays/MaxSize/MaxBackups (#30316)

* expression: fix data race in builtin_other_vec_generated_test.go (#30503)

* expression: fix data race in the collationInfo (#30490)

* planner/core, session: fix error message of wrong variable scope (#30510)

* lightning: support Re/ReregisterMySQL by different tls name (#30463)

* executor: TestBatchGetandPointGetwithHashPartition test typo (#29669) (#29671)

* mockstore: improve log to avoid panic for nil pointer (#30513)

* *: replace compareDatum by compare, PR 10 (#30456)

* planner: Disable dynamic partition prune mode for all non-autocommit (#27532) (#30505)

* expression: change the log level of an confusing log from warn to debug (#30484)

* br: Check crypter.key valid before backup (#29991)

* *: replace compareDatum by compare, PR 11 (#30465)

* dumpling: fix default column collation with upstream when dump table (#30531)

* server: fix prepared cursor select (#30285)

* executor: HashJoinExec checks the buildError even if the probeSide is empty (#30471)

* parser, expression: follow mysql, increase interval precedence (#30528)

* makefile: set timeout 25m for make race (#30555)

* planner: fix the unstable test TestAnalyzeGlobalStatsWithOpts/2 (#30576)

* expression,types: Adjusts UNIX_TIMESTAMP() for non-existing DST values (#28739) (#30405)

* br: add res.Body.close to avoid leak (#30545)

* lightning: add back integration test lightning_error_summary (#30547)

* sessionctx/variable: small refactor (split large file) (#30511)

* ddl: let `admin cancel ddl jobs` run in a new transaction (#30549)

* *: Retry when placement PutBundles failed (#30590)

* dumpling: delete unit test in github actions (#30562)

* *: support trace plan target='estimation' statement (#30491)

* expression: migrate test-infra to testify for integration_test.go (#30548)

* planner: support trace for min/max eliminate (#30441)

* support min/max trace

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>

* br: remove cdclog in br (#30573)

* *: show cmd to check if all needed histograms are loaded (#29672)

* expression: clone repertoire when clone the scalar function (#30602)

* *: use the real StateRemote interface implementation for cached table (#30066)

* *: query failed after add index / timestamp out-of-range (#28424) (#29323)

* planner: implement collecting predicate columns from logical plan (#29878)

* *: show PK name when decoding the clustered index row key (#30623)

* ddl/callback_test.go: migrate test-infra to testify (#30317)

* *: Rename some names of placement ddl operation (#30622)

* executor: fix data race in the index_lookup_hash_join (#30619)

* ddl: remove unnecessary locking when adding an index (#29772)

* server: try to make `TidbTestSuite` more stable (#30643)

* *: Add some PD tests for placement and fix some bug found (#30621)

* *: migrate sync.WaitGroup to util.WaitGroupWrapper (#30644)

* planner: add trace for join eliminate rule (#30343)

* executor: migrate test-infra to testify for executor/shuffle_test.go (#30514)

* planner: make (*AccessPath).OnlyPointRange more succinct (#30520)

* planner: add trace for join reorder (#30394)

* executor: migrate test-infra to testify for executor/union_scan_test.go (#30525)

* expression: make cast return error if cast binary literal to another character set (#30537)

* *: update tikv client (#30670)

* *: update sysutil in go.mod to fix panic when search log (#30523)

* topsql: shouldn't evict the SQL meta, since the evicted SQL can be appear on Other components (TiKV) TopN records (#27050)

* testify: migrate test-infra to testify for analyze_test.go (#30640)

* util: replace compareDatum by compare,  point part (#30575)

* test: make all the tests run in serial (#30692)

* statistics: add mutex for Handle.globalMap and Handle.feedback (#30550)

* executor: fix regular expression in json so that it could match identifer start with '$' (#29750)

* util/testkit/testkit.go: fix typo (#30638)

* planner: Introduce a new global variable to control the historical statistics feature (#30646)

* topsql: introduce datasink interface (#30662)

* planner: unify the argument of stats functions to use SessionCtx instead of StatementContext (#30668)

* metrics: fix the Max SafeTS Gap metrics (#30689)

* lightning: Add source dir existence check for s3 (#30674)

* golangci-lint: support durationcheck (#30027)

* executor: fix data race on IndexHashJoin.cancelFunc (#30701)

* sessionctx/variable: change tidb_store_limit to global only (#30522)

* statistics: remove reassignment of Handle.pool in NewHandle (#30675)

* br: fix some unstable unit test cases. (#30716)

* bindinfo: fix the comment typo (#30616)

* server: support decoding prepared string args to character_set_client (#30723)

* expression: fix enum type join binary get wrong result (#30445)

* cmd/explaintest: fix wrong result comparison for explain test (#30717)

* parallel create tables in br

* metrics: fix copr-cache metrics (#30712)

* test: merge executor's serial tests to other tests (#30711)

* ddl: add batch create table api

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: add unit tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: typo

Co-authored-by: Arenatlx <ailinsilence4@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: rename to BatchCreateTableWithInfo

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: trace the error

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: comments

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancle the job right

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancel the job right 2

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error if entry too large

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error when table is duplicated

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: go fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* infoschema: improve batch memory perf

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: retain ID

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: reduce log frequency

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* fix merge issue

* fix issue that loss table restore

* refactoring code

* refactoring code

Co-authored-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: wangggong <793160615@qq.com>
Co-authored-by: 王超 <cclcwangchao@hotmail.com>
Co-authored-by: José Clovis Ramírez de la Rosa <clovis-@live.com>
Co-authored-by: unconsolable <chenzhipeng2012@gmail.com>
Co-authored-by: zhangguangchao <1614439+zgcbj@users.noreply.github.com>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
Co-authored-by: mmyj <mayj.hello@gmail.com>
Co-authored-by: Shenghui Wu <793703860@qq.com>
Co-authored-by: tison <wander4096@gmail.com>
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
Co-authored-by: xiaolunzhou <51695571+JayL-zxl@users.noreply.github.com>
Co-authored-by: glorv <glorvs@163.com>
Co-authored-by: sylzd <liuzidong@xiaomi.com>
Co-authored-by: Yexiang Zhang <mornyx.z@gmail.com>
Co-authored-by: tangenta <tangenta@126.com>
Co-authored-by: Yujie Xia <xiayjchn@gmail.com>
Co-authored-by: Hangjie Mo <mohangjie1995@gmail.com>
Co-authored-by: HuaiyuXu <391585975@qq.com>
Co-authored-by: Song Gao <disxiaofei@163.com>
Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: WangDeng <DWang_Slam@163.com>
Co-authored-by: Mattias Jonsson <mjonss@users.noreply.github.com>
Co-authored-by: djshow832 <zhangming@pingcap.com>
Co-authored-by: tiancaiamao <tiancaiamao@gmail.com>
Co-authored-by: Chengpeng Yan <41809508+Reminiscent@users.noreply.github.com>
Co-authored-by: Arenatlx <314806019@qq.com>
Co-authored-by: Meng Xin <tregoldmeng@gmail.com>
Co-authored-by: Zhou Kunqin <25057648+time-and-fate@users.noreply.github.com>
Co-authored-by: Youra Cho <espresso98@users.noreply.github.com>
Co-authored-by: Yifan Xu <30385241+xuyifangreeneyes@users.noreply.github.com>
Co-authored-by: Xiang Zhang <angwerzx@126.com>
Co-authored-by: Lei Zhao <zlwgx1023@gmail.com>
Co-authored-by: Daniël van Eeden <git@myname.nl>
Co-authored-by: docsir <73268456+docsir@users.noreply.github.com>
Co-authored-by: Morgan Tocker <tocker@gmail.com>
Co-authored-by: jakevin <30525741+jackwener@users.noreply.github.com>
Co-authored-by: 姬小野 <38575466+JameyWoo@users.noreply.github.com>
Co-authored-by: you06 <you1474600@gmail.com>
Co-authored-by: lance6716 <lance6716@gmail.com>
Co-authored-by: TonsnakeLin <87681388+TonsnakeLin@users.noreply.github.com>
Co-authored-by: imentu <imentu@foxmail.com>
Co-authored-by: Alkaid <38248129+jyz0309@users.noreply.github.com>
Co-authored-by: lvtu <37565148+tongtongyin@users.noreply.github.com>
Co-authored-by: 3pointer <luancheng@pingcap.com>
Co-authored-by: Zhuhe Fang <fzhedu@gmail.com>
Co-authored-by: WizardXiao <89761062+WizardXiao@users.noreply.github.com>
Co-authored-by: Jianjun Liao <36503113+Leavrth@users.noreply.github.com>
Co-authored-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Ryan Leung <rleungx@gmail.com>
Co-authored-by: xufei <xufei@pingcap.com>
Co-authored-by: Ehco <zh19960202@gmail.com>
Co-authored-by: Zak Zhao <57036248+joccau@users.noreply.github.com>
Co-authored-by: xhe <xw897002528@gmail.com>
Co-authored-by: Chunzhu Li <lichunzhu@stu.xjtu.edu.cn>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: Xiaoju Wu <wuxiaoju@pingcap.com>
Co-authored-by: JmPotato <ghzpotato@gmail.com>
Co-authored-by: Zach <51114270+zach030@users.noreply.github.com>
Co-authored-by: bb7133 <bb7133@gmail.com>
Co-authored-by: crazycs <crazycs520@gmail.com>
Co-authored-by: znhh6018 <44599853+znhh6018@users.noreply.github.com>
Co-authored-by: eddie lin <eddievim@foxmail.com>
Co-authored-by: dongjunduo <andj4cn@gmail.com>
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com>
Co-authored-by: zhangjinpeng1987 <zhangjinpeng@pingcap.com>
Co-authored-by: Jack Yu <yusp@pingcap.com>
Co-authored-by: Arenatlx <ailinsilence4@gmail.com>
fengou1 added a commit that referenced this issue Dec 27, 2021
* dumpling: fix default collation with upstream when dump database and table (#30292)

* ddl: fix the enum default value by triming trailing space (#30356)

* expression: migrate test-infra to testify for flag_simplify_test.go (#30407)

* server: refine code logic in handleDownloadFile (#30422)

* refine logic

Signed-off-by: yisaer <disxiaofei@163.com>

* fix

Signed-off-by: yisaer <disxiaofei@163.com>

* ddl: migrate test-infra to testify for ddl/table_test.go (#30267)

* ddl: handle the error from `addBatchDDLJobs()` correctly (#30401)

* br: fix the integration tests (#30423)

* util, cmd: remove unused filesort (#30438)

* *: update client-go for small backoff time (#30436)

* server: Fix unstable tests with FakeAuthSwitch (#30287)

* dumpling: fix dump failed when sequence exists (#30164)

* *: replace compareDatum by compare (#30421)

* lightning: fix gcs max key limit (#30393)

* expression, parser: add built-in func is_uuid (#30318)

* expression: migrate test-infra to testify for constant_fold_test.go (#30424)

* executor: fix pipelined window invalid memory address (#30418)

* makefile: add gotestsum for verify ci (#29848)

* server: close sql rows to fix unstable test (#30306)

* Makefile: add coverage record for BR and Dumpling (#30457)

* executor: track the mem usage of IndexMergeReader (#30210)

* infosync: close body when ReadAll encounters error (#30462)

* planner: show accessed partition when explain mpp query over partition table (#30367)

* *: Fix use of user identity in SHOW GRANTS + error messages (#30294)

* ddl: add not null flag for auto_increment column  (#30477)

* expression: make some unstable test serial (#30323)

* expression: migrate test-infra to testify for constant_propagation_test.go (#30430)

* executor: stable test TestSetDDLReorgBatchSize and TestSetDDLReorgWorkerCnt (#30480)

* statistics, util/ranger: add cardinality estimation trace for `GetRowCountBy...` (#30321)

* *: skip mysql client goroutine leak detection in integration ddl (#30467)

* executor,util: write slow query to slow log no matter what log level (#30461)

* executor: enable index_merge used in transaction. (#29875)

* logutil: add testcase for SlowQueryLogger.MaxDays/MaxSize/MaxBackups (#30316)

* expression: fix data race in builtin_other_vec_generated_test.go (#30503)

* expression: fix data race in the collationInfo (#30490)

* planner/core, session: fix error message of wrong variable scope (#30510)

* lightning: support Re/ReregisterMySQL by different tls name (#30463)

* executor: TestBatchGetandPointGetwithHashPartition test typo (#29669) (#29671)

* mockstore: improve log to avoid panic for nil pointer (#30513)

* *: replace compareDatum by compare, PR 10 (#30456)

* planner: Disable dynamic partition prune mode for all non-autocommit (#27532) (#30505)

* expression: change the log level of an confusing log from warn to debug (#30484)

* br: Check crypter.key valid before backup (#29991)

* *: replace compareDatum by compare, PR 11 (#30465)

* dumpling: fix default column collation with upstream when dump table (#30531)

* server: fix prepared cursor select (#30285)

* executor: HashJoinExec checks the buildError even if the probeSide is empty (#30471)

* parser, expression: follow mysql, increase interval precedence (#30528)

* makefile: set timeout 25m for make race (#30555)

* planner: fix the unstable test TestAnalyzeGlobalStatsWithOpts/2 (#30576)

* expression,types: Adjusts UNIX_TIMESTAMP() for non-existing DST values (#28739) (#30405)

* br: add res.Body.close to avoid leak (#30545)

* lightning: add back integration test lightning_error_summary (#30547)

* sessionctx/variable: small refactor (split large file) (#30511)

* ddl: let `admin cancel ddl jobs` run in a new transaction (#30549)

* *: Retry when placement PutBundles failed (#30590)

* dumpling: delete unit test in github actions (#30562)

* *: support trace plan target='estimation' statement (#30491)

* expression: migrate test-infra to testify for integration_test.go (#30548)

* planner: support trace for min/max eliminate (#30441)

* support min/max trace

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>

* br: remove cdclog in br (#30573)

* *: show cmd to check if all needed histograms are loaded (#29672)

* expression: clone repertoire when clone the scalar function (#30602)

* *: use the real StateRemote interface implementation for cached table (#30066)

* *: query failed after add index / timestamp out-of-range (#28424) (#29323)

* planner: implement collecting predicate columns from logical plan (#29878)

* *: show PK name when decoding the clustered index row key (#30623)

* ddl/callback_test.go: migrate test-infra to testify (#30317)

* *: Rename some names of placement ddl operation (#30622)

* executor: fix data race in the index_lookup_hash_join (#30619)

* ddl: remove unnecessary locking when adding an index (#29772)

* server: try to make `TidbTestSuite` more stable (#30643)

* *: Add some PD tests for placement and fix some bug found (#30621)

* *: migrate sync.WaitGroup to util.WaitGroupWrapper (#30644)

* planner: add trace for join eliminate rule (#30343)

* executor: migrate test-infra to testify for executor/shuffle_test.go (#30514)

* planner: make (*AccessPath).OnlyPointRange more succinct (#30520)

* planner: add trace for join reorder (#30394)

* executor: migrate test-infra to testify for executor/union_scan_test.go (#30525)

* expression: make cast return error if cast binary literal to another character set (#30537)

* *: update tikv client (#30670)

* *: update sysutil in go.mod to fix panic when search log (#30523)

* topsql: shouldn't evict the SQL meta, since the evicted SQL can be appear on Other components (TiKV) TopN records (#27050)

* testify: migrate test-infra to testify for analyze_test.go (#30640)

* util: replace compareDatum by compare,  point part (#30575)

* test: make all the tests run in serial (#30692)

* statistics: add mutex for Handle.globalMap and Handle.feedback (#30550)

* executor: fix regular expression in json so that it could match identifer start with '$' (#29750)

* util/testkit/testkit.go: fix typo (#30638)

* planner: Introduce a new global variable to control the historical statistics feature (#30646)

* topsql: introduce datasink interface (#30662)

* planner: unify the argument of stats functions to use SessionCtx instead of StatementContext (#30668)

* metrics: fix the Max SafeTS Gap metrics (#30689)

* lightning: Add source dir existence check for s3 (#30674)

* golangci-lint: support durationcheck (#30027)

* executor: fix data race on IndexHashJoin.cancelFunc (#30701)

* sessionctx/variable: change tidb_store_limit to global only (#30522)

* statistics: remove reassignment of Handle.pool in NewHandle (#30675)

* br: fix some unstable unit test cases. (#30716)

* bindinfo: fix the comment typo (#30616)

* server: support decoding prepared string args to character_set_client (#30723)

* expression: fix enum type join binary get wrong result (#30445)

* cmd/explaintest: fix wrong result comparison for explain test (#30717)

* parallel create tables in br

* metrics: fix copr-cache metrics (#30712)

* test: merge executor's serial tests to other tests (#30711)

* statistics: avoid deadlock when create/drop extended stats and analyze at the same time (#30566)

* ddl: add batch create table api

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: add unit tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: typo

Co-authored-by: Arenatlx <ailinsilence4@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: rename to BatchCreateTableWithInfo

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: trace the error

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: comments

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancle the job right

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancel the job right 2

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error if entry too large

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error when table is duplicated

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: go fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* infoschema: improve batch memory perf

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: retain ID

Signed-off-by: xhe <xw897002528@gmail.com>

* sessionctx: fix the value of analyze_version when upgrading 4.x to 5.… (#30743)

* ddl: reduce log frequency

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* server: disable socket listener for `basicHTTPHandlerTestSuite` (#30680)

* planner: support the plan cache aware of bindings (#30169)

* planner: fix early set of plan's statisticsTable (#30754)

* *: implement renew write lock lease for cached table (#30206)

* *: Modify placement rule index to reserve some indexes for future work (#30737)

* executor: add an unit test case for unreasonable invoking Close (#30696)

* planner: fix wrong subquery's coercibility  (#30750)

* executor: add more testcases for index merge (#30497)

* server: add grpc server config for a suitable behavior (#30774)

* config, charset: make charset config not affected by collation config (#30572)

* lightning: emit tidb log by change FilterCore to only allow matched packages (#30700)

* topsql: a centralized place to generate tipb report data (#30781)

* planner: add trace for partition pruning (#30546)

* planner: refine collation handling for between (#30793)

* test: merge serial tests in bindinfo, expression, parser and statistics (#30749)

* br: update log description for split check (#30763)

* *: replace compareDatum by compare, range part (#30710)

* *: placement policy ref will be converted to direct options when recover or flashback table (#30705)

* ddl: handle the incorrect number of placement followers (#30715)

* ddl: revert "ddl: remove unnecessary locking when adding an index" (#30667)

* br/pkg/task: migrate test-infra to testify (#30605)

* *: fix the flen type datetime for union/case-when/control-funcs (#30588)

* types, util: clean up compareDatum (#30815)

* ddl: add helper function to set and query TiFlash's sync status (#30473)

* dumpling: fix more dumpling log level query template (#30176)

* parser: support `admin flush plan_cache` (#30747)

* topsql: support multiple datasinks (#30808)

* br: update permission, so tikv can write to folder when backup to local (#30396)

* session: fix bootstrap to only persist global variables (#30593)

close #28667

* docs/design: update collation compatibility issues in charsets doc (#30806)

* executor: improve SET sysvar=DEFAULT handling (#29680)

close #29670

* br: add error handling for group context cancel when restore file is corrupted (#30190)

close #30135

* executor: buildWindow cannot call typeInfer twice (#30773)

close #30402

* *: refactor encoding and uniform usages (#30288)

* lightning: optimize region split check logic (#30428)

close #30018

* br: ignore mock directory when gcov in br (#30586)

* *: forbid set tiflash replica count for a placement table (#30844)

close #30741

* execute: don't transform charset in internal sql (#30843)

close #30789

* planner: update PlanBuilder.windowSpecs when building subquery (#30878)

close #30804

* br: fix S3 backup endpoint suffix (#30530)

close #30104

* lightning: make pre-check output message clearer (#30439)

close #30395

* expression: wrap to_binary and from_binary for cast function's argument (#30706)

* executor: fix bug when using IndexMerge in transaction (#30719)

close #30685

* ddl: migrate test-infra to testify for ddl/foreign_key_test.go (#30853)

close #29103

* expression: fix wrong retType for reverse function (#30829)

close #30809

* planner: support trace topn push down (#30800)

ref #29661

* github: add issue requirement to pull request template (#30817)

close #30814

* fix merge issue

* topsql: introduce stmtstats and sql execution count (#30277)

* topsql: add pubsub datasink (#30860)

* executor: fix the incorrect untouch used in optimistic transactions (#30447)

close #30410

* expression, cmd: let crc32() support gbk (#30900)

close #30898

* server: Add uptime status var and statistics (#29790)

close #8842

* br: error log optimization (#29640)

close #27015

* planner: fix wrong collation when rewrite in condition (#30492)

close #30486

* planner: add extractor for tikv_region_peers (#30656)

* fix issue that loss table restore

* lightning: add back table empty check and add a switch config (#30887)

close #27919

* br: improve backoff unit test (#30892)

* *: add TxnManager to manage txn in session (#30574)

* *: add TxnManager to manage txn in session

* modify

* add tests

* move failpoint content to a single file

* Makefile: add `t.Parallel` check to ensure tests are run in serial (#30869)

* refactoring code

* refactoring code

* placement: remove isolationlevel (#30859)

close #30858

* planner: revise the optimize trace output (#30882)

* table: set the datum collation correctly in CastValue() (#30931)

close #30930

* *: Use TxnManager.GetTxnInfoSchema() to get the txn infoschema (#30934)

close #30933

* parser: add IsValid() to Encoding to speed up string validation for UTF-8 (#30937)

close #30936

* planner: rename pstmtPlanCacheXX to PlanCacheXX (#30909)

* table/tables: make CI TestCacheTableBasicReadAndWrite more stable (#30924)

close #30922

* restore: use new ScatterRegions API (#30899)

close #30425

* *: when placement conflicts with tiflash, cancel the job (#30945)

* Makefile,tools: make CI great again! (#30828)

close #30822

* br/pkg/membuf: remove global buffer pool (#29934)

* ddl: add format error for incorrect dict syntax in the placement rule (#30919)

close #30454

* planner: fix index merge plan when expr cannot be pushed to tikv (#30341)

close #30200

* executor: display 'show create table' and INFOSCHEMA for cached table correctly (#30951)

close #30950

* br: extend the timeout for scan region since 3 seconds is not enough (#30889)

close #30720

* planner: remove bindSQL from planCacheKey to planCacheValue (#30916)

* execution: refine precision of cast as decimal in agg func (#30805)

* *: fix data race in the tikv_client (#30964)

close #30658

* ddl: migrate test-infra to testify for ddl/db_partition_test.go (#30952)

close #28635

* planner: fix `AccessPath.TableFilters` got modified unexpectedly (#30966)

close #30965

* test: merge serial tests in ddl, infoschema, session, store, table, telemetry and types (#30874)

* executor: fix the returned field count of the prepare statement (#30981)

close #30971

* binlog: allow multiple ddl targets (#30904)

* planner: trace predicate push down  (#30902)

ref #29661

* placement: give default 2 followers for non-sugar syntax (#31000)

* flatten the json output (#30905)

Signed-off-by: yisaer <disxiaofei@163.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>

* test: control log level with environment variables (#30871)

* planner: add usage of paging copr in optimizer (#30536)

close #30578

* test: merge serial tests in cmd, planner, server, util (#31003)

* planner: change predicateColumnCollector to columnStatsUsageCollector and collect histogram-needed columns (#30671)

* executor: migrate test-infra to testify for distsql_test.go (#31023)

close #28574

* remote uncessary package errors

* reused the retry code from lightning

* refactoring retryable

* ddl: add batch create table api

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: add unit tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* br ddl code

* parallel create tables in br

* ddl: add batch create table api

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: add unit tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: typo

Co-authored-by: Arenatlx <ailinsilence4@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: rename to BatchCreateTableWithInfo

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: trace the error

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: comments

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancle the job right

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancel the job right 2

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error if entry too large

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error when table is duplicated

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: go fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* infoschema: improve batch memory perf

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: retain ID

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: reduce log frequency

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: remove retainID from the interface

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* executor: fix rebasing problem

Signed-off-by: xhe <xw897002528@gmail.com>

Co-authored-by: WizardXiao <89761062+WizardXiao@users.noreply.github.com>
Co-authored-by: sylzd <liuzidong@xiaomi.com>
Co-authored-by: tison <wander4096@gmail.com>
Co-authored-by: Song Gao <disxiaofei@163.com>
Co-authored-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: tangenta <tangenta@126.com>
Co-authored-by: 3pointer <luancheng@pingcap.com>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
Co-authored-by: Lei Zhao <zlwgx1023@gmail.com>
Co-authored-by: Daniël van Eeden <git@myname.nl>
Co-authored-by: Jianjun Liao <36503113+Leavrth@users.noreply.github.com>
Co-authored-by: unconsolable <chenzhipeng2012@gmail.com>
Co-authored-by: Shenghui Wu <793703860@qq.com>
Co-authored-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Ryan Leung <rleungx@gmail.com>
Co-authored-by: xufei <xufei@pingcap.com>
Co-authored-by: Morgan Tocker <tocker@gmail.com>
Co-authored-by: Zhou Kunqin <25057648+time-and-fate@users.noreply.github.com>
Co-authored-by: 王超 <cclcwangchao@hotmail.com>
Co-authored-by: TonsnakeLin <87681388+TonsnakeLin@users.noreply.github.com>
Co-authored-by: Ehco <zh19960202@gmail.com>
Co-authored-by: Mattias Jonsson <mjonss@users.noreply.github.com>
Co-authored-by: HuaiyuXu <391585975@qq.com>
Co-authored-by: Zak Zhao <57036248+joccau@users.noreply.github.com>
Co-authored-by: xhe <xw897002528@gmail.com>
Co-authored-by: Hangjie Mo <mohangjie1995@gmail.com>
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
Co-authored-by: glorv <glorvs@163.com>
Co-authored-by: djshow832 <zhangming@pingcap.com>
Co-authored-by: Chunzhu Li <lichunzhu@stu.xjtu.edu.cn>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: Xiaoju Wu <wuxiaoju@pingcap.com>
Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: tiancaiamao <tiancaiamao@gmail.com>
Co-authored-by: Yifan Xu <30385241+xuyifangreeneyes@users.noreply.github.com>
Co-authored-by: JmPotato <ghzpotato@gmail.com>
Co-authored-by: Zach <51114270+zach030@users.noreply.github.com>
Co-authored-by: bb7133 <bb7133@gmail.com>
Co-authored-by: lvtu <37565148+tongtongyin@users.noreply.github.com>
Co-authored-by: crazycs <crazycs520@gmail.com>
Co-authored-by: znhh6018 <44599853+znhh6018@users.noreply.github.com>
Co-authored-by: eddie lin <eddievim@foxmail.com>
Co-authored-by: dongjunduo <andj4cn@gmail.com>
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com>
Co-authored-by: wangggong <793160615@qq.com>
Co-authored-by: zhangjinpeng1987 <zhangjinpeng@pingcap.com>
Co-authored-by: Jack Yu <yusp@pingcap.com>
Co-authored-by: Arenatlx <ailinsilence4@gmail.com>
Co-authored-by: Yiding Cui <winoros@gmail.com>
Co-authored-by: Chengpeng Yan <41809508+Reminiscent@users.noreply.github.com>
Co-authored-by: bestwoody <89765764+bestwoody@users.noreply.github.com>
Co-authored-by: Calvin Neo <CalvinNeo@users.noreply.github.com>
Co-authored-by: Lynn <zimu_xia@126.com>
Co-authored-by: Zhuhe Fang <fzhedu@gmail.com>
Co-authored-by: Mini256 <minianter@foxmail.com>
Co-authored-by: Xiang Zhang <angwerzx@126.com>
Co-authored-by: Yexiang Zhang <mornyx.z@gmail.com>
Co-authored-by: cfzjywxk <lsswxrxr@163.com>
Co-authored-by: db <39407623+IcePigZDB@users.noreply.github.com>
Co-authored-by: 山岚 <36239017+YuJuncen@users.noreply.github.com>
Co-authored-by: Yujie Xia <xiayjchn@gmail.com>
Co-authored-by: Yilong Li <liyilongko@gmail.com>
Co-authored-by: tuuuuuu <83738345+MiaoMiaoGarden@users.noreply.github.com>
Co-authored-by: qupeng <qupeng@pingcap.com>
Co-authored-by: you06 <you1474600@gmail.com>
fengou1 added a commit that referenced this issue Dec 27, 2021
* br: fix the integration tests (#30423)

* util, cmd: remove unused filesort (#30438)

* *: update client-go for small backoff time (#30436)

* server: Fix unstable tests with FakeAuthSwitch (#30287)

* dumpling: fix dump failed when sequence exists (#30164)

* *: replace compareDatum by compare (#30421)

* lightning: fix gcs max key limit (#30393)

* expression, parser: add built-in func is_uuid (#30318)

* expression: migrate test-infra to testify for constant_fold_test.go (#30424)

* executor: fix pipelined window invalid memory address (#30418)

* makefile: add gotestsum for verify ci (#29848)

* server: close sql rows to fix unstable test (#30306)

* Makefile: add coverage record for BR and Dumpling (#30457)

* executor: track the mem usage of IndexMergeReader (#30210)

* infosync: close body when ReadAll encounters error (#30462)

* planner: show accessed partition when explain mpp query over partition table (#30367)

* *: Fix use of user identity in SHOW GRANTS + error messages (#30294)

* ddl: add not null flag for auto_increment column  (#30477)

* expression: make some unstable test serial (#30323)

* expression: migrate test-infra to testify for constant_propagation_test.go (#30430)

* executor: stable test TestSetDDLReorgBatchSize and TestSetDDLReorgWorkerCnt (#30480)

* statistics, util/ranger: add cardinality estimation trace for `GetRowCountBy...` (#30321)

* *: skip mysql client goroutine leak detection in integration ddl (#30467)

* executor,util: write slow query to slow log no matter what log level (#30461)

* executor: enable index_merge used in transaction. (#29875)

* logutil: add testcase for SlowQueryLogger.MaxDays/MaxSize/MaxBackups (#30316)

* expression: fix data race in builtin_other_vec_generated_test.go (#30503)

* expression: fix data race in the collationInfo (#30490)

* planner/core, session: fix error message of wrong variable scope (#30510)

* lightning: support Re/ReregisterMySQL by different tls name (#30463)

* executor: TestBatchGetandPointGetwithHashPartition test typo (#29669) (#29671)

* mockstore: improve log to avoid panic for nil pointer (#30513)

* *: replace compareDatum by compare, PR 10 (#30456)

* planner: Disable dynamic partition prune mode for all non-autocommit (#27532) (#30505)

* expression: change the log level of an confusing log from warn to debug (#30484)

* br: Check crypter.key valid before backup (#29991)

* *: replace compareDatum by compare, PR 11 (#30465)

* dumpling: fix default column collation with upstream when dump table (#30531)

* server: fix prepared cursor select (#30285)

* executor: HashJoinExec checks the buildError even if the probeSide is empty (#30471)

* parser, expression: follow mysql, increase interval precedence (#30528)

* makefile: set timeout 25m for make race (#30555)

* planner: fix the unstable test TestAnalyzeGlobalStatsWithOpts/2 (#30576)

* expression,types: Adjusts UNIX_TIMESTAMP() for non-existing DST values (#28739) (#30405)

* br: add res.Body.close to avoid leak (#30545)

* lightning: add back integration test lightning_error_summary (#30547)

* sessionctx/variable: small refactor (split large file) (#30511)

* ddl: let `admin cancel ddl jobs` run in a new transaction (#30549)

* *: Retry when placement PutBundles failed (#30590)

* dumpling: delete unit test in github actions (#30562)

* *: support trace plan target='estimation' statement (#30491)

* expression: migrate test-infra to testify for integration_test.go (#30548)

* planner: support trace for min/max eliminate (#30441)

* support min/max trace

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>

* br: remove cdclog in br (#30573)

* *: show cmd to check if all needed histograms are loaded (#29672)

* expression: clone repertoire when clone the scalar function (#30602)

* *: use the real StateRemote interface implementation for cached table (#30066)

* *: query failed after add index / timestamp out-of-range (#28424) (#29323)

* planner: implement collecting predicate columns from logical plan (#29878)

* *: show PK name when decoding the clustered index row key (#30623)

* ddl/callback_test.go: migrate test-infra to testify (#30317)

* *: Rename some names of placement ddl operation (#30622)

* executor: fix data race in the index_lookup_hash_join (#30619)

* ddl: remove unnecessary locking when adding an index (#29772)

* server: try to make `TidbTestSuite` more stable (#30643)

* *: Add some PD tests for placement and fix some bug found (#30621)

* *: migrate sync.WaitGroup to util.WaitGroupWrapper (#30644)

* planner: add trace for join eliminate rule (#30343)

* executor: migrate test-infra to testify for executor/shuffle_test.go (#30514)

* planner: make (*AccessPath).OnlyPointRange more succinct (#30520)

* planner: add trace for join reorder (#30394)

* executor: migrate test-infra to testify for executor/union_scan_test.go (#30525)

* expression: make cast return error if cast binary literal to another character set (#30537)

* *: update tikv client (#30670)

* *: update sysutil in go.mod to fix panic when search log (#30523)

* topsql: shouldn't evict the SQL meta, since the evicted SQL can be appear on Other components (TiKV) TopN records (#27050)

* testify: migrate test-infra to testify for analyze_test.go (#30640)

* util: replace compareDatum by compare,  point part (#30575)

* test: make all the tests run in serial (#30692)

* statistics: add mutex for Handle.globalMap and Handle.feedback (#30550)

* executor: fix regular expression in json so that it could match identifer start with '$' (#29750)

* util/testkit/testkit.go: fix typo (#30638)

* planner: Introduce a new global variable to control the historical statistics feature (#30646)

* topsql: introduce datasink interface (#30662)

* planner: unify the argument of stats functions to use SessionCtx instead of StatementContext (#30668)

* metrics: fix the Max SafeTS Gap metrics (#30689)

* lightning: Add source dir existence check for s3 (#30674)

* golangci-lint: support durationcheck (#30027)

* executor: fix data race on IndexHashJoin.cancelFunc (#30701)

* sessionctx/variable: change tidb_store_limit to global only (#30522)

* statistics: remove reassignment of Handle.pool in NewHandle (#30675)

* br: fix some unstable unit test cases. (#30716)

* bindinfo: fix the comment typo (#30616)

* server: support decoding prepared string args to character_set_client (#30723)

* expression: fix enum type join binary get wrong result (#30445)

* cmd/explaintest: fix wrong result comparison for explain test (#30717)

* parallel create tables in br

* metrics: fix copr-cache metrics (#30712)

* test: merge executor's serial tests to other tests (#30711)

* statistics: avoid deadlock when create/drop extended stats and analyze at the same time (#30566)

* ddl: add batch create table api

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: add unit tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: typo

Co-authored-by: Arenatlx <ailinsilence4@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: rename to BatchCreateTableWithInfo

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: trace the error

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: comments

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancle the job right

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancel the job right 2

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error if entry too large

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error when table is duplicated

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: go fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* infoschema: improve batch memory perf

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: retain ID

Signed-off-by: xhe <xw897002528@gmail.com>

* sessionctx: fix the value of analyze_version when upgrading 4.x to 5.… (#30743)

* ddl: reduce log frequency

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* server: disable socket listener for `basicHTTPHandlerTestSuite` (#30680)

* planner: support the plan cache aware of bindings (#30169)

* planner: fix early set of plan's statisticsTable (#30754)

* *: implement renew write lock lease for cached table (#30206)

* *: Modify placement rule index to reserve some indexes for future work (#30737)

* executor: add an unit test case for unreasonable invoking Close (#30696)

* planner: fix wrong subquery's coercibility  (#30750)

* executor: add more testcases for index merge (#30497)

* server: add grpc server config for a suitable behavior (#30774)

* config, charset: make charset config not affected by collation config (#30572)

* lightning: emit tidb log by change FilterCore to only allow matched packages (#30700)

* topsql: a centralized place to generate tipb report data (#30781)

* planner: add trace for partition pruning (#30546)

* planner: refine collation handling for between (#30793)

* test: merge serial tests in bindinfo, expression, parser and statistics (#30749)

* br: update log description for split check (#30763)

* *: replace compareDatum by compare, range part (#30710)

* *: placement policy ref will be converted to direct options when recover or flashback table (#30705)

* ddl: handle the incorrect number of placement followers (#30715)

* ddl: revert "ddl: remove unnecessary locking when adding an index" (#30667)

* br/pkg/task: migrate test-infra to testify (#30605)

* *: fix the flen type datetime for union/case-when/control-funcs (#30588)

* types, util: clean up compareDatum (#30815)

* ddl: add helper function to set and query TiFlash's sync status (#30473)

* dumpling: fix more dumpling log level query template (#30176)

* parser: support `admin flush plan_cache` (#30747)

* topsql: support multiple datasinks (#30808)

* br: update permission, so tikv can write to folder when backup to local (#30396)

* session: fix bootstrap to only persist global variables (#30593)

close #28667

* docs/design: update collation compatibility issues in charsets doc (#30806)

* executor: improve SET sysvar=DEFAULT handling (#29680)

close #29670

* br: add error handling for group context cancel when restore file is corrupted (#30190)

close #30135

* executor: buildWindow cannot call typeInfer twice (#30773)

close #30402

* *: refactor encoding and uniform usages (#30288)

* lightning: optimize region split check logic (#30428)

close #30018

* br: ignore mock directory when gcov in br (#30586)

* *: forbid set tiflash replica count for a placement table (#30844)

close #30741

* execute: don't transform charset in internal sql (#30843)

close #30789

* planner: update PlanBuilder.windowSpecs when building subquery (#30878)

close #30804

* br: fix S3 backup endpoint suffix (#30530)

close #30104

* lightning: make pre-check output message clearer (#30439)

close #30395

* expression: wrap to_binary and from_binary for cast function's argument (#30706)

* executor: fix bug when using IndexMerge in transaction (#30719)

close #30685

* ddl: migrate test-infra to testify for ddl/foreign_key_test.go (#30853)

close #29103

* expression: fix wrong retType for reverse function (#30829)

close #30809

* planner: support trace topn push down (#30800)

ref #29661

* github: add issue requirement to pull request template (#30817)

close #30814

* fix merge issue

* topsql: introduce stmtstats and sql execution count (#30277)

* topsql: add pubsub datasink (#30860)

* executor: fix the incorrect untouch used in optimistic transactions (#30447)

close #30410

* expression, cmd: let crc32() support gbk (#30900)

close #30898

* server: Add uptime status var and statistics (#29790)

close #8842

* br: error log optimization (#29640)

close #27015

* planner: fix wrong collation when rewrite in condition (#30492)

close #30486

* planner: add extractor for tikv_region_peers (#30656)

* fix issue that loss table restore

* lightning: add back table empty check and add a switch config (#30887)

close #27919

* br: improve backoff unit test (#30892)

* *: add TxnManager to manage txn in session (#30574)

* *: add TxnManager to manage txn in session

* modify

* add tests

* move failpoint content to a single file

* Makefile: add `t.Parallel` check to ensure tests are run in serial (#30869)

* refactoring code

* refactoring code

* placement: remove isolationlevel (#30859)

close #30858

* planner: revise the optimize trace output (#30882)

* table: set the datum collation correctly in CastValue() (#30931)

close #30930

* *: Use TxnManager.GetTxnInfoSchema() to get the txn infoschema (#30934)

close #30933

* parser: add IsValid() to Encoding to speed up string validation for UTF-8 (#30937)

close #30936

* planner: rename pstmtPlanCacheXX to PlanCacheXX (#30909)

* table/tables: make CI TestCacheTableBasicReadAndWrite more stable (#30924)

close #30922

* restore: use new ScatterRegions API (#30899)

close #30425

* *: when placement conflicts with tiflash, cancel the job (#30945)

* Makefile,tools: make CI great again! (#30828)

close #30822

* br/pkg/membuf: remove global buffer pool (#29934)

* ddl: add format error for incorrect dict syntax in the placement rule (#30919)

close #30454

* planner: fix index merge plan when expr cannot be pushed to tikv (#30341)

close #30200

* executor: display 'show create table' and INFOSCHEMA for cached table correctly (#30951)

close #30950

* br: extend the timeout for scan region since 3 seconds is not enough (#30889)

close #30720

* planner: remove bindSQL from planCacheKey to planCacheValue (#30916)

* execution: refine precision of cast as decimal in agg func (#30805)

* *: fix data race in the tikv_client (#30964)

close #30658

* ddl: migrate test-infra to testify for ddl/db_partition_test.go (#30952)

close #28635

* planner: fix `AccessPath.TableFilters` got modified unexpectedly (#30966)

close #30965

* test: merge serial tests in ddl, infoschema, session, store, table, telemetry and types (#30874)

* executor: fix the returned field count of the prepare statement (#30981)

close #30971

* binlog: allow multiple ddl targets (#30904)

* planner: trace predicate push down  (#30902)

ref #29661

* placement: give default 2 followers for non-sugar syntax (#31000)

* flatten the json output (#30905)

Signed-off-by: yisaer <disxiaofei@163.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>

* test: control log level with environment variables (#30871)

* planner: add usage of paging copr in optimizer (#30536)

close #30578

* test: merge serial tests in cmd, planner, server, util (#31003)

* planner: change predicateColumnCollector to columnStatsUsageCollector and collect histogram-needed columns (#30671)

* executor: migrate test-infra to testify for distsql_test.go (#31023)

close #28574

* remote uncessary package errors

* reused the retry code from lightning

* refactoring retryable

* ddl: add batch create table api

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: add unit tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* br ddl code

* parallel create tables in br

* ddl: add batch create table api

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: add unit tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: typo

Co-authored-by: Arenatlx <ailinsilence4@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: rename to BatchCreateTableWithInfo

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: trace the error

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: comments

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancle the job right

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: cancel the job right 2

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error if entry too large

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: report error when table is duplicated

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: go fmt

Signed-off-by: xhe <xw897002528@gmail.com>

* infoschema: improve batch memory perf

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: retain ID

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: reduce log frequency

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: remove retainID from the interface

Signed-off-by: xhe <xw897002528@gmail.com>

* ddl: fix tests

Signed-off-by: xhe <xw897002528@gmail.com>

* executor: fix rebasing problem

Signed-off-by: xhe <xw897002528@gmail.com>

* sessionctx: enable IndexMerge by default (#30650)

close #29597

* br: Enable lint `gosec` in br (#30895)

close #30699

* planner: support 'admin flush plan cache' (#30370)

* merge from tidb batch_1

Co-authored-by: 3pointer <luancheng@pingcap.com>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
Co-authored-by: Lei Zhao <zlwgx1023@gmail.com>
Co-authored-by: Daniël van Eeden <git@myname.nl>
Co-authored-by: sylzd <liuzidong@xiaomi.com>
Co-authored-by: Jianjun Liao <36503113+Leavrth@users.noreply.github.com>
Co-authored-by: unconsolable <chenzhipeng2012@gmail.com>
Co-authored-by: tison <wander4096@gmail.com>
Co-authored-by: Shenghui Wu <793703860@qq.com>
Co-authored-by: tangenta <tangenta@126.com>
Co-authored-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Ryan Leung <rleungx@gmail.com>
Co-authored-by: xufei <xufei@pingcap.com>
Co-authored-by: Morgan Tocker <tocker@gmail.com>
Co-authored-by: Zhou Kunqin <25057648+time-and-fate@users.noreply.github.com>
Co-authored-by: 王超 <cclcwangchao@hotmail.com>
Co-authored-by: TonsnakeLin <87681388+TonsnakeLin@users.noreply.github.com>
Co-authored-by: Ehco <zh19960202@gmail.com>
Co-authored-by: Mattias Jonsson <mjonss@users.noreply.github.com>
Co-authored-by: HuaiyuXu <391585975@qq.com>
Co-authored-by: Zak Zhao <57036248+joccau@users.noreply.github.com>
Co-authored-by: WizardXiao <89761062+WizardXiao@users.noreply.github.com>
Co-authored-by: xhe <xw897002528@gmail.com>
Co-authored-by: Hangjie Mo <mohangjie1995@gmail.com>
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
Co-authored-by: glorv <glorvs@163.com>
Co-authored-by: djshow832 <zhangming@pingcap.com>
Co-authored-by: Chunzhu Li <lichunzhu@stu.xjtu.edu.cn>
Co-authored-by: Song Gao <disxiaofei@163.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: Xiaoju Wu <wuxiaoju@pingcap.com>
Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: tiancaiamao <tiancaiamao@gmail.com>
Co-authored-by: Yifan Xu <30385241+xuyifangreeneyes@users.noreply.github.com>
Co-authored-by: JmPotato <ghzpotato@gmail.com>
Co-authored-by: Zach <51114270+zach030@users.noreply.github.com>
Co-authored-by: bb7133 <bb7133@gmail.com>
Co-authored-by: lvtu <37565148+tongtongyin@users.noreply.github.com>
Co-authored-by: crazycs <crazycs520@gmail.com>
Co-authored-by: znhh6018 <44599853+znhh6018@users.noreply.github.com>
Co-authored-by: eddie lin <eddievim@foxmail.com>
Co-authored-by: dongjunduo <andj4cn@gmail.com>
Co-authored-by: Zhenchi <zhongzc_arch@outlook.com>
Co-authored-by: wangggong <793160615@qq.com>
Co-authored-by: zhangjinpeng1987 <zhangjinpeng@pingcap.com>
Co-authored-by: Jack Yu <yusp@pingcap.com>
Co-authored-by: Arenatlx <ailinsilence4@gmail.com>
Co-authored-by: Yiding Cui <winoros@gmail.com>
Co-authored-by: Chengpeng Yan <41809508+Reminiscent@users.noreply.github.com>
Co-authored-by: bestwoody <89765764+bestwoody@users.noreply.github.com>
Co-authored-by: Calvin Neo <CalvinNeo@users.noreply.github.com>
Co-authored-by: Lynn <zimu_xia@126.com>
Co-authored-by: Zhuhe Fang <fzhedu@gmail.com>
Co-authored-by: Mini256 <minianter@foxmail.com>
Co-authored-by: Xiang Zhang <angwerzx@126.com>
Co-authored-by: Yexiang Zhang <mornyx.z@gmail.com>
Co-authored-by: cfzjywxk <lsswxrxr@163.com>
Co-authored-by: db <39407623+IcePigZDB@users.noreply.github.com>
Co-authored-by: 山岚 <36239017+YuJuncen@users.noreply.github.com>
Co-authored-by: Yujie Xia <xiayjchn@gmail.com>
Co-authored-by: Yilong Li <liyilongko@gmail.com>
Co-authored-by: tuuuuuu <83738345+MiaoMiaoGarden@users.noreply.github.com>
Co-authored-by: qupeng <qupeng@pingcap.com>
Co-authored-by: you06 <you1474600@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-5.2 This bug affects 5.2.x versions. affects-5.3 This bug affects 5.3.x versions. severity/minor sig/planner SIG: Planner type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants