Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tikv: fix wrong cherry-pick 3.0 #18292

Merged
merged 1 commit into from
Jul 1, 2020
Merged

tikv: fix wrong cherry-pick 3.0 #18292

merged 1 commit into from
Jul 1, 2020

Conversation

lysu
Copy link
Contributor

@lysu lysu commented Jun 30, 2020 •
edited
Loading

What problem does this PR solve?

Problem Summary:

CI failure in 3.0

PD server timeout%!(EXTRA string=start timestamp may fall behind safe point)

What is changed and how it works?

Proposal: xxx

What's Changed，How it Works:

revert https://github.com/pingcap/tidb/pull/17944/files#diff-7a4a1f349a05c777732cb147db848c12L59

Related changes

  • n/a

Check List

Tests

  • n/a

Side effects

  • n/a

Release note

  • No release note

This change is Reviewable

@lysu lysu added type/3.0-cherry-pick type/bugfix This PR fixes a bug. labels Jun 30, 2020
kennytm
kennytm approved these changes Jun 30, 2020
View reviewed changes
Copy link
Contributor

@kennytm kennytm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-srebot
Copy link
Contributor

@kennytm,Thanks for you review.

@kennytm
Copy link
Contributor

kennytm commented Jun 30, 2020

3 data races 
[2020-06-30T12:01:29.851Z] ==================
[2020-06-30T12:01:29.851Z] WARNING: DATA RACE
[2020-06-30T12:01:29.851Z] Write at 0x00c00728c648 by goroutine 415:
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/mvcc.(*keyIndex).put()
[2020-06-30T12:01:29.851Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:101 +0x1f6
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/mvcc.(*keyIndex).tombstone()
[2020-06-30T12:01:29.851Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:141 +0x2f0
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Tombstone()
[2020-06-30T12:01:29.851Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:151 +0x1e5
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).delete()
[2020-06-30T12:01:29.851Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:283 +0x3a1
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).deleteRange()
[2020-06-30T12:01:29.851Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:251 +0x1b7
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).DeleteRange()
[2020-06-30T12:01:29.851Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:90 +0x81
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/mvcc.(*metricsTxnWrite).DeleteRange()
[2020-06-30T12:01:29.851Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/metrics_txn.go:41 +0xe1
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/mvcc.(*watchableStoreTxnWrite).DeleteRange()
[2020-06-30T12:01:29.851Z]       <autogenerated>:1 +0xb1
[2020-06-30T12:01:29.851Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).DeleteRange()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:244 +0x248
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).applyTxn()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:539 +0x91d
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Txn()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:369 +0x309
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*quotaApplierV3).Txn()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:838 +0xab
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*authApplierV3).Txn()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply_auth.go:166 +0xec
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Apply()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:128 +0x68a
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*quotaApplierV3).Apply()
[2020-06-30T12:01:29.852Z]       <autogenerated>:1 +0x68
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*authApplierV3).Apply()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply_auth.go:58 +0x111
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyEntryNormal()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:2011 +0x5d8
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).apply()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1925 +0x792
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyEntries()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1349 +0x177
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyAll()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1075 +0x98
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).run.func8()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1020 +0x53
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/pkg/schedule.(*fifo).run()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/pkg/schedule/schedule.go:157 +0x11b
[2020-06-30T12:01:29.852Z] 
[2020-06-30T12:01:29.852Z] Previous read at 0x00c00728c648 by goroutine 64:
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*keyIndex).findGeneration()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:313 +0x153
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*keyIndex).get()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:160 +0x255
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Revisions.func1()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:116 +0xab
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*treeIndex).visit.func1()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:102 +0x8b
[2020-06-30T12:01:29.852Z]   github.com/google/btree.(*node).iterate()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/google/btree@v1.0.0/btree.go:524 +0x85e
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*treeIndex).visit()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/google/btree@v1.0.0/btree.go:768 +0x40f
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Revisions()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:115 +0x20d
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*storeTxnRead).rangeKeys()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:128 +0x377
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*storeTxnRead).Range()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:50 +0xe4
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*txnReadWrite).Range()
[2020-06-30T12:01:29.852Z]       <autogenerated>:1 +0xf4
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/mvcc.(*metricsTxnWrite).Range()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/metrics_txn.go:36 +0x12a
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Range()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:275 +0x325
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).Range.func3()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:104 +0x9d
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).doSerialize()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:554 +0xad
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).Range()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:105 +0x1f5
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.(*kvServer).Range()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/key.go:52 +0xb0
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.(*quotaKVServer).Range()
[2020-06-30T12:01:29.852Z]       <autogenerated>:1 +0x87
[2020-06-30T12:01:29.852Z]   go.etcd.io/etcd/etcdserver/etcdserverpb._KV_Range_Handler.func1()
[2020-06-30T12:01:29.852Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/etcdserverpb/rpc.pb.go:3473 +0xa1
[2020-06-30T12:01:29.852Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:31 +0x2d3
[2020-06-30T12:01:29.853Z]   github.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).UnaryServerInterceptor.func1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-prometheus@v1.2.0/server_metrics.go:107 +0xff
[2020-06-30T12:01:29.853Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:34 +0x1d9
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.newUnaryInterceptor.func1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/interceptor.go:60 +0x10c
[2020-06-30T12:01:29.853Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:34 +0x1d9
[2020-06-30T12:01:29.853Z] [2020/06/30 20:01:17.713 +08:00] [INFO] [ddl_worker.go:114] ["[ddl] DDL worker closed"] [worker="worker 3, tp general"] ["take time"=109.888µs]
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.newLogUnaryInterceptor.func1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/interceptor.go:67 +0xda
[2020-06-30T12:01:29.853Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:39 +0x33f
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/etcdserver/etcdserverpb._KV_Range_Handler()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/etcdserverpb/rpc.pb.go:3475 +0x1d8
[2020-06-30T12:01:29.853Z]   google.golang.org/grpc.(*Server).processUnaryRPC()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:966 +0x92f
[2020-06-30T12:01:29.853Z]   google.golang.org/grpc.(*Server).handleStream()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:1245 +0x132b
[2020-06-30T12:01:29.853Z]   google.golang.org/grpc.(*Server).serveStreams.func1.1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:685 +0xc8
[2020-06-30T12:01:29.853Z] 
[2020-06-30T12:01:29.853Z] Goroutine 415 (running) created at:
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/pkg/schedule.NewFIFOScheduler()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/pkg/schedule/schedule.go:70 +0x2b1
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).run()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:905 +0x327
[2020-06-30T12:01:29.853Z] 
[2020-06-30T12:01:29.853Z] Goroutine 64 (running) created at:
[2020-06-30T12:01:29.853Z]   google.golang.org/grpc.(*Server).serveStreams.func1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:683 +0xb8
[2020-06-30T12:01:29.853Z]   google.golang.org/grpc/internal/transport.(*http2Server).operateHeaders()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/internal/transport/http2_server.go:419 +0x14e2
[2020-06-30T12:01:29.853Z]   google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/internal/transport/http2_server.go:459 +0x39f
[2020-06-30T12:01:29.853Z]   google.golang.org/grpc.(*Server).serveStreams()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:681 +0x19a
[2020-06-30T12:01:29.853Z]   google.golang.org/grpc.(*Server).handleRawConn.func1()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:643 +0x50
[2020-06-30T12:01:29.853Z] ==================
[2020-06-30T12:01:29.853Z] ==================
[2020-06-30T12:01:29.853Z] WARNING: DATA RACE
[2020-06-30T12:01:29.853Z] Write at 0x00c00728c630 by goroutine 415:
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/mvcc.(*keyIndex).put()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:102 +0x275
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/mvcc.(*keyIndex).tombstone()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:141 +0x2f0
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Tombstone()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:151 +0x1e5
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).delete()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:283 +0x3a1
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).deleteRange()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:251 +0x1b7
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).DeleteRange()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:90 +0x81
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/mvcc.(*metricsTxnWrite).DeleteRange()
[2020-06-30T12:01:29.853Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/metrics_txn.go:41 +0xe1
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/mvcc.(*watchableStoreTxnWrite).DeleteRange()
[2020-06-30T12:01:29.853Z]       <autogenerated>:1 +0xb1
[2020-06-30T12:01:29.853Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).DeleteRange()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:244 +0x248
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).applyTxn()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:539 +0x91d
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Txn()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:369 +0x309
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*quotaApplierV3).Txn()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:838 +0xab
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*authApplierV3).Txn()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply_auth.go:166 +0xec
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Apply()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:128 +0x68a
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*quotaApplierV3).Apply()
[2020-06-30T12:01:29.854Z]       <autogenerated>:1 +0x68
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*authApplierV3).Apply()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply_auth.go:58 +0x111
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyEntryNormal()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:2011 +0x5d8
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).apply()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1925 +0x792
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyEntries()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1349 +0x177
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyAll()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1075 +0x98
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).run.func8()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1020 +0x53
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/pkg/schedule.(*fifo).run()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/pkg/schedule/schedule.go:157 +0x11b
[2020-06-30T12:01:29.854Z] 
[2020-06-30T12:01:29.854Z] Previous read at 0x00c00728c630 by goroutine 64:
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*keyIndex).get()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:167 +0x2f9
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Revisions.func1()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:116 +0xab
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*treeIndex).visit.func1()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:102 +0x8b
[2020-06-30T12:01:29.854Z]   github.com/google/btree.(*node).iterate()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/google/btree@v1.0.0/btree.go:524 +0x85e
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*treeIndex).visit()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/google/btree@v1.0.0/btree.go:768 +0x40f
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Revisions()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:115 +0x20d
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*storeTxnRead).rangeKeys()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:128 +0x377
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*storeTxnRead).Range()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:50 +0xe4
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*txnReadWrite).Range()
[2020-06-30T12:01:29.854Z]       <autogenerated>:1 +0xf4
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/mvcc.(*metricsTxnWrite).Range()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/metrics_txn.go:36 +0x12a
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Range()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:275 +0x325
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).Range.func3()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:104 +0x9d
[2020-06-30T12:01:29.854Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).doSerialize()
[2020-06-30T12:01:29.854Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:554 +0xad
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).Range()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:105 +0x1f5
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.(*kvServer).Range()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/key.go:52 +0xb0
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.(*quotaKVServer).Range()
[2020-06-30T12:01:29.855Z]       <autogenerated>:1 +0x87
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/etcdserver/etcdserverpb._KV_Range_Handler.func1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/etcdserverpb/rpc.pb.go:3473 +0xa1
[2020-06-30T12:01:29.855Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:31 +0x2d3
[2020-06-30T12:01:29.855Z]   github.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).UnaryServerInterceptor.func1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-prometheus@v1.2.0/server_metrics.go:107 +0xff
[2020-06-30T12:01:29.855Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:34 +0x1d9
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.newUnaryInterceptor.func1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/interceptor.go:60 +0x10c
[2020-06-30T12:01:29.855Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:34 +0x1d9
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.newLogUnaryInterceptor.func1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/interceptor.go:67 +0xda
[2020-06-30T12:01:29.855Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:39 +0x33f
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/etcdserver/etcdserverpb._KV_Range_Handler()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/etcdserverpb/rpc.pb.go:3475 +0x1d8
[2020-06-30T12:01:29.855Z]   google.golang.org/grpc.(*Server).processUnaryRPC()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:966 +0x92f
[2020-06-30T12:01:29.855Z]   google.golang.org/grpc.(*Server).handleStream()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:1245 +0x132b
[2020-06-30T12:01:29.855Z]   google.golang.org/grpc.(*Server).serveStreams.func1.1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:685 +0xc8
[2020-06-30T12:01:29.855Z] 
[2020-06-30T12:01:29.855Z] Goroutine 415 (running) created at:
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/pkg/schedule.NewFIFOScheduler()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/pkg/schedule/schedule.go:70 +0x2b1
[2020-06-30T12:01:29.855Z] [2020/06/30 20:01:17.713 +08:00] [INFO] [ddl_worker.go:114] ["[ddl] DDL worker closed"] [worker="worker 4, tp add index"] ["take time"=141.379µs]
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).run()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:905 +0x327
[2020-06-30T12:01:29.855Z] 
[2020-06-30T12:01:29.855Z] Goroutine 64 (running) created at:
[2020-06-30T12:01:29.855Z]   google.golang.org/grpc.(*Server).serveStreams.func1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:683 +0xb8
[2020-06-30T12:01:29.855Z]   google.golang.org/grpc/internal/transport.(*http2Server).operateHeaders()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/internal/transport/http2_server.go:419 +0x14e2
[2020-06-30T12:01:29.855Z]   google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/internal/transport/http2_server.go:459 +0x39f
[2020-06-30T12:01:29.855Z]   google.golang.org/grpc.(*Server).serveStreams()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:681 +0x19a
[2020-06-30T12:01:29.855Z]   google.golang.org/grpc.(*Server).handleRawConn.func1()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:643 +0x50
[2020-06-30T12:01:29.855Z] ==================
[2020-06-30T12:01:29.855Z] [2020/06/30 20:01:17.714 +08:00] [INFO] [ddl.go:523] ["[ddl] DDL closed"] [ID=50a0265a-ea73-495d-8069-69ca8b3bec82] ["take time"=5.288518ms]
[2020-06-30T12:01:29.855Z] ==================
[2020-06-30T12:01:29.855Z] WARNING: DATA RACE
[2020-06-30T12:01:29.855Z] Write at 0x00c000ccaa28 by goroutine 415:
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/mvcc.(*keyIndex).tombstone()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:142 +0x3aa
[2020-06-30T12:01:29.855Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Tombstone()
[2020-06-30T12:01:29.855Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:151 +0x1e5
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).delete()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:283 +0x3a1
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).deleteRange()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:251 +0x1b7
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/mvcc.(*storeTxnWrite).DeleteRange()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:90 +0x81
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/mvcc.(*metricsTxnWrite).DeleteRange()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/metrics_txn.go:41 +0xe1
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/mvcc.(*watchableStoreTxnWrite).DeleteRange()
[2020-06-30T12:01:29.856Z]       <autogenerated>:1 +0xb1
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).DeleteRange()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:244 +0x248
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).applyTxn()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:539 +0x91d
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Txn()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:369 +0x309
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*quotaApplierV3).Txn()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:838 +0xab
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*authApplierV3).Txn()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply_auth.go:166 +0xec
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Apply()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:128 +0x68a
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*quotaApplierV3).Apply()
[2020-06-30T12:01:29.856Z]       <autogenerated>:1 +0x68
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*authApplierV3).Apply()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply_auth.go:58 +0x111
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyEntryNormal()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:2011 +0x5d8
[2020-06-30T12:01:29.856Z] [2020/06/30 20:01:17.714 +08:00] [INFO] [manager.go:267] ["failed to campaign"] ["owner info"="[ddl] /tidb/ddl/fg/owner ownerManager 50a0265a-ea73-495d-8069-69ca8b3bec82"] [error="context canceled"]
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).apply()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1925 +0x792
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyEntries()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1349 +0x177
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).applyAll()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1075 +0x98
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).run.func8()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:1020 +0x53
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/pkg/schedule.(*fifo).run()
[2020-06-30T12:01:29.856Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/pkg/schedule/schedule.go:157 +0x11b
[2020-06-30T12:01:29.856Z] 
[2020-06-30T12:01:29.856Z] Previous read at 0x00c000ccaa28 by goroutine 64:
[2020-06-30T12:01:29.856Z]   go.etcd.io/etcd/mvcc.(*keyIndex).get()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/key_index.go:298 +0x61
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Revisions.func1()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:116 +0xab
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/mvcc.(*treeIndex).visit.func1()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:102 +0x8b
[2020-06-30T12:01:29.857Z]   github.com/google/btree.(*node).iterate()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/google/btree@v1.0.0/btree.go:524 +0x85e
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/mvcc.(*treeIndex).visit()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/google/btree@v1.0.0/btree.go:768 +0x40f
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/mvcc.(*treeIndex).Revisions()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/index.go:115 +0x20d
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/mvcc.(*storeTxnRead).rangeKeys()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:128 +0x377
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/mvcc.(*storeTxnRead).Range()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/kvstore_txn.go:50 +0xe4
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/mvcc.(*txnReadWrite).Range()
[2020-06-30T12:01:29.857Z]       <autogenerated>:1 +0xf4
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/mvcc.(*metricsTxnWrite).Range()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/mvcc/metrics_txn.go:36 +0x12a
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/etcdserver.(*applierV3backend).Range()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/apply.go:275 +0x325
[2020-06-30T12:01:29.857Z] [2020/06/30 20:01:17.714 +08:00] [INFO] [ddl.go:419] ["[ddl] stop DDL"] [ID=50a0265a-ea73-495d-8069-69ca8b3bec82]
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).Range.func3()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:104 +0x9d
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).doSerialize()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:554 +0xad
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).Range()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/v3_server.go:105 +0x1f5
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.(*kvServer).Range()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/key.go:52 +0xb0
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.(*quotaKVServer).Range()
[2020-06-30T12:01:29.857Z]       <autogenerated>:1 +0x87
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/etcdserver/etcdserverpb._KV_Range_Handler.func1()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/etcdserverpb/rpc.pb.go:3473 +0xa1
[2020-06-30T12:01:29.857Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:31 +0x2d3
[2020-06-30T12:01:29.857Z]   github.com/grpc-ecosystem/go-grpc-prometheus.(*ServerMetrics).UnaryServerInterceptor.func1()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-prometheus@v1.2.0/server_metrics.go:107 +0xff
[2020-06-30T12:01:29.857Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.857Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:34 +0x1d9
[2020-06-30T12:01:29.857Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.newUnaryInterceptor.func1()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/interceptor.go:60 +0x10c
[2020-06-30T12:01:29.858Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:34 +0x1d9
[2020-06-30T12:01:29.858Z]   go.etcd.io/etcd/etcdserver/api/v3rpc.newLogUnaryInterceptor.func1()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/api/v3rpc/interceptor.go:67 +0xda
[2020-06-30T12:01:29.858Z]   github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/github.com/grpc-ecosystem/go-grpc-middleware@v1.0.1-0.20190118093823-f849b5445de4/chain.go:39 +0x33f
[2020-06-30T12:01:29.858Z]   go.etcd.io/etcd/etcdserver/etcdserverpb._KV_Range_Handler()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/etcdserverpb/rpc.pb.go:3475 +0x1d8
[2020-06-30T12:01:29.858Z]   google.golang.org/grpc.(*Server).processUnaryRPC()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:966 +0x92f
[2020-06-30T12:01:29.858Z]   google.golang.org/grpc.(*Server).handleStream()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:1245 +0x132b
[2020-06-30T12:01:29.858Z]   google.golang.org/grpc.(*Server).serveStreams.func1.1()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:685 +0xc8
[2020-06-30T12:01:29.858Z] 
[2020-06-30T12:01:29.858Z] Goroutine 415 (running) created at:
[2020-06-30T12:01:29.858Z]   go.etcd.io/etcd/pkg/schedule.NewFIFOScheduler()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/pkg/schedule/schedule.go:70 +0x2b1
[2020-06-30T12:01:29.858Z]   go.etcd.io/etcd/etcdserver.(*EtcdServer).run()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/go.etcd.io/etcd@v0.0.0-20190320044326-77d4b742cdbf/etcdserver/server.go:905 +0x327
[2020-06-30T12:01:29.858Z] 
[2020-06-30T12:01:29.858Z] Goroutine 64 (finished) created at:
[2020-06-30T12:01:29.858Z]   google.golang.org/grpc.(*Server).serveStreams.func1()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:683 +0xb8
[2020-06-30T12:01:29.858Z]   google.golang.org/grpc/internal/transport.(*http2Server).operateHeaders()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/internal/transport/http2_server.go:419 +0x14e2
[2020-06-30T12:01:29.858Z]   google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/internal/transport/http2_server.go:459 +0x39f
[2020-06-30T12:01:29.858Z] [2020/06/30 20:01:17.714 +08:00] [INFO] [manager.go:239] ["etcd session is done, creates a new one"] ["owner info"="[ddl] /tidb/ddl/fg/owner ownerManager 50a0265a-ea73-495d-8069-69ca8b3bec82"]
[2020-06-30T12:01:29.858Z]   google.golang.org/grpc.(*Server).serveStreams()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:681 +0x19a
[2020-06-30T12:01:29.858Z]   google.golang.org/grpc.(*Server).handleRawConn.func1()
[2020-06-30T12:01:29.858Z]       /home/jenkins/agent/workspace/tidb_ghpr_unit_test/go/pkg/mod/google.golang.org/grpc@v1.17.0/server.go:643 +0x50
[2020-06-30T12:01:29.858Z] ==================

@kennytm
Copy link
Contributor

kennytm commented Jun 30, 2020

/run-unit-test

jackysp
jackysp reviewed Jun 30, 2020
View reviewed changes
Copy link
Member

@jackysp jackysp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-srebot
Copy link
Contributor

@jackysp,Thanks for you review.

@ti-srebot
Copy link
Contributor

@jackysp, Thanks for your review, however we are sorry that your vote won't be count. You already give a LGTM to this PR

@jackysp
Copy link
Member

jackysp commented Jun 30, 2020

/merge

@ti-srebot
Copy link
Contributor

Sorry @jackysp, you don't have permission to trigger auto merge event on this branch.
The version releasement is in progress.

@lysu lysu requested a review from jackysp July 1, 2020 02:49
@jebter
Copy link

jebter commented Jul 1, 2020

/merge

@ti-srebot ti-srebot added the status/can-merge Indicates a PR has been approved by a committer. label Jul 1, 2020
@ti-srebot
Copy link
Contributor

/run-all-tests

HunDunDM
HunDunDM approved these changes Jul 1, 2020
View reviewed changes
Copy link
Contributor

@HunDunDM HunDunDM left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-srebot
Copy link
Contributor

@HunDunDM,Thanks for you review.

@ti-srebot ti-srebot merged commit 332f2d4 into pingcap:release-3.0 Jul 1, 2020
@HunDunDM
Copy link
Contributor

HunDunDM commented Jul 1, 2020

Related #17944

@lysu lysu added this to the v3.0.16 milestone Jul 1, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@HunDunDM HunDunDM HunDunDM approved these changes

@kennytm kennytm kennytm approved these changes

@coocood coocood Awaiting requested review from coocood

@cfzjywxk cfzjywxk Awaiting requested review from cfzjywxk

@imtbkcat imtbkcat Awaiting requested review from imtbkcat

@3pointer 3pointer Awaiting requested review from 3pointer

@jackysp jackysp Awaiting requested review from jackysp

Assignees
No one assigned
Labels
status/can-merge Indicates a PR has been approved by a committer. type/bugfix This PR fixes a bug. type/3.0-cherry-pick
Projects
None yet
Milestone
v3.0.16
Development

Successfully merging this pull request may close these issues.
6 participants
@lysu @ti-srebot @kennytm @jackysp @jebter @HunDunDM