Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

store/tikv: Make RangeTaskRunner support dividing task by multiple regions #10482

Merged
merged 45 commits into from
Jun 20, 2019
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
45 commits
Select commit Hold shift + click to select a range
d938516
Finish range task runner
MyonKeminta May 6, 2019
9176d2c
Replace resolveLock's implementation
MyonKeminta May 7, 2019
65f0cc7
Set backoff
MyonKeminta May 7, 2019
85ace8e
Address comments; add test for task splitting
MyonKeminta May 7, 2019
6600a62
Remove unused constant
MyonKeminta May 7, 2019
53fec9b
Address comments; remove unnecessary ctx check
MyonKeminta May 8, 2019
53b37b9
Adjust code sequence; Add more assertions to tests
MyonKeminta May 8, 2019
b347983
Move subrange handling logic to handler
MyonKeminta May 8, 2019
7260a84
Add metrics
MyonKeminta May 8, 2019
cc9aa5e
Address comments
MyonKeminta May 8, 2019
a747bbb
Merge branch 'master' into misono/concurrent-resolve-lock
MyonKeminta May 8, 2019
881751e
Fix build
MyonKeminta May 8, 2019
55e8d6e
Add metrics for range task push duration
MyonKeminta May 8, 2019
58d74da
Address comments
MyonKeminta May 8, 2019
d208c2f
Address comments
MyonKeminta May 9, 2019
cae457f
Merge branch 'master' of https://github.com/pingcap/tidb into misono/…
MyonKeminta May 10, 2019
9b3e52b
Merge branch 'master' into misono/concurrent-resolve-lock
jackysp May 10, 2019
1d400b2
Support both auto and manual concurrency
MyonKeminta May 13, 2019
f125ed6
Merge branch 'misono/concurrent-resolve-lock' of https://github.com/M…
MyonKeminta May 13, 2019
4428231
* Update dependency PD
MyonKeminta May 14, 2019
3b27b58
Implement ScanRegions; Add BatchLoadRegions to region cache
MyonKeminta May 15, 2019
913072e
Fix import order
MyonKeminta May 15, 2019
f05e885
Merge branch 'misono/concurrent-resolve-lock' into misono/range-task-…
MyonKeminta May 15, 2019
5cc2139
RangeTaskRunner: Support dividing regions by multiple regions
MyonKeminta May 15, 2019
2196a63
Merge branch 'master' of https://github.com/pingcap/tidb into misono/…
MyonKeminta May 15, 2019
ccc27cd
Merge branch 'misono/concurrent-resolve-lock' into misono/range-task-…
MyonKeminta May 15, 2019
f1d3928
Remove configurable concurrency
MyonKeminta May 15, 2019
4d5debc
Fix return in wrong place...
MyonKeminta May 15, 2019
f203fb3
Merge branch 'misono/concurrent-resolve-lock' into misono/range-task-…
MyonKeminta May 15, 2019
c729309
Address comments
MyonKeminta May 16, 2019
0e43585
Merge branch 'misono/concurrent-resolve-lock' into misono/range-task-…
MyonKeminta May 16, 2019
a847836
Merge branch 'master' of https://github.com/pingcap/tidb into misono/…
MyonKeminta May 16, 2019
c627b12
Update PD to master
MyonKeminta May 18, 2019
5604dc3
Merge branch 'master' of https://github.com/pingcap/tidb into misono/…
MyonKeminta Jun 4, 2019
0c3d6cd
Fix scanRegions
MyonKeminta Jun 4, 2019
8b31e04
Merge branch 'master' of https://github.com/pingcap/tidb into misono/…
MyonKeminta Jun 18, 2019
72c3ab8
Set 1 region per task in TestRangeTaskError
MyonKeminta Jun 18, 2019
cb6d635
Address comments
MyonKeminta Jun 18, 2019
fb0880f
Merge branch 'master' into misono/range-task-multi-region
MyonKeminta Jun 18, 2019
9053d47
Address comments
MyonKeminta Jun 18, 2019
b15cbaa
Merge branch 'misono/range-task-multi-region' of https://github.com/M…
MyonKeminta Jun 18, 2019
fd3fffc
Merge branch 'master' of https://github.com/pingcap/tidb into misono/…
MyonKeminta Jun 19, 2019
e9c9cbd
Merge branch 'master' of https://github.com/pingcap/tidb into misono/…
MyonKeminta Jun 20, 2019
f33bfba
Merge branch 'master' into misono/range-task-multi-region
MyonKeminta Jun 20, 2019
ba5ceb0
Merge branch 'master' into misono/range-task-multi-region
zhangjinpeng87 Jun 20, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 2 additions & 17 deletions go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -3,39 +3,29 @@ module github.com/pingcap/tidb
require (
github.com/BurntSushi/toml v0.3.1
github.com/StackExchange/wmi v0.0.0-20180725035823-b12b22c5341f // indirect
github.com/beorn7/perks v0.0.0-20180321164747-3a771d992973 // indirect
github.com/blacktear23/go-proxyprotocol v0.0.0-20180807104634-af7a81e8dd0d
github.com/codahale/hdrhistogram v0.0.0-20161010025455-3a0bb77429bd // indirect
github.com/coreos/bbolt v1.3.3 // indirect
github.com/coreos/etcd v3.3.13+incompatible
github.com/coreos/go-semver v0.2.0 // indirect
github.com/coreos/go-systemd v0.0.0-20181031085051-9002847aa142 // indirect
github.com/coreos/pkg v0.0.0-20180928190104-399ea9e2e55f // indirect
github.com/cznic/mathutil v0.0.0-20181122101859-297441e03548
github.com/cznic/sortutil v0.0.0-20150617083342-4c7342852e65
github.com/dgrijalva/jwt-go v3.2.0+incompatible // indirect
github.com/dgryski/go-farm v0.0.0-20190104051053-3adb47b1fb0f
github.com/dustin/go-humanize v1.0.0 // indirect
github.com/eknkc/amber v0.0.0-20171010120322-cdade1c07385 // indirect
github.com/ghodss/yaml v1.0.1-0.20190212211648-25d852aebe32 // indirect
github.com/go-ole/go-ole v1.2.1 // indirect
github.com/go-sql-driver/mysql v0.0.0-20170715192408-3955978caca4
github.com/gogo/protobuf v1.2.0 // indirect
github.com/golang/groupcache v0.0.0-20181024230925-c65c006176ff // indirect
github.com/golang/protobuf v1.2.0
github.com/golang/snappy v0.0.0-20180518054509-2e65f85255db // indirect
github.com/google/btree v0.0.0-20180813153112-4030bb1f1f0c
github.com/google/uuid v1.1.1
github.com/gorilla/context v1.1.1 // indirect
github.com/gorilla/mux v1.6.2
github.com/gorilla/websocket v1.4.0 // indirect
github.com/grpc-ecosystem/go-grpc-middleware v1.0.1-0.20190118093823-f849b5445de4
github.com/grpc-ecosystem/go-grpc-prometheus v1.2.0 // indirect
github.com/grpc-ecosystem/grpc-gateway v1.5.1 // indirect
github.com/jonboulle/clockwork v0.1.0 // indirect
github.com/json-iterator/go v1.1.6 // indirect
github.com/klauspost/cpuid v0.0.0-20170728055534-ae7887de9fa5
github.com/kr/pretty v0.1.0 // indirect
github.com/matttproud/golang_protobuf_extensions v1.0.1 // indirect
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
github.com/modern-go/reflect2 v1.0.1 // indirect
Expand All @@ -49,13 +39,12 @@ require (
github.com/opentracing/opentracing-go v1.0.2
github.com/pingcap/check v0.0.0-20190102082844-67f458068fc8
github.com/pingcap/errors v0.11.4
github.com/pingcap/failpoint v0.0.0-20190422094118-d8535965f59b
github.com/pingcap/gofail v0.0.0-20181217135706-6a951c1e42c3 // indirect
github.com/pingcap/failpoint v0.0.0-20190512135322-30cc7431d99c
github.com/pingcap/goleveldb v0.0.0-20171020122428-b9ff6c35079e
github.com/pingcap/kvproto v0.0.0-20190619024611-a4759dfe3753
github.com/pingcap/log v0.0.0-20190307075452-bd41d9273596
github.com/pingcap/parser v0.0.0-20190612052718-3b36f86d9b7b
github.com/pingcap/pd v2.1.11+incompatible
github.com/pingcap/pd v0.0.0-20190617100349-293d4b5189bf
github.com/pingcap/tidb-tools v2.1.3-0.20190321065848-1e8b48f5c168+incompatible
github.com/pingcap/tipb v0.0.0-20190428032612-535e1abaa330
github.com/prometheus/client_golang v0.9.0
Expand All @@ -67,17 +56,14 @@ require (
github.com/shurcooL/httpfs v0.0.0-20171119174359-809beceb2371 // indirect
github.com/shurcooL/vfsgen v0.0.0-20181020040650-a97a25d856ca // indirect
github.com/sirupsen/logrus v1.2.0
github.com/soheilhy/cmux v0.1.4 // indirect
github.com/spaolacci/murmur3 v0.0.0-20180118202830-f09979ecbc72
github.com/struCoder/pidusage v0.1.2
github.com/tiancaiamao/appdash v0.0.0-20181126055449-889f96f722a2
github.com/tmc/grpc-websocket-proxy v0.0.0-20171017195756-830351dc03c6 // indirect
github.com/twinj/uuid v1.0.0
github.com/uber-go/atomic v1.3.2 // indirect
github.com/uber/jaeger-client-go v2.15.0+incompatible
github.com/uber/jaeger-lib v1.5.0 // indirect
github.com/unrolled/render v0.0.0-20180914162206-b9786414de4d // indirect
github.com/xiang90/probing v0.0.0-20190116061207-43a291ad63a2 // indirect
go.etcd.io/bbolt v1.3.3 // indirect
go.uber.org/atomic v1.3.2
go.uber.org/zap v1.9.1
Expand All @@ -88,7 +74,6 @@ require (
golang.org/x/tools v0.0.0-20190130214255-bb1329dc71a0
google.golang.org/genproto v0.0.0-20190108161440-ae2f86662275 // indirect
google.golang.org/grpc v1.17.0
gopkg.in/check.v1 v1.0.0-20180628173108-788fd7840127 // indirect
gopkg.in/natefinch/lumberjack.v2 v2.0.0
sourcegraph.com/sourcegraph/appdash v0.0.0-20180531100431-4c381bd170b4
sourcegraph.com/sourcegraph/appdash-data v0.0.0-20151005221446-73f23eafcf67
Expand Down
Loading