ticdc crash when inject pdleader network_partition

[Lily2025]

What did you do?

1、create changefeed
2、run workload tpcc with 1000 warehouse and 32 thread
3、inject pdleader network_partition last for 10m

What did you expect to see?

ticdc should not crash

What did you see instead?

ticdc crash

[2023/03/08 15:24:37.743 +08:00] [ERROR] [capture.go:285] ["reset capture failed"] [error="[CDC:ErrNewCaptureFailed]new capture failed: [CDC:ErrNewCaptureFailed]new capture failed: context deadline exceeded"] [errorVerbose="[CDC:ErrNewCaptureFailed]new capture failed: [CDC:ErrNewCaptureFailed]new capture failed: context deadline exceeded\ngit.luolix.top/pingcap/errors.AddStack\n\tgit.luolix.top/pingcap/errors@v0.11.5-0.20221009092201-b66cddb77c32/errors.go:174\ngit.luolix.top/pingcap/errors.(*Error).GenWithStackByArgs\n\tgit.luolix.top/pingcap/errors@v0.11.5-0.20221009092201-b66cddb77c32/normalize.go:164\ngit.luolix.top/pingcap/tiflow/pkg/errors.WrapError\n\tgit.luolix.top/pingcap/tiflow/pkg/errors/helper.go:34\ngit.luolix.top/pingcap/tiflow/cdc/capture.(*captureImpl).reset\n\tgit.luolix.top/pingcap/tiflow/cdc/capture/capture.go:194\ngit.luolix.top/pingcap/tiflow/cdc/capture.(*captureImpl).Run\n\tgit.luolix.top/pingcap/tiflow/cdc/capture/capture.go:283\ngit.luolix.top/pingcap/tiflow/cdc/server.(*server).run.func1\n\tgit.luolix.top/pingcap/tiflow/cdc/server/server.go:315\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.1.0/errgroup/errgroup.go:75\nruntime.goexit\n\truntime/asm_amd64.s:1598"]

Versions of the cluster

./cdc version
Release Version: v6.7.0-alpha
Git Commit Hash: f43dfb2
Git Branch: heads/refs/tags/v6.7.0-alpha
UTC Build Time: 2023-03-07 11:34:11
Go Version: go version go1.20.1 linux/amd64
Failpoint Build: false

current status of DM cluster (execute query-status <task-name> in dmctl)

(paste current status of DM cluster here)

[Lily2025]

/remove-area dm
/area ticdc

[fubinzh]

/severity critical

[nongfushanquan]

/assign @overvenus