dm-master: embed etcd in DM-master

[csuzhangxc]

What problem does this PR solve?

embed etcd in DM-master.

What is changed and how it works?

• add some config items in DM-master which needed by etcd
  • name: human-readable name for this DM-master member (default 'dm-master-${hostname}')
  • data-dir: path to the data directory (default 'default.${name}')
  • initial-cluster: initial cluster configuration for bootstrapping, e,g. 'dm-master=http://127.0.0.1:8291'
  • peer-urls: URLs for peer traffic (default 'http://127.0.0.1:8291')
  • advertise-peer-urls: advertise URLs for peer traffic (default '${peer-urls}')
• register gRPC API server, HTTP API server and status&debug HTTP server into embed etcd server.

NOTE: we use master-addr to generate listen-client-urls and advertise-client-urls now.

to reviewers:

• previously DM-master listening 8261 for clients request, now another port is needed for peers request. I use 8291 as the default peer port, do you think is it OK?
• this PR not support join a member to a existing cluster, and I'll add it in late PR
• this PR only embed etcd into DM-master, no leader election exists yet, and I'll add it in late PR
• this PR not handle etcd's log, and I'll handle it after ectd in tidb and tidb-tool upgraded

Check List

Tests

• Unit test
• Integration test

Code changes

• Has exported variable/fields change
• Has persistent data change

Side effects

• Possible performance regression
• Increased code complexity
• Breaking backward compatibility

Related changes

• Need to cherry-pick to the release branch
• Need to update the documentation
• Need to update the dm/dm-ansible
• Need to be included in the release note

[codecov]

Codecov Report

Merging #344 into master will decrease coverage by 0.0026%.
The diff coverage is 85.4961%.

@@               Coverage Diff                @@
##             master       #344        +/-   ##
================================================
- Coverage   57.6502%   57.6476%   -0.0027%     
================================================
  Files           159        159                
  Lines         16019      16018         -1     
================================================
- Hits           9235       9234         -1     
  Misses         5884       5884                
  Partials        900        900

[csuzhangxc]

@WangXiangUSTC @amyangfei PTAL

[csuzhangxc]

/run-all-tests

[csuzhangxc]

/run-all-tests

[WangXiangUSTC]

previously DM-master listening 8261 for clients request, now another port is needed for peers request. I use 8269 as the default peer port, do you think is it OK?

some users deploy dm-master and more than one dm-worker in one server, perhaps they use port like 8261, 8262, 8263 ...
how about use another port?

[csuzhangxc]

/run-all-tests

[WangXiangUSTC]

LGTM

[csuzhangxc]

@amyangfei PTAL. we are adding another integration test case Integration Test import_gorout…, and it should be failed in this PR, that's not a problem.

[amyangfei]

LGTM

[csuzhangxc]

/run-all-tests

[csuzhangxc]

/run-all-tests

[csuzhangxc]

/run-all-tests

[csuzhangxc]

/run-all-tests