etcd@host01:/tmp/test-ssletcd --config-file initial-test-auto-ssl.yml 2>&1 | grep -v 'v3rpc/grpc: transport: http2Client.notifyError got notified' 2016-12-06 17:28:03.528409 I | etcdmain: Loading server configuration from "initial-test-auto-ssl.yml" 2016-12-06 17:28:03.529190 W | etcdmain: expected IP in URL for binding (https://host01.domain.yandex.net:2480) 2016-12-06 17:28:03.529219 W | etcdmain: expected IP in URL for binding (https://host01.domain.yandex.net:2479) 2016-12-06 17:28:03.529245 I | etcdmain: etcd Version: 3.0.15 2016-12-06 17:28:03.529260 I | etcdmain: Git SHA: GitNotFound 2016-12-06 17:28:03.529272 I | etcdmain: Go Version: go1.7.3 2016-12-06 17:28:03.529282 I | etcdmain: Go OS/Arch: linux/amd64 2016-12-06 17:28:03.529295 I | etcdmain: setting maximum number of CPUs to 32, total number of available CPUs is 32 2016-12-06 17:28:03.578524 I | etcdmain: peerTLS: cert = /var/lib/etcd/test-ssl-auto/fixtures/peer/cert.pem, key = /var/lib/etcd/test-ssl-auto/fixtures/peer/key.pem, ca = , trusted-ca = , client-cert-auth = false 2016-12-06 17:28:03.598455 I | etcdmain: listening for peers on https://host01.domain.yandex.net:2480 2016-12-06 17:28:03.639671 I | etcdmain: clientTLS: cert = /var/lib/etcd/test-ssl-auto/fixtures/client/cert.pem, key = /var/lib/etcd/test-ssl-auto/fixtures/client/key.pem, ca = , trusted-ca = , client-cert-auth = false 2016-12-06 17:28:03.661101 I | etcdmain: listening for client requests on host01.domain.yandex.net:2479 2016-12-06 17:28:03.661315 I | etcdmain: listening for client requests on localhost:2479 2016-12-06 17:28:03.686617 I | netutil: resolving host01.domain.yandex.net:2480 to [::fe6b:c0a8]:2480 2016-12-06 17:28:03.686670 I | netutil: resolving host01.domain.yandex.net:2480 to [::fe6b:c0a8]:2480 2016-12-06 17:28:03.706257 I | etcdserver: name = host01 2016-12-06 17:28:03.706277 I | etcdserver: data dir = /var/lib/etcd/test-ssl-auto 2016-12-06 17:28:03.706296 I | etcdserver: member dir = /var/lib/etcd/test-ssl-auto/member 2016-12-06 17:28:03.706303 I | etcdserver: heartbeat = 100ms 2016-12-06 17:28:03.706310 I | etcdserver: election = 1000ms 2016-12-06 17:28:03.706316 I | etcdserver: snapshot count = 10000 2016-12-06 17:28:03.706331 I | etcdserver: advertise client URLs = https://host01.domain.yandex.net:2479 2016-12-06 17:28:03.706340 I | etcdserver: initial advertise peer URLs = https://host01.domain.yandex.net:2480 2016-12-06 17:28:03.706375 I | etcdserver: initial cluster = host01=https://host01.domain.yandex.net:2480,host02=https://host02.domain.yandex.net:2480,host03=https://host03.domain.yandex.net:2480 2016-12-06 17:28:03.711636 I | etcdserver: starting member 89986b3e07c939dc in cluster ffff6fb75d331df5 2016-12-06 17:28:03.711741 I | raft: 89986b3e07c939dc became follower at term 0 2016-12-06 17:28:03.711774 I | raft: newRaft 89986b3e07c939dc [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0] 2016-12-06 17:28:03.711804 I | raft: 89986b3e07c939dc became follower at term 1 2016-12-06 17:28:03.778064 I | rafthttp: starting peer 6d46397fdc98d0fc... 2016-12-06 17:28:03.778146 I | rafthttp: started HTTP pipelining with peer 6d46397fdc98d0fc 2016-12-06 17:28:03.779286 I | rafthttp: started streaming with peer 6d46397fdc98d0fc (writer) 2016-12-06 17:28:03.781151 I | rafthttp: started streaming with peer 6d46397fdc98d0fc (writer) 2016-12-06 17:28:03.781782 I | rafthttp: started peer 6d46397fdc98d0fc 2016-12-06 17:28:03.781832 I | rafthttp: added peer 6d46397fdc98d0fc 2016-12-06 17:28:03.781857 I | rafthttp: started streaming with peer 6d46397fdc98d0fc (stream MsgApp v2 reader) 2016-12-06 17:28:03.781900 I | rafthttp: starting peer def2d01498537949... 2016-12-06 17:28:03.781944 I | rafthttp: started HTTP pipelining with peer def2d01498537949 2016-12-06 17:28:03.781954 I | rafthttp: started streaming with peer 6d46397fdc98d0fc (stream Message reader) 2016-12-06 17:28:03.782860 I | rafthttp: started streaming with peer def2d01498537949 (writer) 2016-12-06 17:28:03.783712 I | rafthttp: started streaming with peer def2d01498537949 (writer) 2016-12-06 17:28:03.786259 I | rafthttp: started peer def2d01498537949 2016-12-06 17:28:03.786290 I | rafthttp: added peer def2d01498537949 2016-12-06 17:28:03.786308 I | etcdserver: starting server... [version: 3.0.15, cluster version: to_be_decided] 2016-12-06 17:28:03.786340 I | rafthttp: started streaming with peer def2d01498537949 (stream Message reader) 2016-12-06 17:28:03.786389 I | rafthttp: started streaming with peer def2d01498537949 (stream MsgApp v2 reader) 2016-12-06 17:28:03.786814 I | membership: added member 6d46397fdc98d0fc [https://host02.domain.yandex.net:2480] to cluster ffff6fb75d331df5 2016-12-06 17:28:03.787059 I | membership: added member 89986b3e07c939dc [https://host01.domain.yandex.net:2480] to cluster ffff6fb75d331df5 2016-12-06 17:28:03.787192 I | membership: added member def2d01498537949 [https://host03.domain.yandex.net:2480] to cluster ffff6fb75d331df5 2016-12-06 17:28:04.412169 I | raft: 89986b3e07c939dc is starting a new election at term 1 2016-12-06 17:28:04.412212 I | raft: 89986b3e07c939dc became candidate at term 2 2016-12-06 17:28:04.412250 I | raft: 89986b3e07c939dc received vote from 89986b3e07c939dc at term 2 2016-12-06 17:28:04.412262 I | raft: 89986b3e07c939dc [logterm: 1, index: 3] sent vote request to def2d01498537949 at term 2 2016-12-06 17:28:04.412272 I | raft: 89986b3e07c939dc [logterm: 1, index: 3] sent vote request to 6d46397fdc98d0fc at term 2 2016-12-06 17:28:05.735357 I | rafthttp: peer 6d46397fdc98d0fc became active 2016-12-06 17:28:05.735387 I | rafthttp: established a TCP streaming connection with peer 6d46397fdc98d0fc (stream Message writer) 2016-12-06 17:28:05.735675 I | rafthttp: established a TCP streaming connection with peer 6d46397fdc98d0fc (stream MsgApp v2 writer) 2016-12-06 17:28:05.741827 I | rafthttp: established a TCP streaming connection with peer 6d46397fdc98d0fc (stream MsgApp v2 reader) 2016-12-06 17:28:05.744701 I | rafthttp: established a TCP streaming connection with peer 6d46397fdc98d0fc (stream Message reader) 2016-12-06 17:28:05.758297 I | raft: 89986b3e07c939dc [logterm: 1, index: 3, vote: 89986b3e07c939dc] rejected vote from 6d46397fdc98d0fc [logterm: 1, index: 3] at term 2 2016-12-06 17:28:06.212133 I | raft: 89986b3e07c939dc is starting a new election at term 2 2016-12-06 17:28:06.212182 I | raft: 89986b3e07c939dc became candidate at term 3 2016-12-06 17:28:06.212195 I | raft: 89986b3e07c939dc received vote from 89986b3e07c939dc at term 3 2016-12-06 17:28:06.212211 I | raft: 89986b3e07c939dc [logterm: 1, index: 3] sent vote request to 6d46397fdc98d0fc at term 3 2016-12-06 17:28:06.212226 I | raft: 89986b3e07c939dc [logterm: 1, index: 3] sent vote request to def2d01498537949 at term 3 2016-12-06 17:28:06.216994 I | raft: 89986b3e07c939dc received vote from 6d46397fdc98d0fc at term 3 2016-12-06 17:28:06.217028 I | raft: 89986b3e07c939dc [quorum:2] has received 2 votes and 0 vote rejections 2016-12-06 17:28:06.217071 I | raft: 89986b3e07c939dc became leader at term 3 2016-12-06 17:28:06.217114 I | raft: raft.node: 89986b3e07c939dc elected leader 89986b3e07c939dc at term 3 2016-12-06 17:28:06.221782 I | etcdserver: published {Name:host01 ClientURLs:[https://host01.domain.yandex.net:2479]} to cluster ffff6fb75d331df5 2016-12-06 17:28:06.221806 I | etcdmain: ready to serve client requests 2016-12-06 17:28:06.221873 I | etcdmain: ready to serve client requests 2016-12-06 17:28:06.222186 I | etcdmain: serving client requests on host01.domain.yandex.net:2479 2016-12-06 17:28:06.222531 I | etcdmain: serving client requests on localhost:2479 2016-12-06 17:28:06.357495 W | etcdserver: failed to reach the peerURL(https://host03.domain.yandex.net:2480) of member def2d01498537949 (Get https://host03.domain.yandex.net:2480/version: dial tcp [::fe6b:986a]:2480: getsockopt: connection refused) 2016-12-06 17:28:06.357527 W | etcdserver: cannot get the version of member def2d01498537949 (Get https://host03.domain.yandex.net:2480/version: dial tcp [::fe6b:986a]:2480: getsockopt: connection refused) 2016-12-06 17:28:06.357578 I | etcdserver: setting up the initial cluster version to 2.3 2016-12-06 17:28:06.360552 N | membership: set the initial cluster version to 2.3 2016-12-06 17:28:06.360631 I | api: enabled capabilities for version 2.3 2016-12-06 17:28:07.123324 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp [::fe6b:c0a8]:49367->[::fe6b:c0a8]:2479: write: broken pipe"; Reconnecting to {"[::fe6b:c0a8]:2479" } 2016-12-06 17:28:07.410191 I | rafthttp: peer def2d01498537949 became active 2016-12-06 17:28:07.410274 I | rafthttp: established a TCP streaming connection with peer def2d01498537949 (stream Message writer) 2016-12-06 17:28:07.413590 I | rafthttp: established a TCP streaming connection with peer def2d01498537949 (stream MsgApp v2 writer) 2016-12-06 17:28:07.425952 I | rafthttp: established a TCP streaming connection with peer def2d01498537949 (stream Message reader) 2016-12-06 17:28:07.435041 I | rafthttp: established a TCP streaming connection with peer def2d01498537949 (stream MsgApp v2 reader) 2016-12-06 17:28:09.239560 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp 127.0.0.1:59378->127.0.0.1:2479: write: broken pipe"; Reconnecting to {"127.0.0.1:2479" } 2016-12-06 17:28:10.444719 I | etcdserver: updating the cluster version from 2.3 to 3.0 2016-12-06 17:28:10.449808 N | membership: updated the cluster version from 2.3 to 3.0 2016-12-06 17:28:10.449888 I | api: enabled capabilities for version 3.0 ^Cetcd@host01:/tmp/test-ssl$ cat existing-test-auto-ssl.yml name: host01 data-dir: /var/lib/etcd/test-ssl-auto listen-peer-urls: https://host01.domain.yandex.net:2480 listen-client-urls: https://host01.domain.yandex.net:2479,https://localhost:2479 initial-advertise-peer-urls: https://host01.domain.yandex.net:2480 initial-cluster: host01=https://host01.domain.yandex.net:2480,host02=https://host02.domain.yandex.net:2480,host03=https://host03.domain.yandex.net:2480 initial-cluster-state: existing initial-cluster-token: test-ssl advertise-client-urls: https://host01.domain.yandex.net:2479 client-transport-security: auto-tls: true peer-transport-security: auto-tls: true client-cert-auth: false etcd@host01:/tmp/test-ssl$ etcd --config-file existing-test-auto-ssl.yml 2>&1 | grep -v 'v3rpc/grpc: transport: http2Client.notifyError got notified' 2016-12-06 17:30:37.605655 I | etcdmain: Loading server configuration from "existing-test-auto-ssl.yml" 2016-12-06 17:30:37.606379 W | etcdmain: expected IP in URL for binding (https://host01.domain.yandex.net:2480) 2016-12-06 17:30:37.606402 W | etcdmain: expected IP in URL for binding (https://host01.domain.yandex.net:2479) 2016-12-06 17:30:37.606417 I | etcdmain: etcd Version: 3.0.15 2016-12-06 17:30:37.606424 I | etcdmain: Git SHA: GitNotFound 2016-12-06 17:30:37.606430 I | etcdmain: Go Version: go1.7.3 2016-12-06 17:30:37.606436 I | etcdmain: Go OS/Arch: linux/amd64 2016-12-06 17:30:37.606444 I | etcdmain: setting maximum number of CPUs to 32, total number of available CPUs is 32 2016-12-06 17:30:37.606499 W | etcdmain: found invalid file/dir fixtures under data dir /var/lib/etcd/test-ssl-auto (Ignore this if you are upgrading etcd) 2016-12-06 17:30:37.606516 N | etcdmain: the server is already initialized as member before, starting as etcd member... 2016-12-06 17:30:37.606663 I | etcdmain: peerTLS: cert = /var/lib/etcd/test-ssl-auto/fixtures/peer/cert.pem, key = /var/lib/etcd/test-ssl-auto/fixtures/peer/key.pem, ca = , trusted-ca = , client-cert-auth = false 2016-12-06 17:30:37.639261 I | etcdmain: listening for peers on https://host01.domain.yandex.net:2480 2016-12-06 17:30:37.639506 I | etcdmain: clientTLS: cert = /var/lib/etcd/test-ssl-auto/fixtures/client/cert.pem, key = /var/lib/etcd/test-ssl-auto/fixtures/client/key.pem, ca = , trusted-ca = , client-cert-auth = false 2016-12-06 17:30:37.663073 I | etcdmain: listening for client requests on host01.domain.yandex.net:2479 2016-12-06 17:30:37.663309 I | etcdmain: listening for client requests on localhost:2479 2016-12-06 17:30:37.694280 I | etcdserver: name = host01 2016-12-06 17:30:37.694303 I | etcdserver: data dir = /var/lib/etcd/test-ssl-auto 2016-12-06 17:30:37.694313 I | etcdserver: member dir = /var/lib/etcd/test-ssl-auto/member 2016-12-06 17:30:37.694321 I | etcdserver: heartbeat = 100ms 2016-12-06 17:30:37.694328 I | etcdserver: election = 1000ms 2016-12-06 17:30:37.694334 I | etcdserver: snapshot count = 10000 2016-12-06 17:30:37.694354 I | etcdserver: advertise client URLs = https://host01.domain.yandex.net:2479 2016-12-06 17:30:37.697620 I | etcdserver: restarting member 89986b3e07c939dc in cluster ffff6fb75d331df5 at commit index 18 2016-12-06 17:30:37.697744 I | raft: 89986b3e07c939dc became follower at term 3 2016-12-06 17:30:37.697780 I | raft: newRaft 89986b3e07c939dc [peers: [], term: 3, commit: 18, applied: 0, lastindex: 19, lastterm: 3] 2016-12-06 17:30:37.747622 I | etcdserver: starting server... [version: 3.0.15, cluster version: to_be_decided] 2016-12-06 17:30:37.748197 I | membership: added member 6d46397fdc98d0fc [https://host02.domain.yandex.net:2480] to cluster ffff6fb75d331df5 2016-12-06 17:30:37.748238 I | rafthttp: starting peer 6d46397fdc98d0fc... 2016-12-06 17:30:37.748261 I | rafthttp: started HTTP pipelining with peer 6d46397fdc98d0fc 2016-12-06 17:30:37.750465 I | rafthttp: started streaming with peer 6d46397fdc98d0fc (writer) 2016-12-06 17:30:37.751982 I | rafthttp: started streaming with peer 6d46397fdc98d0fc (writer) 2016-12-06 17:30:37.752016 I | rafthttp: started peer 6d46397fdc98d0fc 2016-12-06 17:30:37.752037 I | rafthttp: started streaming with peer 6d46397fdc98d0fc (stream MsgApp v2 reader) 2016-12-06 17:30:37.752054 I | rafthttp: added peer 6d46397fdc98d0fc 2016-12-06 17:30:37.752114 I | rafthttp: started streaming with peer 6d46397fdc98d0fc (stream Message reader) 2016-12-06 17:30:37.752241 I | membership: added member 89986b3e07c939dc [https://host01.domain.yandex.net:2480] to cluster ffff6fb75d331df5 2016-12-06 17:30:37.752394 I | membership: added member def2d01498537949 [https://host03.domain.yandex.net:2480] to cluster ffff6fb75d331df5 2016-12-06 17:30:37.752430 I | rafthttp: starting peer def2d01498537949... 2016-12-06 17:30:37.752478 I | rafthttp: started HTTP pipelining with peer def2d01498537949 2016-12-06 17:30:37.754024 I | rafthttp: started streaming with peer def2d01498537949 (writer) 2016-12-06 17:30:37.754293 I | rafthttp: started streaming with peer def2d01498537949 (writer) 2016-12-06 17:30:37.754691 I | rafthttp: started peer def2d01498537949 2016-12-06 17:30:37.754737 I | rafthttp: added peer def2d01498537949 2016-12-06 17:30:37.754755 I | rafthttp: started streaming with peer def2d01498537949 (stream MsgApp v2 reader) 2016-12-06 17:30:37.754854 I | rafthttp: started streaming with peer def2d01498537949 (stream Message reader) 2016-12-06 17:30:37.755157 N | membership: set the initial cluster version to 2.3 2016-12-06 17:30:37.755280 I | api: enabled capabilities for version 2.3 2016-12-06 17:30:37.755563 N | membership: updated the cluster version from 2.3 to 3.0 2016-12-06 17:30:37.755739 I | api: enabled capabilities for version 3.0 2016-12-06 17:30:37.858218 I | rafthttp: peer def2d01498537949 became active 2016-12-06 17:30:37.858243 I | rafthttp: established a TCP streaming connection with peer def2d01498537949 (stream MsgApp v2 reader) 2016-12-06 17:30:37.862344 I | rafthttp: established a TCP streaming connection with peer def2d01498537949 (stream Message reader) 2016-12-06 17:30:37.865164 I | rafthttp: peer 6d46397fdc98d0fc became active 2016-12-06 17:30:37.865192 I | rafthttp: established a TCP streaming connection with peer 6d46397fdc98d0fc (stream Message reader) 2016-12-06 17:30:37.871414 I | rafthttp: established a TCP streaming connection with peer 6d46397fdc98d0fc (stream MsgApp v2 reader) 2016-12-06 17:30:37.883352 I | rafthttp: established a TCP streaming connection with peer def2d01498537949 (stream Message writer) 2016-12-06 17:30:37.888695 I | rafthttp: established a TCP streaming connection with peer def2d01498537949 (stream MsgApp v2 writer) 2016-12-06 17:30:37.904275 I | rafthttp: established a TCP streaming connection with peer 6d46397fdc98d0fc (stream MsgApp v2 writer) 2016-12-06 17:30:37.904482 I | raft: 89986b3e07c939dc [term: 3] received a MsgHeartbeat message with higher term from 6d46397fdc98d0fc [term: 7] 2016-12-06 17:30:37.904519 I | raft: 89986b3e07c939dc became follower at term 7 2016-12-06 17:30:37.904568 I | raft: raft.node: 89986b3e07c939dc elected leader 6d46397fdc98d0fc at term 7 2016-12-06 17:30:37.912031 I | rafthttp: established a TCP streaming connection with peer 6d46397fdc98d0fc (stream Message writer) 2016-12-06 17:30:37.994093 I | etcdmain: ready to serve client requests 2016-12-06 17:30:37.994154 I | etcdserver: published {Name:host01 ClientURLs:[https://host01.domain.yandex.net:2479]} to cluster ffff6fb75d331df5 2016-12-06 17:30:37.994193 I | etcdmain: ready to serve client requests 2016-12-06 17:30:37.994690 I | etcdmain: serving client requests on host01.domain.yandex.net:2479 2016-12-06 17:30:37.994712 I | etcdmain: serving client requests on localhost:2479 2016-12-06 17:30:43.669804 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp [::fe6b:c0a8]:48827->[::fe6b:c0a8]:2479: write: broken pipe"; Reconnecting to {"[::fe6b:c0a8]:2479" } 2016-12-06 17:30:52.223284 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp [::fe6b:c0a8]:53015->[::fe6b:c0a8]:2479: write: broken pipe"; Reconnecting to {"[::fe6b:c0a8]:2479" } 2016-12-06 17:30:52.250603 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp 127.0.0.1:40990->127.0.0.1:2479: write: broken pipe"; Reconnecting to {"127.0.0.1:2479" } 2016-12-06 17:30:57.152445 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp 127.0.0.1:43454->127.0.0.1:2479: write: broken pipe"; Reconnecting to {"127.0.0.1:2479" } 2016-12-06 17:31:00.925726 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp 127.0.0.1:45297->127.0.0.1:2479: write: connection reset by peer"; Reconnecting to {"127.0.0.1:2479" } 2016-12-06 17:31:03.285246 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp [::fe6b:c0a8]:58503->[::fe6b:c0a8]:2479: write: broken pipe"; Reconnecting to {"[::fe6b:c0a8]:2479" } 2016-12-06 17:31:08.721725 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp 127.0.0.1:49096->127.0.0.1:2479: write: broken pipe"; Reconnecting to {"127.0.0.1:2479" } 2016-12-06 17:31:13.385386 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp [::fe6b:c0a8]:42359->[::fe6b:c0a8]:2479: write: broken pipe"; Reconnecting to {"[::fe6b:c0a8]:2479" } 2016-12-06 17:31:15.532682 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp [::fe6b:c0a8]:43470->[::fe6b:c0a8]:2479: write: broken pipe"; Reconnecting to {"[::fe6b:c0a8]:2479" } 2016-12-06 17:31:16.603094 I | v3rpc/grpc: grpc: addrConn.resetTransport failed to create client transport: connection error: desc = "transport: write tcp 127.0.0.1:52999->127.0.0.1:2479: write: broken pipe"; Reconnecting to {"127.0.0.1:2479" } ^C