Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

kube-router not working as expected #93

Closed
felipejfc opened this issue Aug 2, 2017 · 9 comments · Fixed by #101
Closed

kube-router not working as expected #93

felipejfc opened this issue Aug 2, 2017 · 9 comments · Fixed by #101
Labels
bug

Comments

@felipejfc
Copy link

I have a scenario where I have 19 nodes, running like 900 pods + 900 services, a service per pod, I'm tying kube-router and I've realised that some of the services (type nodeport) are not working, I can telnet to pods directly but not through the service:

Name:			tan-07cdbae3
Namespace:		tan
Labels:			name=tan-07cdbae3
Annotations:		<none>
Selector:		app=tan-07cdbae3
Type:			NodePort
IP:			100.64.100.200
Port:			pom-port	30000/TCP
NodePort:		pom-port	32678/TCP
Endpoints:		100.96.11.53:30000
Port:			room-port	10000/UDP
NodePort:		room-port	31135/UDP
Endpoints:		100.96.11.53:10000
Session Affinity:	None
Events:			<none>

$ telnet tan-07cdbae3.tan 30000
Trying 100.64.100.200...
^C

$ telnet 100.96.11.53 30000
Trying 100.96.11.53...
Connected to 100.96.11.53.
Escape character is '^]'.

As a side-effect I cant access the service through the nodeports.

This is not the only case that is not working as expected, in another cases, I can access a svc type NodePort from some nodes but in others the port is closed...

I really would like to use kube-router in production as it fits my need for performance and low overhead, but unfortunately, with this kind of instability it's impossible.

Any hints @murali-reddy ?

Thanks
@felipejfc felipejfc changed the title kube-router now working as expected kube-router not working as expected Aug 2, 2017
@felipejfc
Copy link
Author

felipejfc commented Aug 2, 2017 •
edited
Loading

maybe related to #57?

the service was really not created:

$ sudo ipvsadm
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port Scheduler Flags
  -> RemoteAddress:Port           Forward Weight ActiveConn InActConn
TCP  100.64.0.1:https rr persistent 10800 mask 0.0.0.0
  -> ip-172-17-58-162.eu-central- Masq    1      0          0
TCP  100.64.0.10:domain rr
  -> 100.96.1.136:domain          Masq    1      0          0
  -> 100.96.2.252:domain          Masq    1      0          0
TCP  100.64.6.18:30000 rr
  -> 100.96.2.43:30000            Masq    1      0          0
TCP  100.64.28.235:30000 rr
  -> 100.96.3.10:30000            Masq    1      0          0
TCP  100.64.37.237:30000 rr
  -> 100.96.1.176:30000           Masq    1      0          0
TCP  100.64.50.211:30000 rr
  -> 100.96.1.165:30000           Masq    1      0          0
TCP  100.64.77.99:http rr
  -> 100.96.1.135:http            Masq    1      0          0
  -> 100.96.2.251:http            Masq    1      0          0
TCP  100.64.77.99:https rr
  -> 100.96.1.135:https           Masq    1      0          0
  -> 100.96.2.251:https           Masq    1      0          0
TCP  100.64.100.219:30000 rr
  -> 100.96.3.12:30000            Masq    1      0          0
TCP  100.64.105.96:30000 rr
TCP  100.64.136.217:30000 rr
  -> 100.96.2.42:30000            Masq    1      0          0
TCP  100.64.137.171:30000 rr
  -> 100.96.4.8:30000             Masq    1      0          0
TCP  100.64.140.162:30000 rr
  -> 100.96.4.15:30000            Masq    1      0          0
TCP  100.64.141.52:http rr
  -> 100.96.2.254:http-alt        Masq    1      0          0
TCP  100.64.187.56:30000 rr
  -> 100.96.2.40:30000            Masq    1      0          0
TCP  100.64.191.101:30000 rr
  -> 100.96.1.172:30000           Masq    1      0          0
TCP  100.64.211.1:30000 rr
  -> 100.96.3.20:30000            Masq    1      0          0
TCP  100.64.212.73:30000 rr
  -> 100.96.2.48:30000            Masq    1      0          0
TCP  100.64.219.117:30000 rr
  -> 100.96.3.22:30000            Masq    1      0          0
TCP  100.65.28.206:30000 rr
  -> 100.96.3.15:30000            Masq    1      0          0
TCP  100.65.41.42:30000 rr
TCP  100.65.45.213:30000 rr
  -> 100.96.2.45:30000            Masq    1      0          0
TCP  100.65.67.233:30000 rr
  -> 100.96.1.182:30000           Masq    1      0          0
TCP  100.65.79.214:30000 rr
TCP  100.65.94.27:30000 rr
  -> 100.96.1.174:30000           Masq    1      0          0
TCP  100.65.119.56:30000 rr
  -> 100.96.4.20:30000            Masq    1      0          0
TCP  100.65.192.94:30000 rr
TCP  100.65.202.83:30000 rr
  -> 100.96.3.8:30000             Masq    1      0          0
TCP  100.65.207.100:30000 rr
  -> 100.96.1.179:30000           Masq    1      0          0
TCP  100.65.225.78:30000 rr
  -> 100.96.2.31:30000            Masq    1      0          0
TCP  100.65.240.219:30000 rr
TCP  100.66.27.214:30000 rr
TCP  100.66.65.198:30000 rr
TCP  100.66.69.119:30000 rr
TCP  100.66.93.194:30000 rr
  -> 100.96.4.16:30000            Masq    1      0          0
TCP  100.66.97.127:30000 rr
  -> 100.96.4.11:30000            Masq    1      0          0
TCP  100.66.108.120:30000 rr
  -> 100.96.3.26:30000            Masq    1      0          0
TCP  100.66.112.135:30000 rr
  -> 100.96.4.3:30000             Masq    1      0          0
TCP  100.66.116.117:30000 rr
  -> 100.96.2.37:30000            Masq    1      0          0
TCP  100.66.126.142:30000 rr
  -> 100.96.1.167:30000           Masq    1      0          0
TCP  100.66.136.169:30000 rr
  -> 100.96.3.9:30000             Masq    1      0          0
TCP  100.66.145.46:30000 rr
  -> 100.96.2.44:30000            Masq    1      0          0
TCP  100.66.156.216:30000 rr
  -> 100.96.1.173:30000           Masq    1      0          0
TCP  100.66.184.46:30000 rr
  -> 100.96.4.21:30000            Masq    1      0          0
TCP  100.66.201.139:30000 rr
  -> 100.96.4.23:30000            Masq    1      0          0
TCP  100.66.207.198:30000 rr
  -> 100.96.3.23:30000            Masq    1      0          0
TCP  100.66.234.198:30000 rr
  -> 100.96.1.184:30000           Masq    1      0          0
TCP  100.66.252.99:30000 rr
  -> 100.96.4.6:30000             Masq    1      0          0
TCP  100.67.8.244:30000 rr
  -> 100.96.2.39:30000            Masq    1      0          0
TCP  100.67.39.90:44134 rr
  -> 100.96.2.2:44134             Masq    1      0          0
TCP  100.67.59.163:30000 rr
  -> 100.96.1.177:30000           Masq    1      0          0
TCP  100.67.64.106:30000 rr
  -> 100.96.3.7:30000             Masq    1      0          0
TCP  100.67.70.231:30000 rr
  -> 100.96.4.7:30000             Masq    1      0          0
TCP  100.67.78.128:30000 rr
  -> 100.96.1.175:30000           Masq    1      0          0
TCP  100.67.141.38:30000 rr
TCP  100.67.165.225:30000 rr
  -> 100.96.3.13:30000            Masq    1      0          0
TCP  100.67.179.185:30000 rr
  -> 100.96.4.25:30000            Masq    1      0          0
TCP  100.67.191.216:30000 rr
  -> 100.96.2.30:30000            Masq    1      0          0
TCP  100.67.198.148:30000 rr
  -> 100.96.1.170:30000           Masq    1      0          0
TCP  100.67.221.212:30000 rr
TCP  100.67.224.215:30000 rr
  -> 100.96.3.6:30000             Masq    1      0          0
TCP  100.67.246.124:30000 rr
  -> 100.96.3.25:30000            Masq    1      0          0
TCP  100.68.18.83:30000 rr
TCP  100.68.20.246:30000 rr
  -> 100.96.1.178:30000           Masq    1      0          0
TCP  100.68.48.4:30000 rr
  -> 100.96.3.18:30000            Masq    1      0          0
TCP  100.68.56.12:30000 rr
  -> 100.96.3.19:30000            Masq    1      0          0
TCP  100.68.58.108:30000 rr
TCP  100.68.75.245:30000 rr
  -> 100.96.4.10:30000            Masq    1      0          0
TCP  100.68.86.67:30000 rr
TCP  100.68.118.75:30000 rr
  -> 100.96.2.49:30000            Masq    1      0          0
TCP  100.68.122.25:30000 rr
  -> 100.96.1.168:30000           Masq    1      0          0
TCP  100.68.134.148:30000 rr
TCP  100.68.169.252:30000 rr
  -> 100.96.3.21:30000            Masq    1      0          0
TCP  100.68.175.220:30000 rr
TCP  100.68.200.90:30000 rr
  -> 100.96.4.19:30000            Masq    1      0          0
TCP  100.68.201.100:30000 rr
  -> 100.96.2.38:30000            Masq    1      0          0
TCP  100.68.245.202:30000 rr
  -> 100.96.4.4:30000             Masq    1      0          0
TCP  100.69.5.145:30000 rr
  -> 100.96.3.4:30000             Masq    1      0          0
TCP  100.69.27.46:30000 rr
TCP  100.69.53.215:30000 rr
  -> 100.96.3.5:30000             Masq    1      0          0
TCP  100.69.66.228:30000 rr
  -> 100.96.1.164:30000           Masq    1      0          0
TCP  100.69.99.191:30000 rr
  -> 100.96.2.47:30000            Masq    1      0          0
TCP  100.69.107.80:30000 rr
  -> 100.96.1.183:30000           Masq    1      0          0
TCP  100.69.171.161:30000 rr
  -> 100.96.2.41:30000            Masq    1      0          0
TCP  100.69.195.155:30000 rr
  -> 100.96.3.24:30000            Masq    1      0          0
TCP  100.69.201.212:30000 rr
  -> 100.96.4.18:30000            Masq    1      0          0
TCP  100.69.207.43:30000 rr
  -> 100.96.2.33:30000            Masq    1      0          0
TCP  100.69.209.197:30000 rr
  -> 100.96.2.32:30000            Masq    1      0          0
TCP  100.69.212.132:30000 rr
  -> 100.96.4.14:30000            Masq    1      0          0
TCP  100.70.15.145:30000 rr
  -> 100.96.1.169:30000           Masq    1      0          0
TCP  100.70.64.63:30000 rr
  -> 100.96.2.46:30000            Masq    1      0          0
TCP  100.70.71.164:30000 rr
TCP  100.70.72.216:30000 rr
  -> 100.96.4.24:30000            Masq    1      0          0
TCP  100.70.89.17:30000 rr
  -> 100.96.1.171:30000           Masq    1      0          0
TCP  100.70.91.204:http rr
  -> 100.96.1.137:http            Masq    1      0          84
  -> 100.96.2.3:http              Masq    1      0          84
TCP  100.70.127.1:http-alt rr
  -> 100.96.2.16:http-alt         Masq    1      0          0
TCP  100.70.128.192:30000 rr
  -> 100.96.4.13:30000            Masq    1      0          0
TCP  100.70.137.181:30000 rr
  -> 100.96.3.14:30000            Masq    1      0          0
TCP  100.70.149.82:30000 rr
  -> 100.96.4.17:30000            Masq    1      0          0
TCP  100.70.210.252:30000 rr
  -> 100.96.1.181:30000           Masq    1      0          0
TCP  100.70.212.227:30000 rr
  -> 100.96.3.16:30000            Masq    1      0          0
TCP  100.70.225.1:30000 rr
TCP  100.70.240.201:30000 rr
  -> 100.96.1.163:30000           Masq    1      0          0
TCP  100.70.242.24:30000 rr
  -> 100.96.2.35:30000            Masq    1      0          0
TCP  100.71.21.225:30000 rr
  -> 100.96.4.5:30000             Masq    1      0          0
TCP  100.71.51.81:30000 rr
  -> 100.96.1.180:30000           Masq    1      0          0
TCP  100.71.66.6:30000 rr
  -> 100.96.3.11:30000            Masq    1      0          0
TCP  100.71.86.226:30000 rr
  -> 100.96.2.50:30000            Masq    1      0          0
TCP  100.71.92.165:30000 rr
  -> 100.96.4.22:30000            Masq    1      0          0
TCP  100.71.106.146:30000 rr
  -> 100.96.2.36:30000            Masq    1      0          0
TCP  100.71.114.47:30000 rr
  -> 100.96.4.12:30000            Masq    1      0          0
TCP  100.71.120.150:30000 rr
TCP  100.71.132.238:30000 rr
  -> 100.96.2.34:30000            Masq    1      0          0
TCP  100.71.226.143:30000 rr
  -> 100.96.1.166:30000           Masq    1      0          0
TCP  100.71.250.153:30000 rr
  -> 100.96.4.9:30000             Masq    1      0          0
TCP  100.71.254.78:30000 rr
  -> 100.96.3.3:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.178:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.135:https           Masq    1      0          0
  -> 100.96.2.251:https           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.30:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.5:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.36:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.13:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.135:http            Masq    1      0          12
  -> 100.96.2.251:http            Masq    1      0          12
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.9:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.8:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.14:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.39:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.20:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.17:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.31:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.172:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.163:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.16:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.43:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.15:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.9:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.14:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.22:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.26:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.164:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.40:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.21:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.16:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.49:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.21:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.165:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.184:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.19:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.11:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.4:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.24:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.6:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.174:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.12:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.176:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.25:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.11:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.4:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.168:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.181:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.173:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.182:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.180:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.6:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.170:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.19:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.37:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.47:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.167:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.8:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.183:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.22:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.7:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.177:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.3:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.18:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.18:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.5:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.33:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.44:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.166:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.48:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.23:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.171:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.45:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.46:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.23:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.41:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.179:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.25:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.12:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.7:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.32:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.10:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.34:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.3:30000             Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.175:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.13:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.50:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.42:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.10:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.35:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.38:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.20:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.24:30000            Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.169:30000           Masq    1      0          0
TCP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.15:30000            Masq    1      0          0
UDP  100.64.0.10:domain rr
  -> 100.96.1.136:domain          Masq    1      0          715
  -> 100.96.2.252:domain          Masq    1      0          717
UDP  100.64.6.18:10000 rr
  -> 100.96.2.43:10000            Masq    1      0          0
UDP  100.64.28.235:10000 rr
  -> 100.96.3.10:10000            Masq    1      0          0
UDP  100.64.37.237:10000 rr
  -> 100.96.1.176:10000           Masq    1      0          0
UDP  100.64.50.211:10000 rr
  -> 100.96.1.165:10000           Masq    1      0          0
UDP  100.64.100.219:10000 rr
  -> 100.96.3.12:10000            Masq    1      0          0
UDP  100.64.105.96:10000 rr
UDP  100.64.136.217:10000 rr
  -> 100.96.2.42:10000            Masq    1      0          0
UDP  100.64.137.171:10000 rr
  -> 100.96.4.8:10000             Masq    1      0          0
UDP  100.64.140.162:10000 rr
  -> 100.96.4.15:10000            Masq    1      0          0
UDP  100.64.187.56:10000 rr
  -> 100.96.2.40:10000            Masq    1      0          0
UDP  100.64.191.101:10000 rr
  -> 100.96.1.172:10000           Masq    1      0          0
UDP  100.64.211.1:10000 rr
  -> 100.96.3.20:10000            Masq    1      0          0
UDP  100.64.212.73:10000 rr
  -> 100.96.2.48:10000            Masq    1      0          0
UDP  100.64.219.117:10000 rr
  -> 100.96.3.22:10000            Masq    1      0          0
UDP  100.65.28.206:10000 rr
  -> 100.96.3.15:10000            Masq    1      0          0
UDP  100.65.41.42:10000 rr
UDP  100.65.45.213:10000 rr
  -> 100.96.2.45:10000            Masq    1      0          0
UDP  100.65.67.233:10000 rr
  -> 100.96.1.182:10000           Masq    1      0          0
UDP  100.65.79.214:10000 rr
UDP  100.65.94.27:10000 rr
  -> 100.96.1.174:10000           Masq    1      0          0
UDP  100.65.119.56:10000 rr
  -> 100.96.4.20:10000            Masq    1      0          0
UDP  100.65.192.94:10000 rr
UDP  100.65.202.83:10000 rr
  -> 100.96.3.8:10000             Masq    1      0          0
UDP  100.65.203.35:8125 rr
  -> 100.96.0.2:8125              Masq    1      0          0
  -> 100.96.1.15:8125             Masq    1      0          0
  -> 100.96.2.15:8125             Masq    1      0          0
  -> 100.96.3.2:8125              Masq    1      0          0
  -> 100.96.4.2:8125              Masq    1      0          0
  -> 100.96.5.2:8125              Masq    1      0          0
  -> 100.96.6.2:8125              Masq    1      0          0
  -> 100.96.7.2:8125              Masq    1      0          0
  -> 100.96.8.2:8125              Masq    1      0          0
  -> 100.96.9.2:8125              Masq    1      0          0
  -> 100.96.10.2:8125             Masq    1      0          0
  -> 100.96.11.2:8125             Masq    1      0          0
  -> 100.96.12.2:8125             Masq    1      0          0
  -> 100.96.13.2:8125             Masq    1      0          0
  -> 100.96.14.2:8125             Masq    1      0          0
  -> 100.96.15.2:8125             Masq    1      0          0
  -> 100.96.16.2:8125             Masq    1      0          0
  -> 100.96.17.2:8125             Masq    1      0          0
UDP  100.65.207.100:10000 rr
  -> 100.96.1.179:10000           Masq    1      0          0
UDP  100.65.225.78:10000 rr
  -> 100.96.2.31:10000            Masq    1      0          0
UDP  100.65.240.219:10000 rr
UDP  100.66.27.214:10000 rr
UDP  100.66.65.198:10000 rr
UDP  100.66.69.119:10000 rr
UDP  100.66.93.194:10000 rr
  -> 100.96.4.16:10000            Masq    1      0          0
UDP  100.66.97.127:10000 rr
  -> 100.96.4.11:10000            Masq    1      0          0
UDP  100.66.108.120:10000 rr
  -> 100.96.3.26:10000            Masq    1      0          0
UDP  100.66.112.135:10000 rr
  -> 100.96.4.3:10000             Masq    1      0          0
UDP  100.66.116.117:10000 rr
  -> 100.96.2.37:10000            Masq    1      0          0
UDP  100.66.126.142:10000 rr
  -> 100.96.1.167:10000           Masq    1      0          0
UDP  100.66.136.169:10000 rr
  -> 100.96.3.9:10000             Masq    1      0          0
UDP  100.66.145.46:10000 rr
  -> 100.96.2.44:10000            Masq    1      0          0
UDP  100.66.156.216:10000 rr
  -> 100.96.1.173:10000           Masq    1      0          0
UDP  100.66.184.46:10000 rr
  -> 100.96.4.21:10000            Masq    1      0          0
UDP  100.66.201.139:10000 rr
  -> 100.96.4.23:10000            Masq    1      0          0
UDP  100.66.207.198:10000 rr
  -> 100.96.3.23:10000            Masq    1      0          0
UDP  100.66.234.198:10000 rr
  -> 100.96.1.184:10000           Masq    1      0          0
UDP  100.66.252.99:10000 rr
  -> 100.96.4.6:10000             Masq    1      0          0
UDP  100.67.8.244:10000 rr
  -> 100.96.2.39:10000            Masq    1      0          0
UDP  100.67.59.163:10000 rr
  -> 100.96.1.177:10000           Masq    1      0          0
UDP  100.67.64.106:10000 rr
  -> 100.96.3.7:10000             Masq    1      0          0
UDP  100.67.70.231:10000 rr
  -> 100.96.4.7:10000             Masq    1      0          0
UDP  100.67.78.128:10000 rr
  -> 100.96.1.175:10000           Masq    1      0          0
UDP  100.67.141.38:10000 rr
UDP  100.67.165.225:10000 rr
  -> 100.96.3.13:10000            Masq    1      0          0
UDP  100.67.179.185:10000 rr
  -> 100.96.4.25:10000            Masq    1      0          0
UDP  100.67.191.216:10000 rr
  -> 100.96.2.30:10000            Masq    1      0          0
UDP  100.67.198.148:10000 rr
  -> 100.96.1.170:10000           Masq    1      0          0
UDP  100.67.221.212:10000 rr
UDP  100.67.224.215:10000 rr
  -> 100.96.3.6:10000             Masq    1      0          0
UDP  100.67.246.124:10000 rr
  -> 100.96.3.25:10000            Masq    1      0          0
UDP  100.68.6.32:7778 rr
  -> 100.96.1.6:7778              Masq    1      0          0
UDP  100.68.18.83:10000 rr
UDP  100.68.20.246:10000 rr
  -> 100.96.1.178:10000           Masq    1      0          0
UDP  100.68.48.4:10000 rr
  -> 100.96.3.18:10000            Masq    1      0          0
UDP  100.68.56.12:10000 rr
  -> 100.96.3.19:10000            Masq    1      0          0
UDP  100.68.58.108:10000 rr
UDP  100.68.75.245:10000 rr
  -> 100.96.4.10:10000            Masq    1      0          0
UDP  100.68.86.67:10000 rr
UDP  100.68.118.75:10000 rr
  -> 100.96.2.49:10000            Masq    1      0          0
UDP  100.68.122.25:10000 rr
  -> 100.96.1.168:10000           Masq    1      0          0
UDP  100.68.134.148:10000 rr
UDP  100.68.169.252:10000 rr
  -> 100.96.3.21:10000            Masq    1      0          0
UDP  100.68.175.220:10000 rr
UDP  100.68.200.90:10000 rr
  -> 100.96.4.19:10000            Masq    1      0          0
UDP  100.68.201.100:10000 rr
  -> 100.96.2.38:10000            Masq    1      0          0
UDP  100.68.245.202:10000 rr
  -> 100.96.4.4:10000             Masq    1      0          0
UDP  100.69.5.145:10000 rr
  -> 100.96.3.4:10000             Masq    1      0          0
UDP  100.69.27.46:10000 rr
UDP  100.69.53.215:10000 rr
  -> 100.96.3.5:10000             Masq    1      0          0
UDP  100.69.66.228:10000 rr
  -> 100.96.1.164:10000           Masq    1      0          0
UDP  100.69.99.191:10000 rr
  -> 100.96.2.47:10000            Masq    1      0          0
UDP  100.69.107.80:10000 rr
  -> 100.96.1.183:10000           Masq    1      0          0
UDP  100.69.171.161:10000 rr
  -> 100.96.2.41:10000            Masq    1      0          0
UDP  100.69.195.155:10000 rr
  -> 100.96.3.24:10000            Masq    1      0          0
UDP  100.69.201.212:10000 rr
  -> 100.96.4.18:10000            Masq    1      0          0
UDP  100.69.207.43:10000 rr
  -> 100.96.2.33:10000            Masq    1      0          0
UDP  100.69.209.197:10000 rr
  -> 100.96.2.32:10000            Masq    1      0          0
UDP  100.69.212.132:10000 rr
  -> 100.96.4.14:10000            Masq    1      0          0
UDP  100.70.15.145:10000 rr
  -> 100.96.1.169:10000           Masq    1      0          0
UDP  100.70.64.63:10000 rr
  -> 100.96.2.46:10000            Masq    1      0          0
UDP  100.70.71.164:10000 rr
UDP  100.70.72.216:10000 rr
  -> 100.96.4.24:10000            Masq    1      0          0
UDP  100.70.89.17:10000 rr
  -> 100.96.1.171:10000           Masq    1      0          0
UDP  100.70.128.192:10000 rr
  -> 100.96.4.13:10000            Masq    1      0          0
UDP  100.70.137.181:10000 rr
  -> 100.96.3.14:10000            Masq    1      0          0
UDP  100.70.149.82:10000 rr
  -> 100.96.4.17:10000            Masq    1      0          0
UDP  100.70.210.252:10000 rr
  -> 100.96.1.181:10000           Masq    1      0          0
UDP  100.70.212.227:10000 rr
  -> 100.96.3.16:10000            Masq    1      0          0
UDP  100.70.225.1:10000 rr
UDP  100.70.240.201:10000 rr
  -> 100.96.1.163:10000           Masq    1      0          0
UDP  100.70.242.24:10000 rr
  -> 100.96.2.35:10000            Masq    1      0          0
UDP  100.71.21.225:10000 rr
  -> 100.96.4.5:10000             Masq    1      0          0
UDP  100.71.51.81:10000 rr
  -> 100.96.1.180:10000           Masq    1      0          0
UDP  100.71.66.6:10000 rr
  -> 100.96.3.11:10000            Masq    1      0          0
UDP  100.71.86.226:10000 rr
  -> 100.96.2.50:10000            Masq    1      0          0
UDP  100.71.92.165:10000 rr
  -> 100.96.4.22:10000            Masq    1      0          0
UDP  100.71.106.146:10000 rr
  -> 100.96.2.36:10000            Masq    1      0          0
UDP  100.71.114.47:10000 rr
  -> 100.96.4.12:10000            Masq    1      0          0
UDP  100.71.120.150:10000 rr
UDP  100.71.132.238:10000 rr
  -> 100.96.2.34:10000            Masq    1      0          0
UDP  100.71.226.143:10000 rr
  -> 100.96.1.166:10000           Masq    1      0          0
UDP  100.71.250.153:10000 rr
  -> 100.96.4.9:10000             Masq    1      0          0
UDP  100.71.254.78:10000 rr
  -> 100.96.3.3:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.9:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.39:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.25:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.16:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.20:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.34:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.24:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.6:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.10:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.26:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.36:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.9:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.20:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.4:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.165:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.166:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.44:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.175:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.22:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.181:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.170:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.168:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.50:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.45:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.172:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.15:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.178:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.48:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.12:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.13:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.25:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.23:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.177:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.41:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.8:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.10:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.7:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.22:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.8:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.21:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.6:7778              Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.3:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.38:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.180:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.21:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.14:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.5:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.31:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.179:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.7:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.30:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.174:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.164:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.5:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.46:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.37:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.184:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.15:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.49:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.19:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.4:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.18:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.171:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.14:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.183:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.43:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.176:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.32:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.24:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.42:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.17:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.6:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.163:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.18:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.11:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.33:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.169:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.3.19:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.12:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.23:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.13:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.173:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.16:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.182:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.35:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.40:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.3:10000             Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.4.11:10000            Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.1.167:10000           Masq    1      0          0
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
UDP  ip-172-17-57-182.eu-central- rr
  -> 100.96.2.47:10000            Masq    1      0          0

Oh, I'm using latest version of kube-router

@murali-reddy
Copy link
Member

@felipejfc sorry about the issues you are running into. So far me and @bzub have been running Kubernetes e2e tests to catch the nagging bugs. Honestly we did not run the tests at the scale of yours. We would definitely attempt to run tests at scale ASAP to address any instability. We have been focussing on testing/CD to bring the project production grade reliability and stability before moving Beta release.

Coming to this bug, do you happen to see any errors in the kube-router logs, related service not getting created? I will attempt to reporduce the bug and share my findings.

@murali-reddy
Copy link
Member

murali-reddy commented Aug 2, 2017 •
edited
Loading

@felipejfc quick update

so wrote small script to test deploying large number of services. I am able to repro the problem

Network service controller thread in Kube-router dies due to fatal failure in nlgo library used by Kube-router. We have an issue #78 reported for this.

We recently updated dependent libraries, which forced us to update nlgo to latest version.

I am able to repro the issue at just 10 services.

So basically network service controller stops functioning due to nlgo's error genl hub loop exit

I will investigate further and run some scale tests and get back to you.

Redeploying the pod fixes the problem but need to make code resilient to nlgo failures.

@murali-reddy murali-reddy mentioned this issue Aug 2, 2017
Closed
@felipejfc
Copy link
Author

Nice @murali-reddy, if we can repro it then we can fix it :)
I'll be waiting for updates on this.

Thanks!!

@bzub bzub added the bug label Aug 3, 2017
@bzub bzub mentioned this issue Aug 4, 2017
Merged
@bzub
Copy link
Collaborator

bzub commented Aug 4, 2017

@felipejfc If possible, please test the cloudnativelabs/kube-router-git:PR101 container image. It should fix the issue. If you see log formatting bugs it is a known cosmetic issue at this time. Thanks!

@murali-reddy
Copy link
Member

@bzub thats wonderful.
I tested image with 1600 NodePort services deployed on 11 nodes cluster on AWS. They ran perfectly. Pleasse see PR for test results.

@bzub bzub closed this as completed in #101 Aug 4, 2017
@jsravn
Copy link

jsravn commented Apr 5, 2018 •
edited
Loading

I'm curious since I'm running into the same problem w/ libipvs in a separate project. Did you figure out the actual issue in libipvs?

@murali-reddy
Copy link
Member

@jsravn We hit this issue long time ago when kube-router was using https://github.com/mqliang/libipvs for IPVS, then we switched to docker/libnetwork. We never ran into this issue with docker/libnetwork.

@g0194776
Copy link

@murali-reddy

Can you give me a version of kube-router that had fixed this problem? (Including changed to libnetwork)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Use libnetwork/ipvs instead of libipvs cloudnativelabs/kube-router
5 participants
@felipejfc @jsravn @g0194776 @murali-reddy @bzub