Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v3: plugin discovery does not seem to register all found plugins #355

Closed
edaniszewski opened this issue Jan 30, 2020 · 2 comments
Closed

v3: plugin discovery does not seem to register all found plugins #355

edaniszewski opened this issue Jan 30, 2020 · 2 comments

Comments

@edaniszewski
Copy link
Contributor

Its unclear whats happening. Parsing through the logs, it finds 9 plugins including egauge via service endpoints discovery. Then, it only ends up registering a total of 8. For some reason, the egauge is not registered. Need to dig into this one a bit. I suspect there could be some sort of error that is being masked because this type of behavior was not seen with other plugin deployment configurations.

timestamp='2020-01-30T21:49:34.848605Z' logger='synse_server.plugin' level='info' event='loading plugins from configuration'
timestamp='2020-01-30T21:49:34.848696Z' logger='synse_server.discovery.kubernetes' level='info' event='plugin discovery via Kubernetes is enabled' namespace='default'
timestamp='2020-01-30T21:49:34.848983Z' logger='synse_server.discovery.kubernetes' level='debug' event='listing Kubernetes endpoint' namespace='default' label_selector='synse-component=plugin'
timestamp='2020-01-30T21:49:34.863625Z' logger='synse_server.discovery.kubernetes' level='debug' event='discovered matching Endpoint' name='crane-egauge'
timestamp='2020-01-30T21:49:34.863714Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointSubset'
timestamp='2020-01-30T21:49:34.863770Z' logger='synse_server.discovery.kubernetes' level='debug' event='collecting available addresses for EndpointSubset' name='crane-egauge' subset=0
timestamp='2020-01-30T21:49:34.863825Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-egauge' hostname=None ip='10.42.3.68' node='w4' subset=0
timestamp='2020-01-30T21:49:34.863879Z' logger='synse_server.discovery.kubernetes' level='debug' event='found IPs for EndpointSubset' ips=['10.42.3.68']
timestamp='2020-01-30T21:49:34.863931Z' logger='synse_server.discovery.kubernetes' level='debug' event='found multiple ports - search for port named "http"'
timestamp='2020-01-30T21:49:34.863979Z' logger='synse_server.discovery.kubernetes' level='debug' event='found port' subset=0 name='http'
timestamp='2020-01-30T21:49:34.864028Z' logger='synse_server.discovery.kubernetes' level='debug' event='found port name "http"' subset=0 name='http' port=5004 protocol='TCP'
timestamp='2020-01-30T21:49:34.864077Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-egauge' ip='10.42.3.68' port=5004
timestamp='2020-01-30T21:49:34.864128Z' logger='synse_server.discovery.kubernetes' level='debug' event='discovered matching Endpoint' name='crane-i2c'
timestamp='2020-01-30T21:49:34.864174Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointSubset'
timestamp='2020-01-30T21:49:34.864280Z' logger='synse_server.discovery.kubernetes' level='debug' event='collecting available addresses for EndpointSubset' name='crane-i2c' subset=0
timestamp='2020-01-30T21:49:34.864332Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-i2c' hostname=None ip='10.42.0.68' node='w1' subset=0
timestamp='2020-01-30T21:49:34.864387Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-i2c' hostname=None ip='10.42.1.58' node='w2' subset=0
timestamp='2020-01-30T21:49:34.864437Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-i2c' hostname=None ip='10.42.2.59' node='w3' subset=0
timestamp='2020-01-30T21:49:34.864487Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-i2c' hostname=None ip='10.42.3.67' node='w4' subset=0
timestamp='2020-01-30T21:49:34.864537Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-i2c' hostname=None ip='10.42.4.53' node='w5' subset=0
timestamp='2020-01-30T21:49:34.864586Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-i2c' hostname=None ip='10.42.5.57' node='w6' subset=0
timestamp='2020-01-30T21:49:34.864635Z' logger='synse_server.discovery.kubernetes' level='debug' event='found IPs for EndpointSubset' ips=['10.42.0.68', '10.42.1.58', '10.42.2.59', '10.42.3.67', '10.42.4.53', '10.42.5.57']
timestamp='2020-01-30T21:49:34.864683Z' logger='synse_server.discovery.kubernetes' level='debug' event='found multiple ports - search for port named "http"'
timestamp='2020-01-30T21:49:34.864729Z' logger='synse_server.discovery.kubernetes' level='debug' event='found port' subset=0 name='http'
timestamp='2020-01-30T21:49:34.864791Z' logger='synse_server.discovery.kubernetes' level='debug' event='found port name "http"' subset=0 name='http' port=5002 protocol='TCP'
timestamp='2020-01-30T21:49:34.864849Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-i2c' ip='10.42.0.68' port=5002
timestamp='2020-01-30T21:49:34.864906Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-i2c' ip='10.42.1.58' port=5002
timestamp='2020-01-30T21:49:34.864962Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-i2c' ip='10.42.2.59' port=5002
timestamp='2020-01-30T21:49:34.865018Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-i2c' ip='10.42.3.67' port=5002
timestamp='2020-01-30T21:49:34.865073Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-i2c' ip='10.42.4.53' port=5002
timestamp='2020-01-30T21:49:34.865129Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-i2c' ip='10.42.5.57' port=5002
timestamp='2020-01-30T21:49:34.865187Z' logger='synse_server.discovery.kubernetes' level='debug' event='discovered matching Endpoint' name='crane-modbus'
timestamp='2020-01-30T21:49:34.865248Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointSubset'
timestamp='2020-01-30T21:49:34.865302Z' logger='synse_server.discovery.kubernetes' level='debug' event='collecting available addresses for EndpointSubset' name='crane-modbus' subset=0
timestamp='2020-01-30T21:49:34.865360Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-modbus' hostname=None ip='10.42.3.64' node='w4' subset=0
timestamp='2020-01-30T21:49:34.865419Z' logger='synse_server.discovery.kubernetes' level='debug' event='found IPs for EndpointSubset' ips=['10.42.3.64']
timestamp='2020-01-30T21:49:34.865480Z' logger='synse_server.discovery.kubernetes' level='debug' event='found multiple ports - search for port named "http"'
timestamp='2020-01-30T21:49:34.865541Z' logger='synse_server.discovery.kubernetes' level='debug' event='found port' subset=0 name='http'
timestamp='2020-01-30T21:49:34.865607Z' logger='synse_server.discovery.kubernetes' level='debug' event='found port name "http"' subset=0 name='http' port=5004 protocol='TCP'
timestamp='2020-01-30T21:49:34.865661Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-modbus' ip='10.42.3.64' port=5004
timestamp='2020-01-30T21:49:34.865710Z' logger='synse_server.discovery.kubernetes' level='debug' event='discovered matching Endpoint' name='crane-snmp'
timestamp='2020-01-30T21:49:34.865756Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointSubset'
timestamp='2020-01-30T21:49:34.865802Z' logger='synse_server.discovery.kubernetes' level='debug' event='collecting available addresses for EndpointSubset' name='crane-snmp' subset=0
timestamp='2020-01-30T21:49:34.865850Z' logger='synse_server.discovery.kubernetes' level='debug' event='parsing EndpointAddress' name='crane-snmp' hostname=None ip='10.42.2.55' node='w3' subset=0
timestamp='2020-01-30T21:49:34.865899Z' logger='synse_server.discovery.kubernetes' level='debug' event='found IPs for EndpointSubset' ips=['10.42.2.55']
timestamp='2020-01-30T21:49:34.865946Z' logger='synse_server.discovery.kubernetes' level='debug' event='found multiple ports - search for port named "http"'
timestamp='2020-01-30T21:49:34.865992Z' logger='synse_server.discovery.kubernetes' level='debug' event='found port' subset=0 name='http'
timestamp='2020-01-30T21:49:34.866042Z' logger='synse_server.discovery.kubernetes' level='debug' event='found port name "http"' subset=0 name='http' port=5003 protocol='TCP'
timestamp='2020-01-30T21:49:34.866090Z' logger='synse_server.discovery.kubernetes' level='info' event='discovered plugin via Endpoint' name='crane-snmp' ip='10.42.2.55' port=5003
timestamp='2020-01-30T21:49:34.866139Z' logger='synse_server.discovery.kubernetes' level='info' event='found plugins via Kubernetes Endpoints' count=9
timestamp='2020-01-30T21:49:34.866298Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.3.68:5004' protocol='tcp'
timestamp='2020-01-30T21:49:34.866366Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.871793Z' logger='synse_server.plugin' level='info' event='successfully registered plugin' id='59aa69eb-a5da-569f-aaa4-3ebbdb72530b' tag='vaporio/modbus-ip'
timestamp='2020-01-30T21:49:34.871903Z' logger='synse_server.plugin' level='info' event='marking plugin as active' id='59aa69eb-a5da-569f-aaa4-3ebbdb72530b' tag='vaporio/modbus-ip'
timestamp='2020-01-30T21:49:34.871995Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.0.68:5002' protocol='tcp'
timestamp='2020-01-30T21:49:34.872086Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.873063Z' logger='synse_server.plugin' level='info' event='successfully registered plugin' id='60930702-07ce-5fc6-ad80-dba477feb6e7' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.873134Z' logger='synse_server.plugin' level='info' event='marking plugin as active' id='60930702-07ce-5fc6-ad80-dba477feb6e7' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.873192Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.1.58:5002' protocol='tcp'
timestamp='2020-01-30T21:49:34.873251Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.876367Z' logger='synse_server.plugin' level='info' event='successfully registered plugin' id='fb0d11ed-b15c-557c-b446-83ade04ce56e' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.876445Z' logger='synse_server.plugin' level='info' event='marking plugin as active' id='fb0d11ed-b15c-557c-b446-83ade04ce56e' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.876515Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.2.59:5002' protocol='tcp'
timestamp='2020-01-30T21:49:34.876609Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.879454Z' logger='synse_server.plugin' level='info' event='successfully registered plugin' id='0992dd01-79fb-54da-b06d-9276fc40ced6' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.879528Z' logger='synse_server.plugin' level='info' event='marking plugin as active' id='0992dd01-79fb-54da-b06d-9276fc40ced6' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.879589Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.3.67:5002' protocol='tcp'
timestamp='2020-01-30T21:49:34.879655Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.882741Z' logger='synse_server.plugin' level='info' event='successfully registered plugin' id='cc45331d-0ad3-5e07-9c09-850488d50a7d' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.882819Z' logger='synse_server.plugin' level='info' event='marking plugin as active' id='cc45331d-0ad3-5e07-9c09-850488d50a7d' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.882887Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.4.53:5002' protocol='tcp'
timestamp='2020-01-30T21:49:34.882949Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.886009Z' logger='synse_server.plugin' level='info' event='successfully registered plugin' id='3b073055-9596-5ae2-9aad-7a30d3328b90' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.886080Z' logger='synse_server.plugin' level='info' event='marking plugin as active' id='3b073055-9596-5ae2-9aad-7a30d3328b90' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.886141Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.5.57:5002' protocol='tcp'
timestamp='2020-01-30T21:49:34.886201Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.889250Z' logger='synse_server.plugin' level='info' event='successfully registered plugin' id='4607c5b8-b7c7-5afd-9038-3fe4d24c0019' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.889320Z' logger='synse_server.plugin' level='info' event='marking plugin as active' id='4607c5b8-b7c7-5afd-9038-3fe4d24c0019' tag='vaporio/i2c'
timestamp='2020-01-30T21:49:34.889378Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.3.64:5004' protocol='tcp'
timestamp='2020-01-30T21:49:34.889437Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.893306Z' logger='synse_server.plugin' level='debug' event='plugin with id already registered - skipping' id='59aa69eb-a5da-569f-aaa4-3ebbdb72530b'
timestamp='2020-01-30T21:49:34.893387Z' logger='synse_server.plugin' level='info' event='registering new plugin' addr='10.42.2.55:5003' protocol='tcp'
timestamp='2020-01-30T21:49:34.893451Z' logger='synse_server.plugin' level='debug' event='application metrics enabled: registering gRPC interceptor'
timestamp='2020-01-30T21:49:34.896338Z' logger='synse_server.plugin' level='info' event='successfully registered plugin' id='d0c746de-832e-52b7-bc38-51115117a84d' tag='vaporio/snmp'
timestamp='2020-01-30T21:49:34.896423Z' logger='synse_server.plugin' level='info' event='marking plugin as active' id='d0c746de-832e-52b7-bc38-51115117a84d' tag='vaporio/snmp'
timestamp='2020-01-30T21:49:34.896486Z' logger='synse_server.plugin' level='debug' event='plugin manager refresh complete' plugin_count=8 elapsed_time=0.047882795333862305
timestamp='2020-01-30T21:49:34.896545Z' logger='synse_server.server' level='debug' event='serving API endpoints'
@edaniszewski
Copy link
Contributor Author

This is not a synse-server issue, though perhaps some additional logs and checks could be added, so I'll leave this open for that.

The issue here is that the egauge plugin is really just a modbus plugin with egauge-specific device config. The plugin itself is no different. Its running alongside a modbus plugin, so both have the same id -- this issue is a misconfiguration of the egauge plugin.

@edaniszewski
Copy link
Contributor Author

added additional logging in 3adf18b

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@edaniszewski