Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[oc] Agent cannot talk to collector #1087

Closed
ptescher opened this issue Jun 11, 2020 · 2 comments
Closed

[oc] Agent cannot talk to collector #1087

ptescher opened this issue Jun 11, 2020 · 2 comments
Labels
bug Something isn't working

Comments

@ptescher
Copy link

ptescher commented Jun 11, 2020

Using latest operator on okd 4.4 beta5 the agent cannot talk back to the headless collector.

End up with lots of these in the agent:

{
    "level": "error",
    "ts": 1591844135.1634374,
    "caller": "grpc/reporter.go:74",
    "msg": "Could not send spans over gRPC",
    "error": "rpc error: code = Unavailable desc = last connection error: connection error: desc = \"transport: authentication handshake failed: read tcp 10.124.4.104:34158->10.125.4.13:14250: read: connection reset by peer\"",
    "stacktrace": "github.com/jaegertracing/jaeger/cmd/agent/app/reporter/grpc.(*Reporter).send\n\tgit.luolix.top/jaegertracing/jaeger/cmd/agent/app/reporter/grpc/reporter.go:74\ngit.luolix.top/jaegertracing/jaeger/cmd/agent/app/reporter/grpc.(*Reporter).EmitBatch\n\tgit.luolix.top/jaegertracing/jaeger/cmd/agent/app/reporter/grpc/reporter.go:53\ngit.luolix.top/jaegertracing/jaeger/cmd/agent/app/reporter.(*MetricsReporter).EmitBatch\n\tgit.luolix.top/jaegertracing/jaeger/cmd/agent/app/reporter/metrics.go:83\ngit.luolix.top/jaegertracing/jaeger/cmd/agent/app/reporter.(*ClientMetricsReporter).EmitBatch\n\tgit.luolix.top/jaegertracing/jaeger/cmd/agent/app/reporter/client_metrics.go:120\ngit.luolix.top/jaegertracing/jaeger/thrift-gen/jaeger.(*agentProcessorEmitBatch).Process\n\tgit.luolix.top/jaegertracing/jaeger/thrift-gen/jaeger/agent.go:138\ngit.luolix.top/jaegertracing/jaeger/thrift-gen/jaeger.(*AgentProcessor).Process\n\tgit.luolix.top/jaegertracing/jaeger/thrift-gen/jaeger/agent.go:112\ngit.luolix.top/jaegertracing/jaeger/cmd/agent/app/processors.(*ThriftProcessor).processBuffer\n\tgit.luolix.top/jaegertracing/jaeger/cmd/agent/app/processors/thrift_processor.go:121\ngit.luolix.top/jaegertracing/jaeger/cmd/agent/app/processors.NewThriftProcessor.func2\n\tgit.luolix.top/jaegertracing/jaeger/cmd/agent/app/processors/thrift_processor.go:86"
}

This appears to be cause by the fact that the headless service port name is grpc but should probably be tls-grpc when tls is enabled.

@ghost ghost added the needs-triage New issues, in need of classification label Jun 11, 2020
@ptescher
Copy link
Author

ptescher commented Jul 9, 2020

Fixed by #1122

@ptescher ptescher closed this as completed Jul 9, 2020
@jpkrohling
Copy link
Contributor

@ptescher, thanks for reporting this issue! For some reason, it didn't appear in my radar, otherwise, we could have fixed it earlier.

@jpkrohling jpkrohling added bug Something isn't working and removed needs-triage New issues, in need of classification labels Jul 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants