[v0.5.6] SIGSEGV: segmentation violation when using driver.raw_exec

[DapperTayra]

Nomad version

Nomad v0.5.6

Operating system and Environment details

Ubuntu 16.04.2 LTS

Issue

Nomad executor crashes "out of the blue".

Reproduction steps

We do not know. Happens sporadically. Maybe linked with #2605

Nomad Server logs (if appropriate)

  2017/06/23 22:31:58 [DEBUG] memberlist: TCP connection from=10.0.40.12:36226
    2017/06/23 22:31:58.417021 [DEBUG] http: Request /v1/status/peers (1.243485ms)
    2017/06/23 22:31:58.417202 [DEBUG] http: Request /v1/agent/servers (15.564µs)
    2017/06/23 22:31:58 [DEBUG] plugin: nomad: panic: runtime error: invalid memory address or nil pointer dereference
    2017/06/23 22:31:58 [DEBUG] plugin: nomad: [signal SIGSEGV: segmentation violation code=0x1 addr=0x30 pc=0xb46507]
    2017/06/23 22:31:58 [DEBUG] plugin: nomad:
    2017/06/23 22:31:58 [DEBUG] plugin: nomad: goroutine 67 [running]:
    2017/06/23 22:31:58 [DEBUG] plugin: nomad: github.com/hashicorp/nomad/command/agent/consul.(*Syncer).runCheck(0xc42011e340, 0x1a68200, 0xc4202471a0)
    2017/06/23 22:31:58 [DEBUG] plugin: nomad:  /opt/gopath/src/github.com/hashicorp/nomad/command/agent/consul/syncer.go:923 +0x77
    2017/06/23 22:31:58 [DEBUG] plugin: nomad: github.com/hashicorp/nomad/command/agent/consul.(*Syncer).(github.com/hashicorp/nomad/command/agent/consul.runCheck)-fm(0x1a68200, 0xc4202471a0)
    2017/06/23 22:31:58 [DEBUG] plugin: nomad:  /opt/gopath/src/github.com/hashicorp/nomad/command/agent/consul/syncer.go:255 +0x3e
    2017/06/23 22:31:58 [DEBUG] plugin: nomad: github.com/hashicorp/nomad/command/agent/consul.(*CheckRunner).run(0xc42010eaa0)
    2017/06/23 22:31:58 [DEBUG] plugin: nomad:  /opt/gopath/src/github.com/hashicorp/nomad/command/agent/consul/check.go:76 +0x220
    2017/06/23 22:31:58 [DEBUG] plugin: nomad: created by github.com/hashicorp/nomad/command/agent/consul.(*CheckRunner).Start
    2017/06/23 22:31:58 [DEBUG] plugin: nomad:  /opt/gopath/src/github.com/hashicorp/nomad/command/agent/consul/check.go:46 +0xd6
2017/06/23 22:31:58 [ERR] yamux: keepalive failed: session shutdown
    2017/06/23 22:31:58.426491 [WARN] client: error fetching stats of task zk: unexpected EOF
    2017/06/23 22:31:58 [DEBUG] plugin: /opt/nomad/nomad: plugin process exited
    2017/06/23 22:31:58.426809 [ERR] driver.raw_exec: failed to deregister services: connection is shut down
    2017/06/23 22:31:58.426829 [ERR] driver.raw_exec: error killing executor: connection is shut down
    2017/06/23 22:31:58.429677 [INFO] client: task "zk" for alloc "a7e27a37-1987-190d-e04a-5b8c96aa4885" failed: Wait returned exit code 0, signal 0, and error unexpected EOF

[stale]

Hey there

Since this issue hasn't had any activity in a while - we're going to automatically close it in 30 days. If you're still seeing this issue with the latest version of Nomad, please respond here and we'll keep this open and take another look at this.

Thanks!

[stale]

This issue will be auto-closed because there hasn't been any activity for a few months. Feel free to open a new one if you still experience this problem 👍

[github-actions]

I'm going to lock this issue because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.