Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

all: test failures on netbsd blocked on waiting for subprocesses #57999

Open
bcmills opened this issue Jan 25, 2023 · 203 comments
Open

all: test failures on netbsd blocked on waiting for subprocesses #57999

bcmills opened this issue Jan 25, 2023 · 203 comments
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-NetBSD
Milestone
Backlog

Comments

@bcmills
Copy link
Contributor

bcmills commented Jan 25, 2023 •
edited
Loading 

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
@bcmills bcmills added OS-NetBSD NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Jan 25, 2023
This was referenced Jan 25, 2023
Closed
Closed
Open
@bcmills bcmills changed the title all: test failures on netbsd-386-9_3 blocked in os.wait6 all: test failures on netbsd-.*-9_3 blocked in os.wait6 Jan 25, 2023
@bcmills bcmills added this to the Backlog milestone Jan 25, 2023
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*-9_3` && (`^\s*os\.wait6` || `DETECTED A HANGING GO COMMAND`)
2022-12-09 02:07 netbsd-386-9_3 tools@88ceb240 go@e738a2f1 x/tools/gopls/internal/regtest/completion (log) 
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 10026): see golang/go#54461 for more details

goroutine 7949 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x94ba3c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8c938b8, 0xb4a5710}, 0x95523c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49e
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xa12ce08, {0x8c938b8, 0xb4a5710}, {0x8c8edac, 0xb49d4e8}, {0x8c8edac, 0xb49d500})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xd2f
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xa12ce08, {0x8c938b8, 0xb4a5710}, {0x8c8edac, 0xb49d4e8}, {0x8c8edac, 0xb49d500})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).PackagesForFile(0x981ae40, {0x8c93918, 0xb49d350}, {0xa85e1c0, 0x61}, 0x0, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:640 +0x14a
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0xa0a20a0, {0x8c93918, 0xb49d290}, {0x8c9865c, 0x981ae40}, {0xb51bbf0, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:197 +0x2b7
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0xa0a20a0, {0x8c9865c, 0x981ae40}, {0xb51bbf0, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:156 +0x159
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8c9865c, 0x981ae40}, {0xb51bbf0, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:136 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:134 +0x5c
2022-12-09 21:38 netbsd-386-9_3 go@e8f78cb6 cmd/go.TestScript (log) 
vcs-test.golang.org rerouted to http://127.0.0.1:53798
https://vcs-test.golang.org rerouted to https://127.0.0.1:53797
go test proxy running at GOPROXY=http://127.0.0.1:53796/mod
panic: test timed out after 9m0s
running tests:
	TestScript (9m0s)
	TestScript/mod_get_upgrade (8m39s)

syscall.Syscall6(0x1, 0x704, 0x9907b1c, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0x9907af4 sp=0x9907af0 pc=0x80c53d5
...
	/tmp/workdir/go/src/cmd/go/internal/script/engine.go:590 +0x2cc fp=0x9907c48 sp=0x9907bd0 pc=0x863437c
cmd/go/internal/script.(*Engine).Execute(0x9365020, 0x910abd0, {0x93d1870, 0x13}, 0x9907e54, {0x885913c, 0x95d0170})
	/tmp/workdir/go/src/cmd/go/internal/script/engine.go:292 +0x9bb fp=0x9907db0 sp=0x9907c48 pc=0x8631d4b
cmd/go/internal/script/scripttest.Run.func1({0x885d76c, 0x9559b30}, 0x910abd0, 0x9365020, {0x93d1870, 0x13}, {0x88583cc, 0x955a120})
	/tmp/workdir/go/src/cmd/go/internal/script/scripttest/scripttest.go:89 +0x4fd fp=0x9907e88 sp=0x9907db0 pc=0x86473dd
cmd/go/internal/script/scripttest.Run({0x885d76c, 0x9559b30}, 0x9365020, 0x910abd0, {0x93d1870, 0x13}, {0x88583cc, 0x955a120})
	/tmp/workdir/go/src/cmd/go/internal/script/scripttest/scripttest.go:90 +0x67 fp=0x9907ecc sp=0x9907e88 pc=0x8646cf7
cmd/go_test.TestScript.func3(0x9559b30)
	/tmp/workdir/go/src/cmd/go/script_test.go:154 +0x66c fp=0x9907f9c sp=0x9907ecc pc=0x8664e5c
testing.tRunner(0x9559b30, 0x94fb7a0)
2023-01-03 18:53 netbsd-amd64-9_3 go@d03231d9 cmd/go.TestScript (log) 
vcs-test.golang.org rerouted to http://127.0.0.1:54291
https://vcs-test.golang.org rerouted to https://127.0.0.1:54290
go test proxy running at GOPROXY=http://127.0.0.1:54289/mod
fatal error: runtime.SetFinalizer: finalizer already set

runtime stack:
runtime.throw({0xb84f6e?, 0xbd9d78?})
	/tmp/workdir/go/src/runtime/panic.go:1047 +0x5d fp=0x70ddcbfcfef8 sp=0x70ddcbfcfec8 pc=0x43821d
runtime.SetFinalizer.func2()
	/tmp/workdir/go/src/runtime/mfinal.go:478 +0x54 fp=0x70ddcbfcff30 sp=0x70ddcbfcfef8 pc=0x41ac14
...
	/tmp/workdir/go/src/testing/testing.go:1095 +0x4a fp=0xc0007dfd08 sp=0xc0007dfcb0 pc=0x52bcaa
testing.(*common).Skip(0xc0003dc000, {0xc000112270?, 0xa98cc0?, 0x125f001?})
	/tmp/workdir/go/src/testing/testing.go:1071 +0x58 fp=0xc0007dfd60 sp=0xc0007dfd08 pc=0x52ba58
testing.(*T).Skip(0xc84940?, {0xc000112270?, 0xaae120?, 0xc000112260?})
	<autogenerated>:1 +0x29 fp=0xc0007dfd90 sp=0xc0007dfd60 pc=0x533349
cmd/go/internal/script/scripttest.Run({0xc8e148, 0xc0003dc000}, 0xb60533?, 0xc0002b7ee8?, {0xc0005157d0, 0xf}, {0xc84480, 0xc000e4c1e0})
	/tmp/workdir/go/src/cmd/go/internal/script/scripttest/scripttest.go:94 +0x12e fp=0xc0007dfe10 sp=0xc0007dfd90 pc=0xa2a2ee
cmd/go_test.TestScript.func3(0xc0003dc000)
	/tmp/workdir/go/src/cmd/go/script_test.go:154 +0x60d fp=0xc0007dff70 sp=0xc0007dfe10 pc=0xa4734d
testing.tRunner(0xc0003dc000, 0xc00032d360)
2023-01-05 20:09 netbsd-386-9_3 tools@057ed3c5 go@119f679a x/tools/gopls/internal/regtest/codelens (log) 
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
PPID   PID COMMAND
...
panic: detected hanging go command (pid 10692): see golang/go#54461 for more details

goroutine 1083 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x96b8060)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8ccb080, 0x97fc630}, 0x9a4a0c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:261 +0x1a5
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x9e6bca4, {0x8ccb080, 0x97fc630}, {0x8cc645c, 0x97fc720}, {0x8cc645c, 0x97fc738})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xd2f
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x9e6bca4, {0x8ccb080, 0x97fc630}, {0x8cc645c, 0x97fc720}, {0x8cc645c, 0x97fc738})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).ModTidy.func1({0x8ccb020, 0x9aca720}, {0x8a4ef40, 0x9402b40})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/mod_tidy.go:74 +0x86
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:187 +0x96
runtime/trace.WithRegion({0x8ccb020, 0x9aca720}, {0x94b0fc0, 0x13}, 0x97747cc)
	/tmp/workdir/go/src/runtime/trace/annotation.go:141 +0xe0
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:180 +0x121
created by golang.org/x/tools/internal/memoize.(*Promise).run
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:179 +0x1d6

— watchflakes

@bcmills
Copy link
Contributor Author

bcmills commented Jan 25, 2023

(attn @golang/netbsd)

See previously:

@bcmills bcmills mentioned this issue Jan 25, 2023
Closed
@bcmills bcmills changed the title all: test failures on netbsd-.*-9_3 blocked in os.wait6 all: test failures on netbsd blocked in os.wait6 Jan 25, 2023
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `DETECTED A HANGING GO COMMAND`)
2023-01-24 14:59 netbsd-386-9_3 tools@deeb64bd go@2bf0f54b x/tools/gopls/internal/regtest/workspace (log) 
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 15336): see golang/go#54461 for more details

goroutine 10519 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0xc39f6e0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d0f070, 0xabb3c20}, 0xb80e000)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49e
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xe8def38, {0x8d0f070, 0xabb3c20}, {0x8d0a3dc, 0xb1646d8}, {0x8d0a3dc, 0xb1646f0})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xcfe
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xe8def38, {0x8d0f070, 0xabb3c20}, {0x8d0a3dc, 0xb1646d8}, {0x8d0a3dc, 0xb1646f0})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).MetadataForFile(0xafe9d40, {0x8d0f0d0, 0xb1644f8}, {0x9c81f10, 0x68})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:681 +0x1fb
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0xae799e0, {0x8d0f0d0, 0xb1643d8}, {0x8d13e7c, 0xafe9d40}, {0xb0e6968, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:205 +0x2ba
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0xae799e0, {0x8d13e7c, 0xafe9d40}, {0xb0e6968, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:158 +0x157
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8d13e7c, 0xafe9d40}, {0xb0e6968, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:137 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:135 +0x5c

— watchflakes

@bcmills bcmills mentioned this issue Jan 26, 2023
Open
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-01-25 23:57 netbsd-amd64-9_3 tools@82707575 go@581603cb x/tools/cmd/fiximports.TestFixImports (log) 
panic: test timed out after 10m0s

syscall.Syscall6(0x1c1, 0x6fb, 0xc0000b8f34, 0x0, 0xc000164240, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_amd64.s:39 +0x5
syscall.wait4(0xc0000b8f38?, 0x40ccc7?, 0x90?, 0x5a5960?)
	/tmp/workdir/go/src/syscall/zsyscall_netbsd_amd64.go:34 +0x4e
syscall.Wait4(0x203000?, 0xc0000b8f6c, 0xc0000b8fe8?, 0x5622c6?)
	/tmp/workdir/go/src/syscall/syscall_bsd.go:144 +0x2b
os.(*Process).wait(0xc0001854d0)
	/tmp/workdir/go/src/os/exec_unix.go:43 +0x77
os.(*Process).Wait(...)
	/tmp/workdir/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0xc00048f4a0)
	/tmp/workdir/go/src/os/exec/exec.go:514 +0x54
os/exec.(*Cmd).Run(0x5ac4a7?)
	/tmp/workdir/go/src/os/exec/exec.go:341 +0x39
golang.org/x/tools/cmd/fiximports.list({0xc0000b9340?, 0x1?, 0xc0003e8fc0?})
	/tmp/workdir/gopath/src/golang.org/x/tools/cmd/fiximports/main.go:489 +0x1d9
golang.org/x/tools/cmd/fiximports.fiximports({0xc000058840?, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/cmd/fiximports/main.go:156 +0xe8
golang.org/x/tools/cmd/fiximports.TestFixImports(0xc0000a4680)
	/tmp/workdir/gopath/src/golang.org/x/tools/cmd/fiximports/main_test.go:222 +0x625
testing.tRunner(0xc0000a4680, 0x5ba450)

— watchflakes

@bcmills bcmills changed the title all: test failures on netbsd blocked in os.wait6 all: test failures on netbsd blocked on waiting for subprocesses Jan 26, 2023
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2022-12-21 03:49 netbsd-arm-bsiegert go@78fc8107 (log) 
fatal error: index out of range

runtime stack:
runtime.throw({0x63d1b7, 0x12})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:1047 +0x4c fp=0x7fffd394 sp=0x7fffd380 pc=0x4b2ac
runtime.panicCheck1(0x3b088, {0x63d1b7, 0x12})
	/var/gobuilder/buildlet/go/src/runtime/panic.go:57 +0xb0 fp=0x7fffd3a8 sp=0x7fffd394 pc=0x48938
runtime.goPanicIndex(0x21401a6, 0x1fc)
	/var/gobuilder/buildlet/go/src/runtime/panic.go:112 +0x2c fp=0x7fffd3c8 sp=0x7fffd3a8 pc=0x489d4
runtime.(*gcWork).put(0xc2c25c, 0xc98000)
	/var/gobuilder/buildlet/go/src/runtime/mgcwork.go:136 +0xf4 fp=0x7fffd3d8 sp=0x7fffd3c8 pc=0x3b088
runtime.greyobject(0xc98000, 0xa0d360, 0x8, 0x7bc52ff8, 0xc2c25c, 0x0)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:1506 +0x1d8 fp=0x7fffd3f8 sp=0x7fffd3d8 pc=0x33188
runtime.scanblock(0xa0d360, 0x12eac, 0x7bc544fd, 0xc2c25c, 0x0)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:1238 +0x120 fp=0x7fffd424 sp=0x7fffd3f8 pc=0x32a68
runtime.markrootBlock(0xa0d360, 0x12eac, 0x7bc544fd, 0xc2c25c, 0x0)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:284 +0x74 fp=0x7fffd440 sp=0x7fffd424 pc=0x2ffd0
runtime.markroot(0xc2c25c, 0x3, 0x1)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:176 +0x434 fp=0x7fffd49c sp=0x7fffd440 pc=0x2fc8c
runtime.gcDrain(0xc2c25c, 0x7)
	/var/gobuilder/buildlet/go/src/runtime/mgcmark.go:1069 +0x58c fp=0x7fffd4e4 sp=0x7fffd49c pc=0x32494
runtime.gcBgMarkWorker.func2()
	/var/gobuilder/buildlet/go/src/runtime/mgc.go:1367 +0x7c fp=0x7fffd510 sp=0x7fffd4e4 pc=0x2d11c
runtime.systemstack()
	/var/gobuilder/buildlet/go/src/runtime/asm_arm.s:317 +0x60 fp=0x7fffd514 sp=0x7fffd510 pc=0x7ddd8

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2022-12-22 14:46 netbsd-386-9_3 tools@3be06475 go@41eb70ae x/tools/gopls/internal/regtest/misc (log) 
serve.go:434: debug server listening at http://localhost:65433
serve.go:434: debug server listening at http://localhost:65432
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 22331): see golang/go#54461 for more details

goroutine 62705 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x1048c8d0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d68700, 0x94dff80}, 0xa988fd0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49f
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x11b82d10, {0x8d68700, 0x94dff80}, {0x8d6395c, 0x10fa5b78}, {0x8d6395c, 0x10fa5ba8})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x11b82d10, {0x8d68700, 0x94dff80}, {0x8d6395c, 0x10fa5b78}, {0x8d6395c, 0x10fa5ba8})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).MetadataForFile(0xd56b080, {0x8d68720, 0x10fa5878}, {0x11cb9680, 0x58})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:771 +0x1ee
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0x11cb3180, {0x8d68720, 0x10fa57b8}, {0x8d6de28, 0xd56b080}, {0xc449c70, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:205 +0x2ba
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0x11cb3180, {0x8d6de28, 0xd56b080}, {0xc449c70, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:158 +0x159
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8d6de28, 0xd56b080}, {0xc449c70, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:137 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:135 +0x5c
2022-12-29 16:33 netbsd-386-9_3 tools@3b16059a go@c1760296 x/tools/gopls/internal/regtest/misc (log) 
serve.go:434: debug server listening at http://localhost:65426
serve.go:434: debug server listening at http://localhost:65425
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 20990): see golang/go#54461 for more details

goroutine 66880 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x12d40ab0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d674c0, 0x11ef1380}, 0x14705550)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49f
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x14adcd58, {0x8d674c0, 0x11ef1380}, {0x8d6275c, 0x15b27ae8}, {0x8d6275c, 0x15b27b00})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xfb7dd58, {0x8d674c0, 0x11ef1380}, {0x8d6275c, 0x15b27ae8}, {0x8d6275c, 0x15b27b00})
...
golang.org/x/tools/internal/gocommand.(*Runner).runConcurrent(0x156358a8, {0x8d674c0, 0x11ef1380}, {{0x8abfd1e, 0x4}, {0x9a8e400, 0x4, 0x4}, {0x92e9260, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:100 +0x17c
golang.org/x/tools/internal/gocommand.(*Runner).RunRaw(0x156358a8, {0x8d674c0, 0x11ef1380}, {{0x8abfd1e, 0x4}, {0x9a8e400, 0x4, 0x4}, {0x92e9260, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:75 +0x5e
golang.org/x/tools/go/internal/packagesdriver.GetSizesGolist({0x8d674c0, 0x11ef1380}, {{0x8abfd1e, 0x4}, {0x9a8e400, 0x4, 0x4}, {0x92e9260, 0x0, 0x0}, ...}, ...)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/packagesdriver/sizes.go:22 +0xd8
golang.org/x/tools/go/packages.goListDriver.func1()
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:157 +0x124
created by golang.org/x/tools/go/packages.goListDriver
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:155 +0x325
2023-01-04 22:18 netbsd-386-9_3 tools@a4455feb go@eeaf508d x/tools/gopls/internal/regtest/misc (log) 
serve.go:434: debug server listening at http://localhost:65435
serve.go:434: debug server listening at http://localhost:65434
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 18859): see golang/go#54461 for more details

goroutine 51067 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x154e7cb0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d3088c, 0x157166c0}, 0x1572e160)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x4f0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x137d4f3c, {0x8d3088c, 0x157166c0}, {0x8d2be88, 0x15730270}, {0x8d2be88, 0x15730288})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0x137d4f3c, {0x8d3088c, 0x157166c0}, {0x8d2be88, 0x15730270}, {0x8d2be88, 0x15730288})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).MetadataForFile(0xc330540, {0x8d308ec, 0x15730108}, {0x142ca780, 0x60})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:692 +0x1ee
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0x147c1540, {0x8d308ec, 0x15730048}, {0x8d35b64, 0xc330540}, {0x155581f8, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:205 +0x2ba
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0x147c1540, {0x8d35b64, 0xc330540}, {0x155581f8, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:158 +0x159
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8d35b64, 0xc330540}, {0x155581f8, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:137 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:135 +0x5c

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-01-17 19:56 netbsd-386-9_3 go@2f5718a8 runtime.TestCgoExecSignalMask (log) 
--- FAIL: TestCgoExecSignalMask (145.59s)
    exec.go:146: test timed out while running command: /tmp/workdir/tmp/go-build4138185153/testprogcgo.exe CgoExecSignalMask
    crash_test.go:58: /tmp/workdir/tmp/go-build4138185153/testprogcgo.exe CgoExecSignalMask: exit status 2
    crash_cgo_test.go:140: expected "OK\n", got SIGQUIT: quit
        PC=0x80b2437 m=13 sigcode=0

        eax    0x4
        ebx    0x85824b0
        ecx    0x85824b0
        edx    0x8580240
        edi    0x8418110
        esi    0x2
        ebp    0x1
        esp    0xa9dffe18
        eip    0x80b2437
        eflags 0x247
        cs     0x17
        fs     0xab
        gs     0xb3
2023-02-01 19:46 netbsd-386-9_3 tools@41adf8d4 go@de4748c4 x/tools/gopls/internal/regtest/workspace (log) 
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 19419): see golang/go#54461 for more details

goroutine 20140 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x97f00c0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d054e0, 0xa353368}, 0xb14f800)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49e
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xbe7bca4, {0x8d054e0, 0xa353368}, {0x8d007bc, 0xa353590}, {0x8d007bc, 0xa3535a8})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xd2f
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xbe7bca4, {0x8d054e0, 0xa353368}, {0x8d007bc, 0xa353590}, {0x8d007bc, 0xa3535a8})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).ModTidy.func1({0x8d05480, 0xaa8a540}, {0x8a82400, 0xb14f380})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/mod_tidy.go:74 +0x86
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:187 +0x96
runtime/trace.WithRegion({0x8d05480, 0xaa8a540}, {0xa8ffe78, 0x13}, 0xb238fcc)
	/tmp/workdir/go/src/runtime/trace/annotation.go:141 +0xe0
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:180 +0x121
created by golang.org/x/tools/internal/memoize.(*Promise).run
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/memoize/memoize.go:179 +0x1d6

— watchflakes

@bcmills bcmills mentioned this issue Feb 2, 2023
Closed
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-01 23:31 netbsd-arm-bsiegert tools@4e8ff892 go@de4748c4 x/tools/go/ssa.TestBuildPackage (log) 
panic: test timed out after 1h40m0s
running tests:
	TestBuildPackage (1h40m0s)

syscall.Syscall6(0x1e1, 0x1, 0x2837, 0x94548c, 0x10020, 0x0, 0x0)
	/var/gobuilder/buildlet/go/src/syscall/asm_netbsd_arm.s:39 +0x8
os.wait6(0x1, 0x2837, 0x10020)
	/var/gobuilder/buildlet/go/src/os/wait6_netbsd.go:16 +0x54
os.(*Process).blockUntilWaitable(0x8212c0)
	/var/gobuilder/buildlet/go/src/os/wait_wait6.go:20 +0x30
...
	/var/gobuilder/buildlet/go/src/go/types/resolver.go:254 +0xba0
go/types.(*Checker).checkFiles(0xaa6ff0, {0xabe6b8, 0x1, 0x1})
	/var/gobuilder/buildlet/go/src/go/types/check.go:326 +0xd4
go/types.(*Checker).Files(...)
	/var/gobuilder/buildlet/go/src/go/types/check.go:304
golang.org/x/tools/go/ssa/ssautil.BuildPackage(0xac0390, 0xac0180, 0xac0360, {0xabe6b8, 0x1, 0x1}, 0x8)
	/var/gobuilder/buildlet/gopath/src/golang.org/x/tools/go/ssa/ssautil/load.go:150 +0x194
golang.org/x/tools/go/ssa_test.TestBuildPackage(0xaa6f00)
	/var/gobuilder/buildlet/gopath/src/golang.org/x/tools/go/ssa/builder_test.go:69 +0x218
testing.tRunner(0xaa6f00, 0x38c178)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (`^\s*os\.wait6` || `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-08 22:43 netbsd-386-9_3 tools@d0863f03 go@7302f83d x/tools/gopls/internal/regtest/misc (log) 
serve.go:434: debug server listening at http://localhost:65383
serve.go:434: debug server listening at http://localhost:65382
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 18413): see golang/go#54461 for more details

goroutine 64636 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0x1073a2a0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d766b4, 0xfe3ca80}, 0x11a65680)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49e
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x118dbd54, {0x8d766b4, 0xfe3ca80}, {0x8d7198c, 0xa6001f8}, {0x8d7198c, 0xa600210})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xd2f
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xa787554, {0x8d766b4, 0xfe3ca80}, {0x8d7198c, 0xa6001f8}, {0x8d7198c, 0xa600210})
...
golang.org/x/tools/internal/gocommand.(*Runner).runConcurrent(0xa2eebb8, {0x8d766b4, 0xfe3ca80}, {{0x8ae6d85, 0x4}, {0xd7a98a0, 0x4, 0x4}, {0x932a1f8, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:100 +0x17c
golang.org/x/tools/internal/gocommand.(*Runner).RunRaw(0xa2eebb8, {0x8d766b4, 0xfe3ca80}, {{0x8ae6d85, 0x4}, {0xd7a98a0, 0x4, 0x4}, {0x932a1f8, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:75 +0x5e
golang.org/x/tools/go/internal/packagesdriver.GetSizesGolist({0x8d766b4, 0xfe3ca80}, {{0x8ae6d85, 0x4}, {0xd7a98a0, 0x4, 0x4}, {0x932a1f8, 0x0, 0x0}, ...}, ...)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/packagesdriver/sizes.go:22 +0xd8
golang.org/x/tools/go/packages.goListDriver.func1()
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:157 +0x130
created by golang.org/x/tools/go/packages.goListDriver
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:155 +0x33c

— watchflakes

@bcmills
Copy link
Contributor Author

bcmills commented Feb 9, 2023

@golang/netbsd, is anyone looking into this? These failures are quite frequent.

@bcmills bcmills mentioned this issue Feb 9, 2023
Closed
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-10 19:39 netbsd-amd64-9_3 go@88ad4476 runtime.TestCgoExecSignalMask (log) 
--- FAIL: TestCgoExecSignalMask (145.75s)
    exec.go:146: test timed out while running command: /tmp/workdir/tmp/go-build3507279962/testprogcgo.exe CgoExecSignalMask
    crash_cgo_test.go:137: /tmp/workdir/tmp/go-build3507279962/testprogcgo.exe CgoExecSignalMask: exit status 2
    crash_cgo_test.go:140: expected "OK\n", got SIGQUIT: quit
        PC=0x46c2a3 m=13 sigcode=0

        rax    0x4
        rbx    0x0
        rcx    0x46c2a3
        rdx    0x0
        rdi    0x3
        rsi    0x0
        rbp    0x740fb15ffd48
        rsp    0x740fb15ffcf0
        r8     0xc0002b4340
        r9     0xc0002b4340
        r10    0x0
        r11    0x202
        r12    0x21
        r13    0xc00001a110
        r14    0xc0002b61a0
        r15    0x740fb60ab000
        rip    0x46c2a3
        rflags 0x203
        cs     0x47
        fs     0x0
        gs     0x0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-22 21:51 netbsd-386-9_3 tools@3ec30bd9 go@0fa9ba8a x/tools/gopls/internal/regtest/misc (log) 
serve.go:434: debug server listening at http://localhost:65442
serve.go:434: debug server listening at http://localhost:65441
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
...
panic: detected hanging go command (pid 21113): see golang/go#54461 for more details

goroutine 51703 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0xac47a40)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d9e5c0, 0xd11e600}, 0x9f57a20)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49f
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xab1ed58, {0x8d9e5c0, 0xd11e600}, {0x8d9973c, 0xa057788}, {0x8d9973c, 0xa0577a0})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xa84e558, {0x8d9e5c0, 0xd11e600}, {0x8d9973c, 0xa057788}, {0x8d9973c, 0xa0577a0})
...
golang.org/x/tools/internal/gocommand.(*Runner).runConcurrent(0xcf83c50, {0x8d9e5c0, 0xd11e600}, {{0x8af158a, 0x4}, {0xa3e3680, 0x4, 0x4}, {0x93356c0, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:100 +0x17c
golang.org/x/tools/internal/gocommand.(*Runner).RunRaw(0xcf83c50, {0x8d9e5c0, 0xd11e600}, {{0x8af158a, 0x4}, {0xa3e3680, 0x4, 0x4}, {0x93356c0, 0x0, ...}, ...})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:75 +0x5e
golang.org/x/tools/go/internal/packagesdriver.GetSizesGolist({0x8d9e5c0, 0xd11e600}, {{0x8af158a, 0x4}, {0xa3e3680, 0x4, 0x4}, {0x93356c0, 0x0, 0x0}, ...}, ...)
	/tmp/workdir/gopath/src/golang.org/x/tools/go/internal/packagesdriver/sizes.go:22 +0xd8
golang.org/x/tools/go/packages.goListDriver.func1()
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:157 +0x124
created by golang.org/x/tools/go/packages.goListDriver
	/tmp/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:155 +0x325

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-14 17:25 netbsd-arm64-bsiegert go@8e02cffd os/exec.TestCancelErrors (log) 
panic: test timed out after 30m0s
running tests:
	TestCancelErrors (30m0s)
	TestCancelErrors/killed_after_error (30m0s)

syscall.Syscall6(0x1e1, 0x1, 0x3bf8, 0x4000047d5c, 0x10020, 0x0, 0x0)
	/var/gobuilder/buildlet/go/src/syscall/asm_netbsd_arm64.s:56 +0x10 fp=0x4000047d00 sp=0x4000047cf0 pc=0x88390
os.wait6(0x3b7b78?, 0x40000ec140?, 0x400006c2a0?)
	/var/gobuilder/buildlet/go/src/os/wait6_netbsd.go:16 +0x48 fp=0x4000047d70 sp=0x4000047d00 pc=0xab888
os.(*Process).blockUntilWaitable(0x40000ce0c0)
	/var/gobuilder/buildlet/go/src/os/wait_wait6.go:20 +0x38 fp=0x4000047da0 sp=0x4000047d70 pc=0xab8f8
os.(*Process).wait(0x40000ce0c0)
	/var/gobuilder/buildlet/go/src/os/exec_unix.go:22 +0x2c fp=0x4000047e00 sp=0x4000047da0 pc=0xa631c
os.(*Process).Wait(...)
	/var/gobuilder/buildlet/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0x40002a6c60)
	/var/gobuilder/buildlet/go/src/os/exec/exec.go:890 +0x38 fp=0x4000047e70 sp=0x4000047e00 pc=0x101388
os/exec_test.TestCancelErrors.func3(0x400014aea0)
	/var/gobuilder/buildlet/go/src/os/exec/exec_test.go:1613 +0x23c fp=0x4000047f60 sp=0x4000047e70 pc=0x29326c
testing.tRunner(0x400014aea0, 0x360dc0)
2023-02-24 20:25 netbsd-386-9_3 go@f8050362 runtime.TestLockOSThreadTemplateThreadRace (log) 
panic: test timed out after 3m0s
running tests:
	TestLockOSThreadTemplateThreadRace (2m33s)

syscall.Syscall6(0x1, 0x3543, 0x8d1b5fc, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0x8d1b5d4 sp=0x8d1b5d0 pc=0x80ca555
os.wait6(0x1, 0x3543, 0x10020)
	/tmp/workdir/go/src/os/wait6_netbsd.go:16 +0x5b fp=0x8d1b608 sp=0x8d1b5d4 pc=0x80ee49b
os.(*Process).blockUntilWaitable(0x8825680)
	/tmp/workdir/go/src/os/wait_wait6.go:20 +0x31 fp=0x8d1b624 sp=0x8d1b608 pc=0x80ee4f1
os.(*Process).wait(0x8825680)
	/tmp/workdir/go/src/os/exec_unix.go:22 +0x28 fp=0x8d1b660 sp=0x8d1b624 pc=0x80e8c48
os.(*Process).Wait(...)
	/tmp/workdir/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0x88da3c0)
	/tmp/workdir/go/src/os/exec/exec.go:890 +0x36 fp=0x8d1b698 sp=0x8d1b660 pc=0x8172a06
os/exec.(*Cmd).Run(0x88da3c0)
	/tmp/workdir/go/src/os/exec/exec.go:590 +0x43 fp=0x8d1b6a8 sp=0x8d1b698 pc=0x8171793
os/exec.(*Cmd).CombinedOutput(0x88da3c0)
	/tmp/workdir/go/src/os/exec/exec.go:1005 +0x8f fp=0x8d1b6bc sp=0x8d1b6a8 pc=0x817321f
runtime_test.runBuiltTestProg(0x89cc780, {0x9534210, 0x2f}, {0x8422390, 0x1e}, {0x0, 0x0, 0x0})
	/tmp/workdir/go/src/runtime/crash_test.go:76 +0x28d fp=0x8d1b734 sp=0x8d1b6bc pc=0x82f1f5d
runtime_test.TestLockOSThreadTemplateThreadRace(0x89cc780)
	/tmp/workdir/go/src/runtime/proc_test.go:1022 +0x164 fp=0x8d1b798 sp=0x8d1b734 pc=0x83556c4
testing.tRunner(0x89cc780, 0x8439370)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-02-28 05:12 netbsd-386-9_3 go@41e86796 cmd/compile/internal/test.TestReproducibleBuilds (log) 
panic: test timed out after 3m0s
running tests:
	TestReproducibleBuilds (2m51s)
	TestReproducibleBuilds/issue27013.go (2m51s)

syscall.Syscall6(0x1, 0x455a, 0x9092dd8, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0x9092db0 sp=0x9092dac pc=0x80c2155
os.wait6(0x1, 0x455a, 0x10020)
	/tmp/workdir/go/src/os/wait6_netbsd.go:16 +0x5b fp=0x9092de4 sp=0x9092db0 pc=0x80f0afb
os.(*Process).blockUntilWaitable(0x9886480)
	/tmp/workdir/go/src/os/wait_wait6.go:20 +0x31 fp=0x9092e00 sp=0x9092de4 pc=0x80f0b51
os.(*Process).wait(0x9886480)
	/tmp/workdir/go/src/os/exec_unix.go:22 +0x28 fp=0x9092e3c sp=0x9092e00 pc=0x80eae28
os.(*Process).Wait(...)
	/tmp/workdir/go/src/os/exec.go:132
os/exec.(*Cmd).Wait(0x984cc00)
	/tmp/workdir/go/src/os/exec/exec.go:890 +0x36 fp=0x9092e74 sp=0x9092e3c pc=0x81814f6
os/exec.(*Cmd).Run(0x984cc00)
	/tmp/workdir/go/src/os/exec/exec.go:590 +0x43 fp=0x9092e84 sp=0x9092e74 pc=0x8180273
os/exec.(*Cmd).CombinedOutput(0x984cc00)
	/tmp/workdir/go/src/os/exec/exec.go:1005 +0x8f fp=0x9092e98 sp=0x9092e84 pc=0x8181d0f
cmd/compile/internal/test.TestReproducibleBuilds.func1(0x8f880f0)
	/tmp/workdir/go/src/cmd/compile/internal/test/reproduciblebuilds_test.go:42 +0x360 fp=0x9092f98 sp=0x9092e98 pc=0x842f790
testing.tRunner(0x8f880f0, 0x8f82020)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-03-01 16:36 netbsd-386-9_3 tools@096bae8f go@600d372f x/tools/gopls/internal/regtest/completion (log) 
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
 PPID   PID COMMAND
...
panic: detected hanging go command (pid 13546): see golang/go#54461 for more details

goroutine 6974 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand(0xb6c5ce0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:333 +0x519
golang.org/x/tools/internal/gocommand.runCmdContext({0x8d3b260, 0x9ac99e0}, 0xba586e0)
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:294 +0x49f
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xb658f40, {0x8d3b260, 0x9ac99e0}, {0x8d3642c, 0xa59ddb8}, {0x8d3642c, 0xa59de18})
	/tmp/workdir/gopath/src/golang.org/x/tools/internal/gocommand/invoke.go:234 +0xde3
golang.org/x/tools/internal/gocommand.(*Invocation).runWithFriendlyError(0xb658f40, {0x8d3b260, 0x9ac99e0}, {0x8d3642c, 0xa59ddb8}, {0x8d3642c, 0xa59de18})
...
golang.org/x/tools/gopls/internal/lsp/cache.(*snapshot).MetadataForFile(0xad53b80, {0x8d3b2c0, 0xa59d710}, {0xa8fb5c0, 0x5e})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/cache/snapshot.go:703 +0x1ee
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseChangedFiles(0xa938750, {0x8d3b2c0, 0xa59d650}, {0x8d40088, 0xad53b80}, {0xa7cfdf8, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:205 +0x2ba
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshot(0xa938750, {0x8d40088, 0xad53b80}, {0xa7cfdf8, 0x1, 0x1}, 0x0)
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:158 +0x159
golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots.func1({0x8d40088, 0xad53b80}, {0xa7cfdf8, 0x1, 0x1})
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:137 +0x8a
created by golang.org/x/tools/gopls/internal/lsp.(*Server).diagnoseSnapshots
	/tmp/workdir/gopath/src/golang.org/x/tools/gopls/internal/lsp/diagnostics.go:135 +0x5c

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND`)
2023-01-17 19:56 netbsd-386-9_3 go@354c8fb4 go/internal/srcimporter.TestCgo (log) 
panic: test timed out after 3m0s
running tests:
	TestCgo (2m58s)

syscall.Syscall6(0x1, 0x23c6, 0xa787714, 0x10020, 0x0, 0x0, 0x0)
	/tmp/workdir/go/src/syscall/asm_unix_386.s:43 +0x5 fp=0xa7876ec sp=0xa7876e8 pc=0x80b76c5
os.wait6(0x1, 0x23c6, 0x10020)
	/tmp/workdir/go/src/os/wait6_netbsd.go:16 +0x57 fp=0xa787720 sp=0xa7876ec pc=0x80d2c87
os.(*Process).blockUntilWaitable(0x9f803c0)
	/tmp/workdir/go/src/os/wait_wait6.go:20 +0x31 fp=0xa78773c sp=0xa787720 pc=0x80d2ce1
...
	/tmp/workdir/go/src/go/types/check.go:326 +0x120 fp=0xa787e60 sp=0xa787e30 pc=0x81b9ed0
go/types.(*Checker).Files(...)
	/tmp/workdir/go/src/go/types/check.go:304
go/types.(*Config).Check(0xa170780, {0x825b9cd, 0xa}, 0x9fee240, {0x8ad6700, 0x21, 0x40}, 0x0)
	/tmp/workdir/go/src/go/types/api.go:415 +0x83 fp=0xa787e80 sp=0xa787e60 pc=0x81a8ca3
go/internal/srcimporter.(*Importer).ImportFrom(0x8af1ad0, {0x825b9cd, 0xa}, {0x8a61218, 0x14}, 0x0)
	/tmp/workdir/go/src/go/internal/srcimporter/srcimporter.go:145 +0x815 fp=0xa787f48 sp=0xa787e80 pc=0x8210315
go/internal/srcimporter.TestCgo(0x93b34a0)
	/tmp/workdir/go/src/go/internal/srcimporter/srcimporter_test.go:249 +0x2b3 fp=0xa787f9c sp=0xa787f48 pc=0x8213613
testing.tRunner(0x93b34a0, 0x826bc44)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-03 22:53 x_tools-go1.23-netbsd-arm tools@9a041363 release-branch.go1.23@194de8fb x/tools/gopls/internal/test/integration/misc.TestRenamePackage_InternalPackage/default [ABORT] (log) 
=== RUN   TestRenamePackage_InternalPackage/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m2.225945067s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -overlay=/home/swarming/.swarming/w/ir/x/t/gocommand-2460169772/overlay.json -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-2361705960/TestRenamePackage_InternalPackage/default/work/lib1
		pid:13782

goroutine 69341 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1cc47558db2856a, 0x1149056b373, 0x16b3f38}, 0xdf9e008)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3544798497/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1040a20, 0xdf1bd58}, 0xdf9e008)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3544798497/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xba1b35c, {0x1040a20, 0xdf1bd58}, {0x103b998, 0xdf1bdd0}, {0x103b998, 0xdf1bde8})
...
golang.org/x/tools/go/packages.goListDriver(0xde18f04, 0xde1f038, {0xabbd860, 0x43}, {0xdbf2a98, 0x1, 0x1})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3544798497/go/packages/golist.go:218 +0x8ec
golang.org/x/tools/go/packages.defaultDriver.func1(0xde18f04, {0xdbf2a98, 0x1, 0x1})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3544798497/go/packages/packages.go:340 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3544798497/go/packages/packages.go:387 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.9.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 69340
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.9.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-04 22:20 x_tools-go1.22-netbsd-arm tools@44670c7f release-branch.go1.22@8f3f22ee x/tools/gopls/internal/test/integration/diagnostics.TestRenamePackage/default [ABORT] (log) 
=== RUN   TestRenamePackage/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m8.426237201s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -overlay=/home/swarming/.swarming/w/ir/x/t/gocommand-3750007467/overlay.json -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- foo
		pid:755

goroutine 40857 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1cc6ec2a56389b0, 0xe97a1e2ba1, 0x1613968}, 0x975cf78)
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0xfc4fb8, 0x1453a4b0}, 0x975cf78)
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xe097468, {0xfc4fb8, 0x1453a4b0}, {0xfbff88, 0x1453a540}, {0xfbff88, 0x1453a5b8})
...
golang.org/x/tools/go/packages.goListDriver(0x97ec984, 0x145bc438, {0x8bcf3b0, 0x43}, {0x130e5d90, 0x1, 0x1})
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/go/packages/golist.go:210 +0x808
golang.org/x/tools/go/packages.defaultDriver.func1(0x97ec984, {0x130e5d90, 0x1, 0x1})
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/go/packages/packages.go:340 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/go/packages/packages.go:387 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 40850
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
2024-12-04 22:20 x_tools-go1.22-netbsd-arm tools@44670c7f release-branch.go1.22@8f3f22ee x/tools/gopls/internal/test/integration/misc.TestTelemetryPrompt_PromptFile/v0.16-format/invalid/default [ABORT] (log) 
=== RUN   TestTelemetryPrompt_PromptFile/v0.16-format/invalid/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m22.694678982s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-4071599734/TestTelemetryPrompt_PromptFile/v0.16-format/invalid/default/work/... builtin
		pid:25944

goroutine 48511 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1cc6ec38e5e49ec, 0xae2da979ea, 0x16c3f20}, 0xceb4b68)
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1041108, 0x88682b8}, 0xceb4b68)
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x9b4f468, {0x1041108, 0x88682b8}, {0x103c080, 0x8868330}, {0x103c080, 0x8868348})
...
golang.org/x/tools/go/packages.Load(0xa505400, {0xa9618f0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/go/packages/packages.go:266 +0x4c
golang.org/x/tools/gopls/internal/cache.(*Snapshot).load(0x1b1e508, {0x1041124, 0x93429f0}, 0x1, {0xa9618e0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/gopls/internal/cache/load.go:130 +0xb08
golang.org/x/tools/gopls/internal/cache.(*Snapshot).initialize(0x1b1e508, {0x1041124, 0x93429f0}, 0x1)
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/gopls/internal/cache/view.go:691 +0x2e4
golang.org/x/tools/gopls/internal/cache.(*Session).createView.func3()
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/gopls/internal/cache/session.go:292 +0x54
created by golang.org/x/tools/gopls/internal/cache.(*Session).createView in goroutine 48536
	/home/swarming/.swarming/w/ir/x/w/targetrepo273786389/gopls/internal/cache/session.go:290 +0x18bc
2024-12-04 22:20 x_tools-gotip-netbsd-arm tools@44670c7f go@3ae00f5d x/tools/gopls/internal/test/integration/misc.TestFreeSymbols/default [ABORT] (log) 
=== RUN   TestFreeSymbols/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m8.614869351s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go mod tidy -modfile=/home/swarming/.swarming/w/ir/x/t/gopls-tempmod1471215631/go.mod
		pid:812

goroutine 81787 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1ccefbaeed78ad6, 0x152e855e4cf, 0x17a9690}, 0xeba40d8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo240036938/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x10debf0, 0x9fdaea0}, 0xeba40d8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo240036938/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xd075ae8, {0x10debf0, 0x9fdaea0}, {0x10d9920, 0x9fdaf18}, {0x10d9920, 0x9fdaf30})
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).ModTidy.func1({0x10dec0c, 0x1ca3320}, {0xdadfc0, 0x8c74dc8})
	/home/swarming/.swarming/w/ir/x/w/targetrepo240036938/gopls/internal/cache/mod_tidy.go:80 +0x44
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo240036938/internal/memoize/memoize.go:187 +0xa8
runtime/trace.WithRegion({0x10dec0c, 0x1ca3320}, {0xf14a210, 0x13}, 0xfd057c4)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/trace/annotation.go:141 +0xdc
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo240036938/internal/memoize/memoize.go:180 +0x108
created by golang.org/x/tools/internal/memoize.(*Promise).run in goroutine 81786
	/home/swarming/.swarming/w/ir/x/w/targetrepo240036938/internal/memoize/memoize.go:179 +0x1dc

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-10 18:15 x_tools-go1.24-netbsd-arm tools@5e47a3db release-branch.go1.24@26682773 x/tools/gopls/internal/test/integration/diagnostics.TestEditGoDirective/default [ABORT] (log) 
=== RUN   TestEditGoDirective/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m10.640726829s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-2724133753/TestEditGoDirective/default/work/... builtin
		pid:6842

goroutine 48711 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1ce5b4c37479ce1, 0x8e10e7f2e3, 0x17090e0}, 0xac9a348)
	/home/swarming/.swarming/w/ir/x/w/targetrepo4102910141/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1062180, 0xafa4768}, 0xac9a348)
	/home/swarming/.swarming/w/ir/x/w/targetrepo4102910141/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x8389424, {0x1062180, 0xafa4768}, {0x105cef8, 0xafa47e0}, {0x105cef8, 0xafa47f8})
...
golang.org/x/tools/go/packages.goListDriver(0xae9b284, 0xaef3db8, {0x0, 0x0}, {0x9e6ec00, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo4102910141/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0xae9b284, {0x9e6ec00, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo4102910141/go/packages/packages.go:340 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo4102910141/go/packages/packages.go:387 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 48692
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-10 20:48 x_tools-go1.23-netbsd-arm tools@ab5f969b release-branch.go1.23@194de8fb x/tools/gopls/internal/test/integration/misc.TestRenameInTestVariant/default [ABORT] (log) 
=== RUN   TestRenameInTestVariant/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m6.560344118s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go mod tidy -modfile=/home/swarming/.swarming/w/ir/x/t/gopls-tempmod1394905544/go.mod
		pid:15230

goroutine 61188 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1ce6046db762312, 0xe87cba291e, 0x16b3f68}, 0x8fa5938)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3489243662/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1041a60, 0xa0b28d0}, 0x8fa5938)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3489243662/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x91f1aec, {0x1041a60, 0xa0b28d0}, {0x103c9d8, 0xa0b2948}, {0x103c9d8, 0xa0b2960})
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).ModTidy.func1({0x1041a7c, 0xceb6ba0}, {0xd27f38, 0xa5105a8})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3489243662/gopls/internal/cache/mod_tidy.go:80 +0x44
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3489243662/internal/memoize/memoize.go:187 +0xa8
runtime/trace.WithRegion({0x1041a7c, 0xceb6ba0}, {0x10dc18a8, 0x13}, 0xd0befc4)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/trace/annotation.go:141 +0xdc
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3489243662/internal/memoize/memoize.go:180 +0x108
created by golang.org/x/tools/internal/memoize.(*Promise).run in goroutine 61187
	/home/swarming/.swarming/w/ir/x/w/targetrepo3489243662/internal/memoize/memoize.go:179 +0x1dc

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-11 18:53 x_tools-go1.24-netbsd-arm tools@47df42f1 release-branch.go1.24@26682773 x/tools/gopls/internal/test/integration/workspace.TestReinitializeRepeatedly/default [ABORT] (log) 
=== RUN   TestReinitializeRepeatedly/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m14.466868662s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-904696743/TestReinitializeRepeatedly/default/work/moda/a/... /home/swarming/.swarming/w/ir/x/t/gopls-test-904696743/TestReinitializeRepeatedly/default/work/modb/... builtin
		pid:28734

goroutine 8658 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1cea4c7e2be7e73, 0xd47ccff0b, 0x1729120}, 0x7f95868)
	/home/swarming/.swarming/w/ir/x/w/targetrepo291595978/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x107a0f8, 0x8d66a80}, 0x7f95868)
	/home/swarming/.swarming/w/ir/x/w/targetrepo291595978/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x811b424, {0x107a0f8, 0x8d66a80}, {0x1074e28, 0x8d66af8}, {0x1074e28, 0x8d66b10})
...
golang.org/x/tools/go/packages.goListDriver(0x8862184, 0x8d66780, {0x0, 0x0}, {0x8fe5be0, 0x3, 0x4})
	/home/swarming/.swarming/w/ir/x/w/targetrepo291595978/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0x8862184, {0x8fe5be0, 0x3, 0x4})
	/home/swarming/.swarming/w/ir/x/w/targetrepo291595978/go/packages/packages.go:340 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo291595978/go/packages/packages.go:387 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 8632
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-10 20:48 x_tools-go1.22-netbsd-arm tools@ab5f969b release-branch.go1.22@8f3f22ee x/tools/gopls/internal/test/integration/misc.TestReferencesInTestVariants/default [ABORT] (log) 
=== RUN   TestReferencesInTestVariants/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m3.476134233s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-2273289646/TestReferencesInTestVariants/default/work/... builtin
		pid:12423

goroutine 53751 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1ce65a887d25567, 0x1239f016f3f, 0x16c3f20}, 0xb41a828)
	/home/swarming/.swarming/w/ir/x/w/targetrepo909544892/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1041848, 0xb435a88}, 0xb41a828)
	/home/swarming/.swarming/w/ir/x/w/targetrepo909544892/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x9b49468, {0x1041848, 0xb435a88}, {0x103c7c0, 0xb435b00}, {0x103c7c0, 0xb435b18})
...
golang.org/x/tools/go/packages.goListDriver(0xb5d0184, 0xb5c49a8, {0x0, 0x0}, {0x11ffdda0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo909544892/go/packages/golist.go:210 +0x808
golang.org/x/tools/go/packages.defaultDriver.func1(0xb5d0184, {0x11ffdda0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo909544892/go/packages/packages.go:340 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo909544892/go/packages/packages.go:387 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 53710
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-11 20:32 x_tools-go1.23-netbsd-arm tools@dd4bf11f release-branch.go1.23@69c8cfe2 x/tools/gopls/internal/test/integration/misc.TestChangeConfiguration/default [ABORT] (log) 
=== RUN   TestChangeConfiguration/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m17.057443196s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go mod tidy -modfile=/home/swarming/.swarming/w/ir/x/t/gopls-tempmod42198130/go.mod
		pid:24026

goroutine 1367 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1cedb2e29ec8e70, 0x30c98dc09, 0x16b3f68}, 0x934d6c8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3333157364/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1041a70, 0x9bf6f30}, 0x934d6c8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3333157364/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x825faec, {0x1041a70, 0x9bf6f30}, {0x103c9e8, 0x9bf6fa8}, {0x103c9e8, 0x9bf6fc0})
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).ModTidy.func1({0x1041a8c, 0x9bf44e0}, {0xd27f38, 0x9c7ac88})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3333157364/gopls/internal/cache/mod_tidy.go:80 +0x44
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3333157364/internal/memoize/memoize.go:187 +0xa8
runtime/trace.WithRegion({0x1041a8c, 0x9bf44e0}, {0x9b98d50, 0x13}, 0x7d187c4)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/trace/annotation.go:141 +0xdc
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3333157364/internal/memoize/memoize.go:180 +0x108
created by golang.org/x/tools/internal/memoize.(*Promise).run in goroutine 1366
	/home/swarming/.swarming/w/ir/x/w/targetrepo3333157364/internal/memoize/memoize.go:179 +0x1dc

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-14 16:04 x_tools-go1.22-netbsd-arm tools@a255cbe7 release-branch.go1.22@8f3f22ee x/tools/gopls/internal/test/integration/misc.TestTelemetryPrompt_Conditions_Mode/telemetryPrompt=true/initial_mode=local/default [ABORT] (log) 
=== RUN   TestTelemetryPrompt_Conditions_Mode/telemetryPrompt=true/initial_mode=local/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m26.627663232s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-1720560976/TestTelemetryPrompt_Conditions_Mode/telemetryPrompt=true/initial_mode=local/default/work/... builtin
		pid:18514

goroutine 47370 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1cf8c9c2255882b, 0x9a7ea2e2c8, 0x16e47c0}, 0x9d39d48)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2189800688/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1056230, 0x9d73908}, 0x9d39d48)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2189800688/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xb0ed468, {0x1056230, 0x9d73908}, {0x1051160, 0x9d73980}, {0x1051160, 0x9d73998})
...
golang.org/x/tools/go/packages.goListDriver(0xbcd8804, 0x9d73758, {0x0, 0x0}, {0x9d74ec0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2189800688/go/packages/golist.go:210 +0x808
golang.org/x/tools/go/packages.defaultDriver.func1(0xbcd8804, {0x9d74ec0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2189800688/go/packages/packages.go:340 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2189800688/go/packages/packages.go:387 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 47394
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
2024-12-16 20:01 x_tools-go1.22-netbsd-arm tools@c73f4c81 release-branch.go1.22@8f3f22ee x/tools/gopls/internal/test/integration/codelens.TestGCDetails_Toggle/default [ABORT] (log) 
=== RUN   TestGCDetails_Toggle/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m24.68863469s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -gcflags=-json=0,file:///home/swarming/.swarming/w/ir/x/t/gopls-11496.details510928296 -o=/home/swarming/.swarming/w/ir/x/t/gopls-x428071031 .
		pid:16101

goroutine 5230 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d042562ca58240, 0xbf8f99db7, 0x1613f00}, 0xc0829c8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0xfc5028, 0xc2f0a80}, 0xc0829c8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xa21fac4, {0xfc5028, 0xc2f0a80}, {0xfbffb8, 0xc2f0af8}, {0xfbffb8, 0xc2f0b10})
...
golang.org/x/tools/internal/gocommand.(*Runner).Run(0xbb6aa68, {0xfc5028, 0x843d380}, {{0xcc7b40, 0x5}, {0xc2f0990, 0x3, 0x3}, {0x0, 0x0, ...}, ...})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/internal/gocommand/invoke.go:74 +0x1f8
golang.org/x/tools/gopls/internal/golang.GCOptimizationDetails({0xfc5028, 0x843d380}, 0x843a328, 0x7ccd448)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/gopls/internal/golang/gc_annotations.go:68 +0x4c8
golang.org/x/tools/gopls/internal/server.(*server).gcDetailsDiagnostics(0xa1d25a8, {0xfc5028, 0x843d380}, 0x843a328, 0xc890a20)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/gopls/internal/server/diagnostics.go:557 +0x1a8
golang.org/x/tools/gopls/internal/server.(*server).diagnose.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/gopls/internal/server/diagnostics.go:487 +0x74
created by golang.org/x/tools/gopls/internal/server.(*server).diagnose in goroutine 4667
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/gopls/internal/server/diagnostics.go:485 +0xad4
2024-12-16 20:01 x_tools-go1.22-netbsd-arm tools@c73f4c81 release-branch.go1.22@8f3f22ee x/tools/gopls/internal/test/integration/diagnostics.TestNoGOPATH_Issue37984/default [ABORT] (log) 
=== RUN   TestNoGOPATH_Issue37984/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m25.683761698s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- ./
		pid:2505

goroutine 18545 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d0427a66e6fb6d, 0x29d0c4a180, 0x1634200}, 0x97376c8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0xfdae38, 0x9768918}, 0x97376c8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x8eb7468, {0xfdae38, 0x9768918}, {0xfd5db8, 0x9768990}, {0xfd5db8, 0x97689a8})
...
golang.org/x/tools/go/packages.goListDriver(0x9701584, 0x97686f0, {0x0, 0x0}, {0xbaab608, 0x1, 0x1})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/go/packages/golist.go:210 +0x808
golang.org/x/tools/go/packages.defaultDriver.func1(0x9701584, {0xbaab608, 0x1, 0x1})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/go/packages/packages.go:340 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2938865172/go/packages/packages.go:387 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 18544
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-17 23:14 x_tools-go1.23-netbsd-arm tools@fcb4185e release-branch.go1.23@59b7d407 x/tools/gopls/internal/test/integration/misc.TestRenamePackage_InternalPackage/default [ABORT] (log) 
=== RUN   TestRenamePackage_InternalPackage/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m27.449739827s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-2897996791/TestRenamePackage_InternalPackage/default/work/... builtin
		pid:14750

goroutine 65369 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d0af76a78b9449, 0xf1a917c0ac, 0x16d4818}, 0x8b19ba8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo622363945/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1057238, 0xbc008e8}, 0x8b19ba8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo622363945/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x85a7468, {0x1057238, 0xbc008e8}, {0x1052168, 0xbc00960}, {0x1052168, 0xbc00978})
...
golang.org/x/tools/go/packages.goListDriver(0x9980f84, 0xc33e1e0, {0x0, 0x0}, {0xc6b0230, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo622363945/go/packages/golist.go:210 +0x808
golang.org/x/tools/go/packages.defaultDriver.func1(0x9980f84, {0xc6b0230, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo622363945/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo622363945/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 65382
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-17 23:14 x_tools-go1.24-netbsd-arm tools@fcb4185e release-branch.go1.24@16afa6a7 x/tools/gopls/internal/test/integration/codelens.TestRegenerateCgo/default [ABORT] (log) 
=== RUN   TestRegenerateCgo/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m8.341888876s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-693835726/TestRegenerateCgo/default/work/... builtin
		pid:7031

goroutine 3568 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d0a1f21718963e, 0x8af03cca2, 0x16e96f0}, 0x985c688)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3778452128/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1051f28, 0xd4bd2f0}, 0x985c688)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3778452128/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xd291424, {0x1051f28, 0xd4bd2f0}, {0x104ccc0, 0xd4bd368}, {0x104ccc0, 0xd4bd380})
...
golang.org/x/tools/go/packages.goListDriver(0x92f2584, 0xd2310f8, {0x0, 0x0}, {0xd2360b0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3778452128/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0x92f2584, {0xd2360b0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3778452128/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3778452128/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 3510
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
2024-12-18 20:17 x_tools-go1.24-netbsd-arm tools@88435902 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/test/integration/codelens.TestGCDetails_Toggle/default [ABORT] (log) 
=== RUN   TestGCDetails_Toggle/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m4.612397457s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -gcflags=-json=0,file:///home/swarming/.swarming/w/ir/x/t/gopls-23955.details673043239 -o=/home/swarming/.swarming/w/ir/x/t/gopls-x961683471 .
		pid:24140

goroutine 5813 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d0ff046b07cff5, 0xcbf5adbd1, 0x16e9800}, 0xd3a28f8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1052dc8, 0xdf42918}, 0xd3a28f8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x1c33aa0, {0x1052dc8, 0xdf42918}, {0x104db60, 0xdf42990}, {0x104db60, 0xdf429a8})
...
golang.org/x/tools/internal/gocommand.(*Runner).Run(0xe78dc50, {0x1052dc8, 0x8ebb020}, {{0xd3de8e, 0x5}, {0xdf42828, 0x3, 0x3}, {0x0, 0x0, ...}, ...})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/internal/gocommand/invoke.go:74 +0x1ec
golang.org/x/tools/gopls/internal/golang.GCOptimizationDetails({0x1052dc8, 0x8ebb020}, 0xbcb6968, 0xcb92b48)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/gopls/internal/golang/gc_annotations.go:68 +0x4d0
golang.org/x/tools/gopls/internal/server.(*server).gcDetailsDiagnostics(0x8fd6d28, {0x1052dc8, 0x8ebb020}, 0xbcb6968, 0xdfa9480)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/gopls/internal/server/diagnostics.go:557 +0x1a8
golang.org/x/tools/gopls/internal/server.(*server).diagnose.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/gopls/internal/server/diagnostics.go:487 +0x74
created by golang.org/x/tools/gopls/internal/server.(*server).diagnose in goroutine 5191
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/gopls/internal/server/diagnostics.go:485 +0xae8
2024-12-18 20:17 x_tools-go1.24-netbsd-arm tools@88435902 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/test/integration/diagnostics.TestIssue37978/default [ABORT] (log) 
=== RUN   TestIssue37978/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m13.668820889s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-3325869555/TestIssue37978/default/work/c
		pid:25586

goroutine 11341 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d0ff21cb93b70d, 0x240a7a9b8e, 0x1729b00}, 0x123a8a98)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1078c40, 0x1239ed50}, 0x123a8a98)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x117b9300, {0x1078c40, 0x1239ed50}, {0x10739d0, 0x1239edc8}, {0x10739d0, 0x1239ede0})
...
golang.org/x/tools/go/packages.goListDriver(0x11dd1d04, 0x1239e9a8, {0x0, 0x0}, {0x11dddc70, 0x1, 0x1})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/go/packages/golist.go:218 +0x8e4
golang.org/x/tools/go/packages.defaultDriver.func1(0x11dd1d04, {0x11dddc70, 0x1, 0x1})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1572448470/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 11340
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-20 18:39 x_tools-go1.24-netbsd-arm tools@cb7945a7 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/test/integration/diagnostics.TestErrorsThatPreventAnalysis/default [ABORT] (log) 
=== RUN   TestErrorsThatPreventAnalysis/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m4.805785387s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-1610860074/TestErrorsThatPreventAnalysis/default/work/... builtin
		pid:11660

goroutine 49702 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d19030d6e018e1, 0x123ba9403cd, 0x1729b40}, 0x7ef4ea8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x10777b8, 0x11220de0}, 0x7ef4ea8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xbbed424, {0x10777b8, 0x11220de0}, {0x1072528, 0x11220e58}, {0x1072528, 0x11220e70})
...
golang.org/x/tools/go/packages.goListDriver(0xdf33284, 0x111d10b0, {0x0, 0x0}, {0xe828e10, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0xdf33284, {0xe828e10, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 49550
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
2024-12-20 18:39 x_tools-go1.24-netbsd-arm tools@cb7945a7 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/test/integration/workspace.TestClearNonWorkspaceDiagnostics/default [ABORT] (log) 
=== RUN   TestClearNonWorkspaceDiagnostics/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m14.909674834s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -m -e -json ...
		pid:1846

goroutine 30604 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d18fea2b5b6b90, 0x46cc277ee6, 0x1759b80}, 0xc23fd48)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x109f798, 0x17659f8}, 0xc23fd48)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x7d79960, {0x109f798, 0x17659f8}, {0x109a448, 0xdb20300}, {0x109a448, 0xdb20318})
...
golang.org/x/tools/internal/imports.newModuleResolver(0xb742370, 0xe078a20)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/internal/imports/mod.go:158 +0x990
golang.org/x/tools/internal/imports.(*ProcessEnv).GetResolver(0xb742370)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/internal/imports/fix.go:1036 +0x244
golang.org/x/tools/gopls/internal/cache.(*importsState).refreshProcessEnv(0xb71c9c0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/gopls/internal/cache/imports.go:233 +0xbc
golang.org/x/tools/gopls/internal/cache.(*refreshTimer).schedule.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1625632369/gopls/internal/cache/imports.go:73 +0x64
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:215 +0x2c
2024-12-20 21:24 x_tools-go1.24-netbsd-arm tools@ea69910e release-branch.go1.24@16afa6a7 x/tools/gopls/internal/test/integration/codelens.TestRegenerateCgo/default [ABORT] (log) 
=== RUN   TestRegenerateCgo/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m10.095875114s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-2099213296/TestRegenerateCgo/default/work/... builtin
		pid:22176

goroutine 3628 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d198995bc83e1f, 0x990a1f8f5, 0x16e9840}, 0xc7db118)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3466047753/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1051958, 0xc46e510}, 0xc7db118)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3466047753/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x7d99424, {0x1051958, 0xc46e510}, {0x104c6d0, 0xc46e588}, {0x104c6d0, 0xc46e5a0})
...
golang.org/x/tools/go/packages.Load(0xcffb3b0, {0xd2b1520, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3466047753/go/packages/packages.go:269 +0x4c
golang.org/x/tools/gopls/internal/cache.(*Snapshot).load(0xb12bae8, {0x1051974, 0xc4468d0}, 0x1, {0xd2b1510, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3466047753/gopls/internal/cache/load.go:130 +0xb34
golang.org/x/tools/gopls/internal/cache.(*Snapshot).initialize(0xb12bae8, {0x1051974, 0xc4468d0}, 0x1)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3466047753/gopls/internal/cache/view.go:691 +0x308
golang.org/x/tools/gopls/internal/cache.(*Session).createView.func3()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3466047753/gopls/internal/cache/session.go:291 +0x54
created by golang.org/x/tools/gopls/internal/cache.(*Session).createView in goroutine 3448
	/home/swarming/.swarming/w/ir/x/w/targetrepo3466047753/gopls/internal/cache/session.go:289 +0x1878

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-21 17:57 x_tools-go1.23-netbsd-arm tools@ebeac1b8 release-branch.go1.23@1576793c x/tools/gopls/internal/test/integration/codelens.TestGCDetails_Toggle/default [ABORT] (log) 
=== RUN   TestGCDetails_Toggle/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m15.894791022s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -gcflags=-json=0,file:///home/swarming/.swarming/w/ir/x/t/gopls-16765.details2114507531 -o=/home/swarming/.swarming/w/ir/x/t/gopls-x3515352936 .
		pid:14996

goroutine 5057 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d1e63cc8ba4722, 0xb551e2b36, 0x1614018}, 0xc6f9458)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1990929962/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0xfc4ae8, 0x7ff2e88}, 0xc6f9458)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1990929962/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xbbc3ac4, {0xfc4ae8, 0x7ff2e88}, {0xfbfa58, 0x7ff2f00}, {0xfbfa58, 0x7ff2f18})
...
golang.org/x/tools/internal/gocommand.(*Runner).Run(0xbba6fd8, {0xfc4ae8, 0x8667980}, {{0xcc7ffe, 0x5}, {0x7ff2d98, 0x3, 0x3}, {0x0, 0x0, ...}, ...})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1990929962/internal/gocommand/invoke.go:74 +0x1f8
golang.org/x/tools/gopls/internal/golang.GCOptimizationDetails({0xfc4ae8, 0x8667980}, 0x18b5548, 0x1beabd8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1990929962/gopls/internal/golang/gc_annotations.go:68 +0x4c8
golang.org/x/tools/gopls/internal/server.(*server).gcDetailsDiagnostics(0x1c60c38, {0xfc4ae8, 0x8667980}, 0x18b5548, 0x84a7760)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1990929962/gopls/internal/server/diagnostics.go:557 +0x1a8
golang.org/x/tools/gopls/internal/server.(*server).diagnose.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1990929962/gopls/internal/server/diagnostics.go:487 +0x74
created by golang.org/x/tools/gopls/internal/server.(*server).diagnose in goroutine 5071
	/home/swarming/.swarming/w/ir/x/w/targetrepo1990929962/gopls/internal/server/diagnostics.go:485 +0xad4
2024-12-23 17:52 x_tools-go1.23-netbsd-arm tools@b75baa00 release-branch.go1.23@1576793c x/tools/gopls/internal/test/integration/misc.TestAcceptImportsQuickFixTestVariant/default [ABORT] (log) 
=== RUN   TestAcceptImportsQuickFixTestVariant/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m20.484927378s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go mod tidy -modfile=/home/swarming/.swarming/w/ir/x/t/gopls-tempmod2167629225/go.mod
		pid:11115

goroutine 46212 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d29acab18da0c9, 0xba6a7c7a96, 0x16e48d8}, 0xae50008)
	/home/swarming/.swarming/w/ir/x/w/targetrepo108354006/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1067040, 0xa8dd740}, 0xae50008)
	/home/swarming/.swarming/w/ir/x/w/targetrepo108354006/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x9683aec, {0x1067040, 0xa8dd740}, {0x1061f50, 0xa8dd7b8}, {0x1061f50, 0xa8dd7d0})
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).ModTidy.func1({0x106705c, 0xa1232c0}, {0xd4b0e8, 0xa3e9b88})
	/home/swarming/.swarming/w/ir/x/w/targetrepo108354006/gopls/internal/cache/mod_tidy.go:80 +0x44
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo108354006/internal/memoize/memoize.go:187 +0xa8
runtime/trace.WithRegion({0x106705c, 0xa1232c0}, {0xa41f410, 0x13}, 0x1d6e7c4)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/trace/annotation.go:141 +0xdc
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo108354006/internal/memoize/memoize.go:180 +0x108
created by golang.org/x/tools/internal/memoize.(*Promise).run in goroutine 46211
	/home/swarming/.swarming/w/ir/x/w/targetrepo108354006/internal/memoize/memoize.go:179 +0x1dc

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-23 21:52 x_tools-go1.24-netbsd-arm tools@02033b26 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/test/integration/codelens.TestRegenerateCgo/default [ABORT] (log) 
=== RUN   TestRegenerateCgo/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m16.310556765s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-1607560986/TestRegenerateCgo/default/work/... builtin
		pid:25473

goroutine 2030 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d2cd40164a2566, 0x5a55da006, 0x17098e8}, 0x9b4f1e8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2262619753/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x10638c8, 0x9b68510}, 0x9b4f1e8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2262619753/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x7d5b424, {0x10638c8, 0x9b68510}, {0x105e628, 0x9b68588}, {0x105e628, 0x9b685a0})
...
golang.org/x/tools/go/packages.goListDriver(0x9b52d04, 0x9b68228, {0x0, 0x0}, {0x9b43410, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2262619753/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0x9b52d04, {0x9b43410, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2262619753/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2262619753/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 2022
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-23 20:38 x_tools-go1.22-netbsd-arm tools@aa94d89d release-branch.go1.22@8f3f22ee x/tools/gopls/internal/test/integration/codelens.TestRegenerateCgo/default [ABORT] (log) 
=== RUN   TestRegenerateCgo/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m24.824324909s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-3351404173/TestRegenerateCgo/default/work/... builtin
		pid:1939

goroutine 1912 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d2e02a02c92d0e, 0x594de3d2a, 0x1624048}, 0x9b0d868)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3613242603/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0xfc6158, 0x9cda5a0}, 0x9b0d868)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3613242603/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x1927468, {0xfc6158, 0x9cda5a0}, {0xfc10b0, 0x9cda618}, {0xfc10b0, 0x9cda630})
...
golang.org/x/tools/go/packages.Load(0x9d1f630, {0x9d42960, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3613242603/go/packages/packages.go:269 +0x4c
golang.org/x/tools/gopls/internal/cache.(*Snapshot).load(0x9d20648, {0xfc6174, 0x9ae3620}, 0x1, {0x9d42950, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3613242603/gopls/internal/cache/load.go:130 +0xb08
golang.org/x/tools/gopls/internal/cache.(*Snapshot).initialize(0x9d20648, {0xfc6174, 0x9ae3620}, 0x1)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3613242603/gopls/internal/cache/view.go:691 +0x2e4
golang.org/x/tools/gopls/internal/cache.(*Session).createView.func3()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3613242603/gopls/internal/cache/session.go:291 +0x54
created by golang.org/x/tools/gopls/internal/cache.(*Session).createView in goroutine 1884
	/home/swarming/.swarming/w/ir/x/w/targetrepo3613242603/gopls/internal/cache/session.go:289 +0x1890

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2024-12-23 22:56 x_tools-gotip-netbsd-arm tools@20cd540c go@772f024c x/tools/gopls/internal/test/integration/misc.TestTelemetryPrompt_PromptFile/v0.15-format/pYes/default [ABORT] (log) 
=== RUN   TestTelemetryPrompt_PromptFile/v0.15-format/pYes/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m2.761032346s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-3982118813/TestTelemetryPrompt_PromptFile/v0.15-format/pYes/default/work/... builtin
		pid:5421

goroutine 52360 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d2d87b125cb4b1, 0x813d4fe128, 0x17da1c0}, 0xd68aa98)
	/home/swarming/.swarming/w/ir/x/w/targetrepo983436677/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x10f6c6c, 0xd712318}, 0xd68aa98)
	/home/swarming/.swarming/w/ir/x/w/targetrepo983436677/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x877d424, {0x10f6c6c, 0xd712318}, {0x10f1998, 0xd712390}, {0x10f1998, 0xd7123a8})
...
golang.org/x/tools/go/packages.goListDriver(0xd63b804, 0xd712030, {0x0, 0x0}, {0xd6bcbe0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo983436677/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0xd63b804, {0xd6bcbe0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo983436677/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo983436677/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 52315
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-09 17:03 x_tools-go1.22-netbsd-arm tools@df3de6ae release-branch.go1.22@ae9996f9 x/tools/gopls/internal/test/integration/misc.TestCompilerOptDetails/default [ABORT] (log) 
=== RUN   TestCompilerOptDetails/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m3.05751999s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -gcflags=-json=0,file:///home/swarming/.swarming/w/ir/x/t/gopls-22333.details502738127 -o=/home/swarming/.swarming/w/ir/x/t/gopls-x393480654 .
		pid:19850

goroutine 2773 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d83cdcae4c8b2f, 0x61803b03e, 0x1724ac0}, 0x8f0a1a8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3645060916/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x107ff10, 0xca67458}, 0x8f0a1a8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3645060916/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x1927ac8, {0x107ff10, 0xca67458}, {0x107ad08, 0xca674d0}, {0x107ad08, 0xca674e8})
...
golang.org/x/tools/internal/gocommand.(*Runner).Run(0x81a9a28, {0x107ff10, 0xc326090}, {{0xd652a9, 0x5}, {0xca67368, 0x3, 0x3}, {0x0, 0x0, ...}, ...})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3645060916/internal/gocommand/invoke.go:74 +0x1f8
golang.org/x/tools/gopls/internal/golang.CompilerOptDetails({0x107ff10, 0xc326090}, 0xc0e8aa8, 0x19ef178)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3645060916/gopls/internal/golang/compileropt.go:62 +0x4c8
golang.org/x/tools/gopls/internal/server.(*server).compilerOptDetailsDiagnostics(0x1c1cf08, {0x107ff10, 0xc326090}, 0xc0e8aa8, 0x80a3680)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3645060916/gopls/internal/server/diagnostics.go:557 +0x1a8
golang.org/x/tools/gopls/internal/server.(*server).diagnose.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3645060916/gopls/internal/server/diagnostics.go:487 +0x74
created by golang.org/x/tools/gopls/internal/server.(*server).diagnose in goroutine 2076
	/home/swarming/.swarming/w/ir/x/w/targetrepo3645060916/gopls/internal/server/diagnostics.go:485 +0xad4

— watchflakes

apstndb pushed a commit to apstndb/gotoolsdiff that referenced this issue Jan 11, 2025
@adonovan
internal/gocommand: more tweaks to DebugHangingGoCommands
cb7c137 
As suggested by bcmills, this change increases the time
between SIGINT and SIGKILL to 5s (was 1s), and also
suppresses the process dump if SIGKILL returned
"already done".

Updates golang/go#57999
Updates golang/go#54461

Change-Id: Ie0e55a69d3bbfb4224e5f4ea272c7c2f3210e342
Reviewed-on: https://go-review.googlesource.com/c/tools/+/483215
Run-TryBot: Alan Donovan <adonovan@google.com>
gopls-CI: kokoro <noreply+kokoro@google.com>
Reviewed-by: Robert Findley <rfindley@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-14 22:31 x_tools-go1.24-netbsd-arm tools@9d9b0b6e release-branch.go1.24@e06b6fc5 x/tools/gopls/internal/test/integration/misc.TestCompilerOptDetails_perDirectory/default [ABORT] (log) 
=== RUN   TestCompilerOptDetails_perDirectory/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m14.597738783s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go test -c -vet=off -gcflags=-json=0,file:///home/swarming/.swarming/w/ir/x/t/gopls-4871.details3951251997 -o=/dev/null .
		pid:23380

goroutine 3505 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1d9ee72b04ace30, 0xfe043649d, 0x180a320}, 0x9cdfc78)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1860986651/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x111f32c, 0xa56d1b8}, 0x9cdfc78)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1860986651/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xa149a8c, {0x111f32c, 0xa56d1b8}, {0x111a020, 0xa56d230}, {0x111a020, 0xa56d248})
...
golang.org/x/tools/internal/gocommand.(*Runner).Run(0xa28d8c0, {0x111f32c, 0xa682138}, {{0xdeaa10, 0x4}, {0xa706180, 0x5, 0x5}, {0x0, 0x0, ...}, ...})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1860986651/internal/gocommand/invoke.go:74 +0x1ec
golang.org/x/tools/gopls/internal/golang.CompilerOptDetails({0x111f32c, 0xa682138}, 0x1f5d908, {0xa708600, 0x71})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1860986651/gopls/internal/golang/compileropt.go:57 +0x418
golang.org/x/tools/gopls/internal/server.(*server).compilerOptDetailsDiagnostics(0x808eff8, {0x111f32c, 0xa682138}, 0x1f5d908, 0xa29f620)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1860986651/gopls/internal/server/diagnostics.go:575 +0x188
golang.org/x/tools/gopls/internal/server.(*server).diagnose.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1860986651/gopls/internal/server/diagnostics.go:488 +0x74
created by golang.org/x/tools/gopls/internal/server.(*server).diagnose in goroutine 3652
	/home/swarming/.swarming/w/ir/x/w/targetrepo1860986651/gopls/internal/server/diagnostics.go:486 +0xae8

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-15 20:34 x_tools-gotip-netbsd-arm tools@344e4825 go@1a93e4a2 x/tools/gopls/internal/test/integration/diagnostics.TestEditGoDirective/default [ABORT] (log) 
=== RUN   TestEditGoDirective/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 2m1.135614949s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-3084570784/TestEditGoDirective/default/work/... builtin
		pid:24471

goroutine 50273 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1daae4331766ba2, 0x1a125b8e5d4, 0x1769e38}, 0xb32b388)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x10a2074, 0xb331788}, 0xb32b388)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x8097424, {0x10a2074, 0xb331788}, {0x109cdb8, 0xb331800}, {0x109cdb8, 0xb331818})
...
golang.org/x/tools/go/packages.goListDriver(0xb509484, 0xb40e3c0, {0x0, 0x0}, {0xbac1e90, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0xb509484, {0xbac1e90, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 50268
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
2025-01-15 20:34 x_tools-gotip-netbsd-arm tools@344e4825 go@1a93e4a2 x/tools/gopls/internal/test/integration/workspace.TestPackagesWithTests/file/default [ABORT] (log) 
=== RUN   TestPackagesWithTests/file/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m2.925414392s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-4169045236/TestPackagesWithTests/file/default/work/... builtin
		pid:973

goroutine 10338 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1daadcf03ed8495, 0x1528a93520, 0x1799e68}, 0xb1905b8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x10c9f0c, 0xb1952d8}, 0xb1905b8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x1b95424, {0x10c9f0c, 0xb1952d8}, {0x10c4c00, 0xb195350}, {0x10c4c00, 0xb195368})
...
golang.org/x/tools/go/packages.goListDriver(0xf41e604, 0xaecdd28, {0x0, 0x0}, {0xaed3380, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0xf41e604, {0xaed3380, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1136517513/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 10190
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-15 20:34 x_tools-go1.24-netbsd-arm tools@344e4825 release-branch.go1.24@8a4c24f9 x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/invalid/default [ABORT] (log) 
=== RUN   TestRunVulncheckPackageDiagnostics/invalid/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m1.741190164s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-407105235/TestRunVulncheckPackageDiagnostics/invalid/default/work/... builtin
		pid:24411

goroutine 85324 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1daa29a1857c659, 0xee276366cd, 0x180a320}, 0x97921a8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo955734153/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x111f2bc, 0x12ab3b30}, 0x97921a8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo955734153/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x8d27424, {0x111f2bc, 0x12ab3b30}, {0x1119fb0, 0x12ab3ba8}, {0x1119fb0, 0x12ab3bc0})
...
golang.org/x/tools/go/packages.goListDriver(0xd9f0184, 0x12ab36e0, {0x0, 0x0}, {0x9c435c0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo955734153/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0xd9f0184, {0x9c435c0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo955734153/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo955734153/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 85308
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-21 19:44 x_tools-go1.24-netbsd-arm tools@b0164fc0 release-branch.go1.24@8a4c24f9 x/tools/gopls/internal/test/integration/misc.TestRenamePackageWithDifferentDirectoryPath/default [ABORT] (log) 
=== RUN   TestRenamePackageWithDifferentDirectoryPath/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m57.293956186s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go env -json GO111MODULE GOFLAGS GOINSECURE GOMOD GOMODCACHE GONOPROXY GONOSUMDB GOPATH GOPROXY GOROOT GOSUMDB GOWORK
		pid:27927

goroutine 63892 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1dc24a6ce86da9c, 0xcd66907e64, 0x180a328}, 0x20a8ea8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1998441430/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1120214, 0x18161a0}, 0x20a8ea8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1998441430/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xada3ae8, {0x1120214, 0x18161a0}, {0x111ae98, 0xb943e00}, {0x111ae98, 0xb943e18})
...
golang.org/x/tools/internal/imports.(*ProcessEnv).init(0x1e1d7c0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1998441430/internal/imports/fix.go:999 +0x25c
golang.org/x/tools/internal/imports.(*ProcessEnv).GetResolver(0x1e1d7c0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1998441430/internal/imports/fix.go:1022 +0x1c
golang.org/x/tools/gopls/internal/cache.(*importsState).refreshProcessEnv(0x153e9ec0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1998441430/gopls/internal/cache/imports.go:266 +0xbc
golang.org/x/tools/gopls/internal/cache.(*refreshTimer).schedule.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1998441430/gopls/internal/cache/imports.go:71 +0x64
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:215 +0x2c

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-21 19:44 x_tools-go1.22-netbsd-arm tools@b0164fc0 release-branch.go1.22@c3c6a500 x/tools/gopls/internal/test/integration/misc.TestGenerateProgress/default [ABORT] (log) 
=== RUN   TestGenerateProgress/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m9.428161859s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go generate -x .
		pid:6057

goroutine 32512 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1dc1fddace65a35, 0x323c295b8b, 0x1734ad0}, 0x9a30b68)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3536143367/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1093038, 0x8d6a318}, 0x9a30b68)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3536143367/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x1061b6f0, {0x1093038, 0x8d6a318}, {0x108e170, 0x98f87d0}, {0x108dc50, 0x98f8820})
...
golang.org/x/tools/gopls/internal/lsprpc.(*streamServer).ServeStream.ServerHandler.func3({0x1093038, 0x9036ca8}, 0x8e11920, {0x10930fc, 0x8eb4060})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3536143367/gopls/internal/protocol/protocol.go:160 +0x84
golang.org/x/tools/gopls/internal/lsprpc.(*streamServer).ServeStream.handshaker.func4({0x1093038, 0x9036ca8}, 0x8e11920, {0x10930fc, 0x8eb4060})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3536143367/gopls/internal/lsprpc/lsprpc.go:509 +0x198
golang.org/x/tools/gopls/internal/protocol.Handlers.MustReplyHandler.func1({0x1093038, 0x9036ca8}, 0x9892530, {0x10930fc, 0x8eb4060})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3536143367/internal/jsonrpc2/handler.go:35 +0xbc
golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2.2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3536143367/internal/jsonrpc2/handler.go:104 +0x9c
created by golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2 in goroutine 32450
	/home/swarming/.swarming/w/ir/x/w/targetrepo3536143367/internal/jsonrpc2/handler.go:101 +0x228

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-21 19:44 x_tools-gotip-netbsd-arm tools@b0164fc0 go@f6d17c54 x/tools/gopls/internal/test/integration/misc.TestReferencesInTestVariants/default [ABORT] (log) 
=== RUN   TestReferencesInTestVariants/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m13.121410731s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-4102533045/TestReferencesInTestVariants/default/work/... builtin
		pid:20006

goroutine 59351 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1dc392064ee4a43, 0x100aa1411e0, 0x180a400}, 0x1c13d48)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2479065895/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x112085c, 0xba60708}, 0x1c13d48)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2479065895/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x1fbd424, {0x112085c, 0xba60708}, {0x111b550, 0xba60780}, {0x111b550, 0xba60798})
...
golang.org/x/tools/go/packages.goListDriver(0xbba2f84, 0xc87d4d0, {0x0, 0x0}, {0xc23cba0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2479065895/go/packages/golist.go:210 +0x800
golang.org/x/tools/go/packages.defaultDriver.func1(0xbba2f84, {0xc23cba0, 0x2, 0x2})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2479065895/go/packages/packages.go:343 +0x4c
golang.org/x/tools/go/packages.callDriverOnChunks.func1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2479065895/go/packages/packages.go:390 +0x68
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 59265
	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-21 15:00 x_tools-go1.23-netbsd-arm tools@df4e4ef6 release-branch.go1.23@ab44565b x/tools/gopls/internal/test/integration/diagnostics.TestChattyDiagnostics/default [ABORT] (log) 
=== RUN   TestChattyDiagnostics/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 2m24.529528872s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go mod tidy -modfile=/home/swarming/.swarming/w/ir/x/t/gopls-tempmod2664740980/go.mod
		pid:9870

goroutine 51568 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1dc132356ae0cea, 0x16ca1d9a0c9, 0x1684538}, 0x9cd8b68)
	/home/swarming/.swarming/w/ir/x/w/targetrepo253249220/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1015fd0, 0xcadc408}, 0x9cd8b68)
	/home/swarming/.swarming/w/ir/x/w/targetrepo253249220/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x94e7aec, {0x1015fd0, 0xcadc408}, {0x1010de8, 0xcadc480}, {0x1010de8, 0xcadc498})
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).ModTidy.func1({0x1015fec, 0xdbc2f30}, {0xd09508, 0x9dbc0a8})
	/home/swarming/.swarming/w/ir/x/w/targetrepo253249220/gopls/internal/cache/mod_tidy.go:80 +0x44
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo253249220/internal/memoize/memoize.go:187 +0xa8
runtime/trace.WithRegion({0x1015fec, 0xdbc2f30}, {0xe71cb70, 0x13}, 0xf070fc4)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/trace/annotation.go:141 +0xdc
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo253249220/internal/memoize/memoize.go:180 +0x108
created by golang.org/x/tools/internal/memoize.(*Promise).run in goroutine 51567
	/home/swarming/.swarming/w/ir/x/w/targetrepo253249220/internal/memoize/memoize.go:179 +0x1dc
2025-01-22 21:13 x_tools-go1.23-netbsd-arm tools@fcc9d81f release-branch.go1.23@ab44565b x/tools/gopls/internal/test/integration/misc.TestCompilerOptDetails_perDirectory/default [ABORT] (log) 
=== RUN   TestCompilerOptDetails_perDirectory/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m4.199197207s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go test -c -vet=off -gcflags=-json=0,file:///home/swarming/.swarming/w/ir/x/t/gopls-17859.details4208225291 -o=/dev/null .
		pid:23094

goroutine 3589 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1dc8f7b29b570e9, 0x228d36ab41, 0x1734b00}, 0xa454758)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2965983720/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1093458, 0xa58c528}, 0xa454758)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2965983720/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x8d0dac8, {0x1093458, 0xa58c528}, {0x108e230, 0xa58c5a0}, {0x108e230, 0xa58c5b8})
...
golang.org/x/tools/internal/gocommand.(*Runner).Run(0xa24b248, {0x1093458, 0xa50a810}, {{0xd75470, 0x4}, {0xa478db0, 0x5, 0x5}, {0x0, 0x0, ...}, ...})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2965983720/internal/gocommand/invoke.go:74 +0x1f8
golang.org/x/tools/gopls/internal/golang.CompilerOptDetails({0x1093458, 0xa50a810}, 0xa1cf7c8, {0xa582500, 0x70})
	/home/swarming/.swarming/w/ir/x/w/targetrepo2965983720/gopls/internal/golang/compileropt.go:57 +0x410
golang.org/x/tools/gopls/internal/server.(*server).compilerOptDetailsDiagnostics(0x1c38788, {0x1093458, 0xa50a810}, 0xa1cf7c8, 0xa36c0c0)
	/home/swarming/.swarming/w/ir/x/w/targetrepo2965983720/gopls/internal/server/diagnostics.go:575 +0x17c
golang.org/x/tools/gopls/internal/server.(*server).diagnose.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo2965983720/gopls/internal/server/diagnostics.go:488 +0x74
created by golang.org/x/tools/gopls/internal/server.(*server).diagnose in goroutine 3443
	/home/swarming/.swarming/w/ir/x/w/targetrepo2965983720/gopls/internal/server/diagnostics.go:486 +0xad4

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-22 17:54 x_tools-go1.24-netbsd-arm tools@30bd6fdf release-branch.go1.24@8a4c24f9 x/tools/gopls/internal/test/integration/misc.TestHoverAndDocumentLink/default [ABORT] (log) 
=== RUN   TestHoverAndDocumentLink/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m10.213105156s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go env -json GOPRIVATE GOMODCACHE GOARCH GOCACHE GOFLAGS GO111MODULE GOTOOLCHAIN GOROOT GOOS GOPATH
		pid:10519

goroutine 54962 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1dcb8d1a8708dea, 0x767a6b62ec, 0x180a328}, 0xd881a08)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3255214067/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x112029c, 0xcfaba28}, 0xd881a08)
	/home/swarming/.swarming/w/ir/x/w/targetrepo3255214067/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xe92d54c, {0x112029c, 0xcfaba28}, {0x111af90, 0xcfabaa0}, {0x111af90, 0xcfabab8})
...
golang.org/x/tools/gopls/internal/lsprpc.(*streamServer).ServeStream.ServerHandler.func3({0x112029c, 0xd118d20}, 0xd118d38, {0x7a5aee10, 0xd118a08})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3255214067/gopls/internal/protocol/protocol.go:160 +0x84
golang.org/x/tools/gopls/internal/lsprpc.(*streamServer).ServeStream.handshaker.func4({0x112029c, 0xd118d20}, 0xd118d38, {0x7a5aee10, 0xd118a08})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3255214067/gopls/internal/lsprpc/lsprpc.go:509 +0x198
golang.org/x/tools/gopls/internal/protocol.Handlers.MustReplyHandler.func1({0x112029c, 0xd118d20}, 0xf461e40, {0x7a5aee10, 0xd118a08})
	/home/swarming/.swarming/w/ir/x/w/targetrepo3255214067/internal/jsonrpc2/handler.go:35 +0xbc
golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2.2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo3255214067/internal/jsonrpc2/handler.go:104 +0x9c
created by golang.org/x/tools/gopls/internal/protocol.Handlers.AsyncHandler.func2 in goroutine 54796
	/home/swarming/.swarming/w/ir/x/w/targetrepo3255214067/internal/jsonrpc2/handler.go:101 +0x228

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-22 17:54 x_tools-go1.22-netbsd-arm tools@30bd6fdf release-branch.go1.22@c3c6a500 x/tools/gopls/internal/test/integration/misc.TestCompilerOptDetails_perDirectory/default [ABORT] (log) 
=== RUN   TestCompilerOptDetails_perDirectory/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m2.554147043s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go test -c -vet=off -gcflags=-json=0,file:///home/swarming/.swarming/w/ir/x/t/gopls-6518.details560525268 -o=/dev/null .
		pid:24631

goroutine 3099 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1dcbccce542e83e, 0x167d480464, 0x1734ad0}, 0x8fc3528)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1490635794/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x1093150, 0x8fe3920}, 0x8fc3528)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1490635794/internal/gocommand/invoke.go:391 +0x3e0
golang.org/x/tools/internal/gocommand.(*Invocation).run(0x1923ac8, {0x1093150, 0x8fe3920}, {0x108df28, 0x8fe3998}, {0x108df28, 0x8fe39b0})
...
golang.org/x/tools/internal/gocommand.(*Runner).Run(0x8dc78f0, {0x1093150, 0x8fe31d0}, {{0xd75492, 0x4}, {0x8fb9dd0, 0x5, 0x5}, {0x0, 0x0, ...}, ...})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1490635794/internal/gocommand/invoke.go:74 +0x1f8
golang.org/x/tools/gopls/internal/golang.CompilerOptDetails({0x1093150, 0x8fe31d0}, 0x91145a8, {0x8febd00, 0x71})
	/home/swarming/.swarming/w/ir/x/w/targetrepo1490635794/gopls/internal/golang/compileropt.go:57 +0x410
golang.org/x/tools/gopls/internal/server.(*server).compilerOptDetailsDiagnostics(0xd848e18, {0x1093150, 0x8fe31d0}, 0x91145a8, 0x8de7380)
	/home/swarming/.swarming/w/ir/x/w/targetrepo1490635794/gopls/internal/server/diagnostics.go:575 +0x17c
golang.org/x/tools/gopls/internal/server.(*server).diagnose.func4()
	/home/swarming/.swarming/w/ir/x/w/targetrepo1490635794/gopls/internal/server/diagnostics.go:488 +0x74
created by golang.org/x/tools/gopls/internal/server.(*server).diagnose in goroutine 3094
	/home/swarming/.swarming/w/ir/x/w/targetrepo1490635794/gopls/internal/server/diagnostics.go:486 +0xad4

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-22 17:02 x_tools-go1.24-netbsd-arm tools@e4adc385 release-branch.go1.24@8a4c24f9 x/tools/gopls/internal/test/integration/misc.TestRunGovulncheck_Expiry/default [ABORT] (log) 
=== RUN   TestRunGovulncheck_Expiry/default
DETECTED A HANGING GO COMMAND

The gopls test runner has detected a hanging go command. In order to debug
this, the output of ps and lsof/fstat is printed below.

See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
panic: detected hanging go command (golang/go#54461); waited 1m14.781111563s
		command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go mod tidy -modfile=/home/swarming/.swarming/w/ir/x/t/gopls-tempmod3409773720/go.mod
		pid:14695

goroutine 84868 [running]:
golang.org/x/tools/internal/gocommand.HandleHangingGoCommand({0xc1dcc53735471650, 0xd6d5ad4023, 0x180a328}, 0xd1c9ad8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo686810111/internal/gocommand/invoke.go:458 +0x4b0
golang.org/x/tools/internal/gocommand.runCmdContext({0x112029c, 0xa92ec90}, 0xd1c9ad8)
	/home/swarming/.swarming/w/ir/x/w/targetrepo686810111/internal/gocommand/invoke.go:391 +0x3d4
golang.org/x/tools/internal/gocommand.(*Invocation).run(0xba03ae8, {0x112029c, 0xa92ec90}, {0x111af90, 0xa92ed08}, {0x111af90, 0xa92ed20})
...
golang.org/x/tools/gopls/internal/cache.(*Snapshot).ModTidy.func1({0x11202b8, 0xc62e450}, {0xde5fc0, 0xf2cd188})
	/home/swarming/.swarming/w/ir/x/w/targetrepo686810111/gopls/internal/cache/mod_tidy.go:80 +0x44
golang.org/x/tools/internal/memoize.(*Promise).run.func2.1()
	/home/swarming/.swarming/w/ir/x/w/targetrepo686810111/internal/memoize/memoize.go:187 +0xa8
runtime/trace.WithRegion({0x11202b8, 0xc62e450}, {0xa2e5ce0, 0x13}, 0x1c47fc4)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/trace/annotation.go:141 +0xdc
golang.org/x/tools/internal/memoize.(*Promise).run.func2()
	/home/swarming/.swarming/w/ir/x/w/targetrepo686810111/internal/memoize/memoize.go:180 +0x108
created by golang.org/x/tools/internal/memoize.(*Promise).run in goroutine 84867
	/home/swarming/.swarming/w/ir/x/w/targetrepo686810111/internal/memoize/memoize.go:179 +0x1dc

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-27 18:43 x_tools-gotip-netbsd-arm tools@ac81e9f3 go@b9872221 x/tools/gopls/internal/test/integration/codelens.TestRegenerateCgo/default [ABORT] (log) 
=== RUN   TestRegenerateCgo/default
DETECTED A HANGING GO COMMAND

			The gopls test runner has detected a hanging go command. In order to debug
			this, the output of ps and lsof/fstat is printed below.

			See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
_dhcpcd  dhcpcd      1486   15* internet dgram udp 91cb3040
root     devpubd      701   wd  /                2 drwxr-xr-x     512 r 
root     devpubd      701    0  /              996 crw-rw-rw-    null rw
root     devpubd      701    1  /              996 crw-rw-rw-    null rw
root     devpubd      701    2  /              996 crw-rw-rw-    null rw
root     devpubd      701    3* drvctl_fileops 0x0
2025/01/28 15:44:02 Sending signal 3 to hanging go command: os: process already finished
2025/01/28 15:44:03 detected hanging go command (golang/go#54461); waited 1m42.681369857s
	command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,Export,DepOnly,Imports,ImportMap,TestImports,XTestImports,ForTest,DepsErrors,Module,EmbedFiles -compiled=true -test=true -export=false -deps=true -find=false -pgo=off -- /home/swarming/.swarming/w/ir/x/t/gopls-test-1347397310/TestRegenerateCgo/default/work/... builtin
	pid:15904
2025-01-27 18:43 x_tools-gotip-netbsd-arm tools@ac81e9f3 go@b9872221 x/tools/gopls/internal/test/integration/completion.TestCompleteAllFields/default [ABORT] (log) 
=== RUN   TestCompleteAllFields/default
DETECTED A HANGING GO COMMAND

			The gopls test runner has detected a hanging go command. In order to debug
			this, the output of ps and lsof/fstat is printed below.

			See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
_dhcpcd  dhcpcd      1486   15* internet dgram udp 91cb3040
root     devpubd      701   wd  /                2 drwxr-xr-x     512 r 
root     devpubd      701    0  /              996 crw-rw-rw-    null rw
root     devpubd      701    1  /              996 crw-rw-rw-    null rw
root     devpubd      701    2  /              996 crw-rw-rw-    null rw
root     devpubd      701    3* drvctl_fileops 0x0
2025/01/28 15:50:35 Sending signal 3 to hanging go command: os: process already finished
2025/01/28 15:50:36 detected hanging go command (golang/go#54461); waited 2m24.099020651s
	command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go mod tidy -modfile=/home/swarming/.swarming/w/ir/x/t/gopls-tempmod2252679106/go.mod
	pid:20347

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-01-28 15:38 x_tools-go1.22-netbsd-arm tools@8171d94f release-branch.go1.22@c3c6a500 x/tools/gopls/internal/test/integration/misc.TestWindowsVendoring_Issue56291/default [ABORT] (log) 
=== RUN   TestWindowsVendoring_Issue56291/default
DETECTED A HANGING GO COMMAND

			The gopls test runner has detected a hanging go command. In order to debug
			this, the output of ps and lsof/fstat is printed below.

			See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
_dhcpcd  dhcpcd      1341   14* link dgram  0 91d1d188
_dhcpcd  dhcpcd      1341   15* internet dgram udp 91d0d040
root     devpubd     1063   wd  /                2 drwxr-xr-x     512 r 
root     devpubd     1063    0  /              996 crw-rw-rw-    null rw
root     devpubd     1063    1  /              996 crw-rw-rw-    null rw
root     devpubd     1063    2  /              996 crw-rw-rw-    null rw
root     devpubd     1063    3* drvctl_fileops 0x0
invoke.go:474: detected hanging go command (golang/go#54461); waited 1m14.254874135s
	command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go mod tidy -modfile=/home/swarming/.swarming/w/ir/x/t/gopls-tempmod2485966268/go.mod
	pid:13037

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `netbsd-.*` && (log ~ `^\s*os\.wait6` || log ~ `^\s*syscall.wait4` || `DETECTED A HANGING GO COMMAND` || `test timed out while running command` || `script_test\.go:\d+: .*: signal: killed`)
2025-02-04 17:54 x_tools-go1.22-netbsd-arm tools@0556adba release-branch.go1.22@5817e650 x/tools/gopls/internal/test/integration/misc.TestRunVulncheckPackageDiagnostics/invalid/default [ABORT] (log) 
=== RUN   TestRunVulncheckPackageDiagnostics/invalid/default
DETECTED A HANGING GO COMMAND

			The gopls test runner has detected a hanging go command. In order to debug
			this, the output of ps and lsof/fstat is printed below.

			See golang/go#54461 for more details.

ps axo ppid,pid,command:
-------------------------
...
_dhcpcd  dhcpcd      1440   14* link dgram  0 923092e0
_dhcpcd  dhcpcd      1440   15* internet dgram udp 91cb2040
root     devpubd      701   wd  /                2 drwxr-xr-x     512 r 
root     devpubd      701    0  /              996 crw-rw-rw-    null rw
root     devpubd      701    1  /              996 crw-rw-rw-    null rw
root     devpubd      701    2  /              996 crw-rw-rw-    null rw
root     devpubd      701    3* drvctl_fileops 0x0
invoke.go:474: detected hanging go command (golang/go#54461); waited 1m20.272266104s
	command:/home/swarming/.swarming/w/ir/x/w/goroot/bin/go list -mod=mod ./...
	pid:26351

— watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-NetBSD
Projects
Test Flakes
Status: No status
Milestone
Backlog
Development

No branches or pull requests
5 participants
@bsiegert @ianlancetaylor @riastradh @bcmills @gopherbot