Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

all: plan9-arm builder failing frequently with a variety of errors #49338

Open
bcmills opened this issue Nov 4, 2021 · 539 comments
Open

all: plan9-arm builder failing frequently with a variety of errors #49338

bcmills opened this issue Nov 4, 2021 · 539 comments
Labels
arch-arm Issues solely affecting the 32-bit arm architecture. NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Plan9
Milestone
Unplanned

Comments

@bcmills
Copy link
Contributor

bcmills commented Nov 4, 2021 •
edited by cherrymui
Loading 

#!watchflakes
post <- builder ~ `plan9-arm`

The one remaining plan9 builder is failing a significant fraction of build attempts.
Many of the failures follow specific known patterns (notably #49337, #46526, and #41952). However, many do not.

@millerresearch, @0intro, @fhs: is there someone who can investigate these failures and bring the plan9 port back up to par? With the 0intro builders missing (#49327, #49328), there is no longer any plan9 builder consistently passing tests.

greplogs --dashboard -md -l -e \\Aplan9. -E . --since=2021-10-01

2021-11-04T01:44:54-d9bb5f6/plan9-arm
2021-11-03T23:48:28-283373d/plan9-arm
2021-11-03T21:45:33-4a4e1f2-d3f5dd5/plan9-arm
2021-11-03T21:45:33-2c98350-d3f5dd5/plan9-arm
2021-11-03T19:32:33-74f99d0/plan9-arm
2021-11-03T18:37:22-cfd016d/plan9-arm
2021-11-03T15:59:11-5f0e5d2/plan9-arm
2021-11-03T09:23:34-6458b2e/plan9-arm
2021-11-03T05:00:00-519c0a2/plan9-arm
2021-11-03T00:49:50-a4b2c57/plan9-arm
2021-11-03T00:21:24-8f0ca7d/plan9-arm
2021-11-03T00:07:38-49a0063/plan9-arm
2021-11-03T00:06:52-32d2752/plan9-arm
2021-11-02T23:44:58-a0f373c/plan9-arm
2021-11-02T23:05:17-714668c-eb63cbd/plan9-arm
2021-11-02T21:18:39-60fd3ed/plan9-arm
2021-11-02T20:59:34-79024cf/plan9-arm
2021-11-02T19:56:02-c45c32b/plan9-arm
2021-11-02T19:37:42-1011e26/plan9-arm
2021-11-02T18:35:29-433ba58/plan9-arm
2021-11-02T18:35:22-0b37bd9/plan9-arm
2021-11-02T18:31:53-79c5240/plan9-arm
2021-11-02T18:24:18-f7a95d2/plan9-arm
2021-11-02T15:33:01-4d06874-da7173a/plan9-arm
2021-11-02T13:43:24-ee08195-4d7bf41/plan9-arm
2021-11-02T13:43:24-4ff95d6-4d7bf41/plan9-arm
2021-11-02T06:25:39-4ff95d6-088bb4b/plan9-arm
2021-11-02T06:21:44-3ee426a/plan9-arm
2021-11-02T06:20:21-c1ea339/plan9-arm
2021-11-02T06:19:33-4633b2d/plan9-arm
2021-11-02T05:35:11-6f327f7/plan9-arm
2021-11-02T03:55:19-4ff95d6-6f1e9a9/plan9-arm
2021-11-02T03:54:24-3c61cb3/plan9-arm
2021-11-02T03:53:56-b0472aa/plan9-arm
2021-11-02T03:52:33-9268565/plan9-arm
2021-11-01T22:55:50-02e5913/plan9-arm
2021-11-01T19:42:30-4ff95d6-5f1bcd1/plan9-arm
2021-11-01T18:53:06-b5a5b7b/plan9-arm
2021-11-01T16:31:02-03971e3-2bcf1c0/plan9-arm
2021-11-01T15:55:25-e2e910e/plan9-arm
2021-11-01T15:55:20-d2b5121/plan9-arm
2021-11-01T14:45:28-82f902a/plan9-arm
2021-11-01T13:12:37-4056934/plan9-arm
2021-11-01T13:08:16-732db40/plan9-arm
2021-11-01T02:47:30-fde4cc2/plan9-arm
2021-10-31T18:39:05-89c5270/plan9-arm
2021-10-31T18:13:09-fd09e88/plan9-arm
2021-10-31T17:52:41-3fa9ee4/plan9-arm
2021-10-30T18:30:34-6113dac/plan9-arm
2021-10-30T16:46:47-d1dceaf/plan9-arm
2021-10-30T12:32:06-351c04c-5d6d9f5/plan9-arm
2021-10-29T23:25:18-5d6d9f5/plan9-arm
2021-10-29T22:29:31-c812b97/plan9-arm
2021-10-29T22:27:26-3571ab5/plan9-arm
2021-10-29T19:35:47-5ec139f/plan9-arm
2021-10-29T18:56:29-6afdf01/plan9-arm
2021-10-29T18:35:29-9da6415/plan9-arm
2021-10-29T18:23:03-413672f/plan9-arm
2021-10-29T17:44:52-353d5b6/plan9-arm
2021-10-29T04:21:07-103d89b-f288526/plan9-arm
2021-10-29T02:16:47-2c7cdec/plan9-arm
2021-10-29T02:11:42-33c392f/plan9-arm
2021-10-29T00:04:41-d6a9af8-af05d8b/plan9-arm
2021-10-28T20:50:34-d0751b1/plan9-arm
2021-10-28T20:50:34-103d89b-d0751b1/plan9-arm
2021-10-28T20:43:39-b954024/plan9-arm
2021-10-28T20:43:02-e741e2f/plan9-arm
2021-10-28T18:48:25-e7eb6f6-f229e70/plan9-arm
2021-10-28T18:10:59-ed475fe/plan9-arm
2021-10-28T18:10:50-2bc8ed8/plan9-arm
2021-10-28T17:57:57-2666262/plan9-arm
2021-10-28T17:52:59-3124968/plan9-arm
2021-10-28T02:35:22-056dfe6/plan9-arm
2021-10-28T01:15:26-b2fe2eb/plan9-arm
2021-10-28T00:11:24-a91d0b6/plan9-arm
2021-10-27T22:17:35-79ff663/plan9-arm
2021-10-27T21:37:54-749f6e9/plan9-arm
2021-10-27T21:35:48-a3c4ac0/plan9-arm
2021-10-27T21:34:20-4fefd43/plan9-arm
2021-10-27T20:25:06-bbc0595/plan9-arm
2021-10-27T20:24:34-56dcf97/plan9-arm
2021-10-27T20:03:17-68bd512/plan9-arm
2021-10-27T19:34:49-ffd2284/plan9-arm
2021-10-27T19:18:20-514ebae/plan9-arm
2021-10-27T18:24:50-259735f/plan9-amd64-0intro
2021-10-27T18:24:50-259735f/plan9-arm
2021-10-27T16:59:43-c0ac39c/plan9-arm
2021-10-27T13:12:49-cfb5321/plan9-arm
2021-10-27T08:50:27-e1e2965-bdefb77/plan9-arm
2021-10-27T08:50:27-bdefb77/plan9-arm
2021-10-26T23:12:17-13eccaa/plan9-arm
2021-10-26T22:05:53-80be4a4/plan9-386-0intro
2021-10-26T19:04:53-9626607-1dc77a3/plan9-arm
2021-10-26T19:04:53-03971e3-1dc77a3/plan9-arm
2021-10-26T18:33:39-244f92e-76cef81/plan9-386-0intro
2021-10-26T17:10:45-d418f37-76cef81/plan9-386-0intro
2021-10-26T17:10:45-76cef81/plan9-386-0intro
2021-10-26T17:10:45-76cef81/plan9-amd64-0intro
2021-10-26T16:00:26-94870a3-1b2362b/plan9-arm
2021-10-26T14:05:47-a2b8c18/plan9-arm
2021-10-26T11:58:05-1e2820a/plan9-arm
2021-10-26T05:05:24-23fdd7f/plan9-arm
2021-10-26T01:22:47-f916b54-adfb85b/plan9-arm
2021-10-26T01:22:47-22652b4-adfb85b/plan9-arm
2021-10-26T01:07:41-41f7407/plan9-arm
2021-10-25T23:28:03-f916b54-e9eb66d/plan9-arm
2021-10-25T23:28:03-e9eb66d/plan9-arm
2021-10-25T21:03:33-60c3069/plan9-arm
2021-10-25T18:46:45-f47335e/plan9-arm
2021-10-25T17:02:16-52b10ab/plan9-arm
2021-10-25T16:07:11-fc8b4ca-c6e82e5/plan9-arm
2021-10-23T20:23:35-c96bc14-8dbf3e9/plan9-386-0intro
2021-10-23T20:23:35-8dbf3e9/plan9-arm
2021-10-23T16:18:19-d418f37-16318df/plan9-386-0intro
2021-10-23T16:18:19-c96bc14-16318df/plan9-386-0intro
2021-10-23T16:18:19-c96bc14-16318df/plan9-amd64-0intro
2021-10-23T16:18:19-affba50-16318df/plan9-386-0intro
2021-10-23T16:18:19-16318df/plan9-386-0intro
2021-10-23T16:18:19-16318df/plan9-amd64-0intro
2021-10-23T16:18:19-16318df/plan9-arm
2021-10-23T16:18:15-12e4404/plan9-arm
2021-10-23T16:18:09-c526cf8/plan9-arm
2021-10-23T16:18:04-2d205eb/plan9-arm
2021-10-23T16:17:58-3cd28ba/plan9-arm
2021-10-23T12:44:47-b0f7eb6/plan9-arm
2021-10-22T21:48:34-ae4d67c/plan9-arm
2021-10-22T21:12:07-76dd01f/plan9-arm
2021-10-22T14:05:31-ff8115d/plan9-arm
2021-10-21T17:31:42-392bb06/plan9-arm
2021-10-21T17:23:58-02a3666/plan9-arm
2021-10-21T13:05:07-8b9c0d1/plan9-arm
2021-10-21T02:35:47-9b675d0-fca46d0/plan9-arm
2021-10-20T20:39:19-d419a80/plan9-arm
2021-10-20T20:38:59-75b73d6/plan9-arm
2021-10-20T20:38:47-3ec8d4b/plan9-arm
2021-10-20T19:30:13-cbf1d01-3ff39c5/plan9-arm
2021-10-20T19:30:13-3ff39c5/plan9-arm
2021-10-20T19:29:12-4320949/plan9-arm
2021-10-20T18:48:51-cbf1d01-4e565f7/plan9-arm
2021-10-20T05:28:45-b091189/plan9-arm
2021-10-19T23:27:41-4ea6123-2be5b84/plan9-arm
2021-10-19T22:47:35-9fa8551/plan9-arm
2021-10-19T18:56:08-07e5527/plan9-arm
2021-10-19T18:43:12-d944984/plan9-arm
2021-10-19T18:43:08-1d63052/plan9-arm
2021-10-19T18:22:59-6c3cd5d/plan9-arm
2021-10-19T18:18:37-9820602/plan9-arm
2021-10-19T17:12:53-404f84d/plan9-arm
2021-10-19T17:01:42-3a07ab7/plan9-arm
2021-10-19T16:19:27-98f6e03-f92a358/plan9-arm
2021-10-19T08:44:22-1e49210/plan9-arm
2021-10-19T07:45:46-281050f-ee92daa/plan9-arm
2021-10-18T22:56:07-eba0e86/plan9-arm
2021-10-18T22:55:05-7397178/plan9-arm
2021-10-18T19:46:27-98f6e03-394a1ad/plan9-arm
2021-10-18T16:32:38-543a513/plan9-arm
2021-10-18T15:38:40-74acbaf/plan9-arm
2021-10-16T16:27:40-c96bc14-640a49b/plan9-386-0intro
2021-10-16T16:27:40-98f6e03-640a49b/plan9-arm
2021-10-16T16:27:40-640a49b/plan9-arm
2021-10-16T16:27:40-4f30a5c-640a49b/plan9-386-0intro
2021-10-16T14:50:21-c96bc14-680caf1/plan9-386-0intro
2021-10-16T14:50:21-98f6e03-680caf1/plan9-386-0intro
2021-10-16T14:50:21-4f30a5c-680caf1/plan9-386-0intro
2021-10-15T21:46:06-ed1c8db/plan9-386-0intro
2021-10-15T21:46:06-ed1c8db/plan9-amd64-0intro
2021-10-15T21:46:06-c96bc14-ed1c8db/plan9-amd64-0intro
2021-10-15T21:46:06-4f30a5c-ed1c8db/plan9-amd64-0intro
2021-10-15T21:44:07-4a7975e/plan9-386-0intro
2021-10-15T20:29:48-85cbdda/plan9-arm
2021-10-15T20:29:36-a17b2e8/plan9-386-0intro
2021-10-15T19:54:44-22951fb/plan9-arm
2021-10-15T19:03:33-98f6e03-cfe6763/plan9-arm
2021-10-15T18:07:49-98f6e03-8331f25/plan9-arm
2021-10-15T02:45:22-288d0b3-3da0ff8/plan9-arm
2021-10-15T02:02:50-ce04ca3-3da0ff8/plan9-arm
2021-10-15T02:02:50-3da0ff8/plan9-386-0intro
2021-10-15T00:16:20-ce04ca3-9e8ed86/plan9-arm
2021-10-14T23:32:09-3a269dc-9e8ed86/plan9-arm
2021-10-14T22:15:24-281050f-b59467e/plan9-arm
2021-10-14T18:44:37-a37bebc/plan9-arm
2021-10-14T18:44:29-a8c5a99/plan9-arm
2021-10-14T15:17:03-fbdf830/plan9-arm
2021-10-14T13:09:28-88e80df-24e798e/plan9-arm
2021-10-14T13:09:28-24e798e/plan9-arm
2021-10-14T12:38:31-88e80df-2feb2cc/plan9-arm
2021-10-14T07:18:59-1349c6e/plan9-arm
2021-10-14T04:18:44-acac939-9e4dc6f/plan9-arm
2021-10-14T01:51:22-276fb27/plan9-arm
2021-10-13T22:21:08-ac2ed98-b90d258/plan9-arm
2021-10-13T20:31:25-b90d258/plan9-arm
2021-10-13T18:15:48-40f82f8/plan9-amd64-0intro
2021-10-13T18:15:48-40f82f8/plan9-arm
2021-10-13T18:15:48-281050f-40f82f8/plan9-arm
2021-10-13T17:02:43-b5904f3/plan9-arm
2021-10-13T16:39:23-3986e5c/plan9-arm
2021-10-13T16:36:59-69041c7/plan9-arm
2021-10-13T15:11:16-0454d73/plan9-arm
2021-10-13T03:12:54-24389d4-4fb2e1c/plan9-arm
2021-10-12T22:02:39-732f6fa/plan9-arm
2021-10-12T21:30:45-0b930fb-3283d1a/plan9-arm
2021-10-12T21:15:50-3d051ba/plan9-arm
2021-10-12T20:53:52-ac6d706/plan9-arm
2021-10-12T20:20:41-d032b2b/plan9-arm
2021-10-12T18:30:24-281050f-6e0adde/plan9-arm
2021-10-12T12:24:09-c8768b9-4679670/plan9-arm
2021-10-12T06:55:50-c83725b-d887d3b/plan9-arm
2021-10-11T20:46:14-7023535/plan9-arm
2021-10-11T20:46:14-18fa840-7023535/plan9-arm
2021-10-11T19:20:12-18fa840-65ffee6/plan9-arm
2021-10-11T15:48:29-2478b6f/plan9-arm
2021-10-11T12:53:11-3b03d30-34f7b1f/plan9-386-0intro
2021-10-11T12:53:11-34f7b1f/plan9-arm
2021-10-11T12:42:06-59b2f51/plan9-arm
2021-10-10T15:11:26-d2d21d9/plan9-386-0intro
2021-10-10T15:11:26-d2d21d9/plan9-amd64-0intro
2021-10-10T15:11:26-d2d21d9/plan9-arm
2021-10-10T15:11:26-3b03d30-d2d21d9/plan9-386-0intro
2021-10-10T15:11:26-1af23bd-d2d21d9/plan9-386-0intro
2021-10-10T13:37:52-1af23bd-b99abf3/plan9-arm
2021-10-09T23:29:26-b99abf3/plan9-386-0intro
2021-10-09T23:29:26-b99abf3/plan9-arm
2021-10-08T22:21:41-ee04797-74abcab/plan9-arm
2021-10-08T19:41:16-c5188f2-7fcf9a1/plan9-arm
2021-10-08T19:41:16-7fcf9a1/plan9-386-0intro
2021-10-08T19:30:58-f430bda/plan9-arm
2021-10-08T19:19:09-b9e1e1b/plan9-386-0intro
2021-10-08T18:07:25-d480b5c/plan9-386-0intro
2021-10-08T17:58:41-16a3cef/plan9-arm
2021-10-08T17:32:31-d7ba1d2/plan9-386-0intro
2021-10-08T17:32:25-a7d3a0e/plan9-arm
2021-10-08T15:27:20-b3a4b2d/plan9-arm
2021-10-08T14:08:12-5b9206f/plan9-386-0intro
2021-10-08T14:08:12-5b9206f/plan9-arm
2021-10-07T22:19:58-1ceb723/plan9-arm
2021-10-07T21:39:17-6b4cf2b/plan9-arm
2021-10-07T20:37:43-d477ef3-ef2ebbe/plan9-arm
2021-10-07T19:56:19-4ab3c10/plan9-arm
2021-10-07T18:58:33-7286502/plan9-arm
2021-10-07T18:09:53-4607ebc/plan9-arm
2021-10-07T16:38:24-be571a3/plan9-arm
2021-10-07T14:37:45-ebeab63/plan9-arm
2021-10-07T14:37:36-375a1fb/plan9-arm
2021-10-07T02:30:47-2c98350-39bbf08/plan9-arm
2021-10-06T23:26:57-c8dd89e/plan9-arm
2021-10-06T23:26:57-86761ae-c8dd89e/plan9-arm
2021-10-06T21:17:08-2e107b4/plan9-arm
2021-10-06T21:06:48-197b328/plan9-arm
2021-10-06T15:53:04-4d8db00/plan9-arm
2021-10-05T23:58:29-ac60900/plan9-arm
2021-10-05T23:36:43-e82ed0c/plan9-arm
2021-10-05T22:42:11-96fface/plan9-arm
2021-10-05T20:52:58-0d6561b/plan9-arm
2021-10-05T20:35:54-990c9c6/plan9-arm
2021-10-05T19:15:03-ae83301/plan9-arm
2021-10-05T18:31:14-5d946f1/plan9-arm
2021-10-05T17:10:45-2dc2755-5140ad1/plan9-arm
2021-10-05T15:47:57-017ffcd/plan9-arm
2021-10-05T15:47:07-cfd74f7/plan9-arm
2021-10-05T01:30:56-d4b1ae0-123393a/plan9-386-0intro
2021-10-04T22:59:44-78c2529/plan9-arm
2021-10-04T22:59:13-199ec42/plan9-arm
2021-10-04T22:54:58-7c79e8e/plan9-arm
2021-10-04T22:00:53-d9952ff/plan9-386-0intro
2021-10-04T22:00:19-739328c/plan9-arm
2021-10-04T21:10:16-db89b5a-f0db7ea/plan9-arm
2021-10-04T18:15:09-ccaa907-9f8d558/plan9-arm
2021-10-04T17:17:11-cedda3a-cc5e3de/plan9-386-0intro
2021-10-04T17:17:11-ccaa907-cc5e3de/plan9-386-0intro
2021-10-04T17:17:11-cc5e3de/plan9-amd64-0intro
2021-10-04T15:50:43-9432320/plan9-386-0intro
2021-10-04T15:50:43-9432320/plan9-amd64-0intro
2021-10-02T16:05:55-0ebff1a-a7fe161/plan9-arm
2021-10-02T13:15:42-0ebff1a-7bf7bbc/plan9-arm
2021-10-01T23:51:16-c129af9/plan9-arm
2021-10-01T21:26:43-0ebff1a-0d65c27/plan9-arm
2021-10-01T19:30:53-13c407c-0d65c27/plan9-arm
2021-10-01T18:18:46-0d65c27/plan9-arm
2021-10-01T17:18:20-5279e53/plan9-arm
2021-10-01T16:45:09-58ad7eb-f19b2d5/plan9-arm
2021-10-01T16:17:08-f19b2d5/plan9-arm
2021-10-01T16:01:09-558b9da-8d494b0/plan9-arm
2021-10-01T15:59:38-e5ad363/plan9-arm
2021-10-01T14:06:36-96d3ba8/plan9-arm
@bcmills bcmills added OS-Plan9 NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Nov 4, 2021
@millerresearch
Copy link
Contributor

For most of plan9-arm failures, the cause is filesystem flakiness on the builder machines (a cluster of 3 x raspberry pi 4). I've just reconfigured the build script to stop using ramfs (which has a locking bug) for /tmp, and stop using the ad hoc directory cache (which still seems to have some flaws). This should bypass most of the failures but will make the test suite a lot slower to run (by go.17 it had already regressed to about 2 hours even with these filesystem tweaks).

There are some other flakes of the "shouldn't be possible" variety, which are are rare and perplexing and impossible to replicate. They are occurring in general go runtime code, not specific to plan 9. There's a slight whiff of possible memory cache coherence trouble in some of these:
marked free object in span
attempt to clean non-empty span set
unexpected waitm - semaphore out of sync
runtime: cannot allocate memory
not inlined: unknown reason

It would be good to have a server-class ARM platform capable of running plan 9 as a more reliable builder. I don't know of one.

@bcmills
Copy link
Contributor Author

bcmills commented Nov 10, 2021

Looks like the filesystem change did resolve at least one class of failure: the '/boot/workdir/go/src/os' does not exit failure mode hasn't occurred at all in November so far.

greplogs --dashboard -md -l -e \''/boot/workdir/go/src/os'\'' does not exist'

2021-10-29T22:29:31-c812b97/plan9-arm
2021-10-25T17:02:16-52b10ab/plan9-arm
2021-10-19T18:18:37-9820602/plan9-arm
2021-10-10T15:11:26-d2d21d9/plan9-arm
2021-10-09T23:29:26-b99abf3/plan9-arm
2021-10-07T19:56:19-4ab3c10/plan9-arm
2021-10-01T18:18:46-0d65c27/plan9-arm
2021-09-27T18:58:36-5b90958/plan9-arm
2021-09-21T20:39:31-48cf96c/plan9-arm
2021-09-21T00:59:39-d1fd3eb/plan9-arm
2021-08-28T01:49:50-f371b30/plan9-arm
2021-08-22T22:04:02-5d5e50c/plan9-arm
2021-08-13T21:43:20-a95f1b5/plan9-arm
2021-07-25T17:16:20-849b791/plan9-arm
2021-06-17T03:25:37-b0355a3/plan9-arm
2021-05-25T23:41:42-74242ba/plan9-arm
2021-03-29T20:35:19-164a626/plan9-arm
2021-03-04T06:36:33-868a110/plan9-arm
2021-02-24T19:25:49-bf48163/plan9-arm
2020-10-13T00:31:47-5ef78c4/plan9-arm
2020-10-12T14:44:34-0f53453/plan9-arm
2020-08-18T15:50:52-b58d297/plan9-arm
2020-05-05T19:42:01-0e617d3/plan9-arm

@gopherbot
Copy link
Contributor

Change https://golang.org/cl/362975 mentions this issue: dashboard: omit the website repo on plan9

gopherbot pushed a commit to golang/build that referenced this issue Nov 11, 2021
dashboard: omit the website repo on plan9
d14234e 
The plan9 builders have relatively slow filesystems, and the website
repo is relatively filesystem-intensive — many of its tests walk and
process large trees of website content.

Instead of trying to precisely tune the x/website tests to pass on the
plan9 builders, let's skip this repo on them.

For golang/go#49338.

Change-Id: Ieaf50fb6955a6b39012a23ff72e61c1c31e4ce7c
Reviewed-on: https://go-review.googlesource.com/c/build/+/362975
Trust: Bryan C. Mills <bcmills@google.com>
Run-TryBot: Bryan C. Mills <bcmills@google.com>
TryBot-Result: Go Bot <gobot@golang.org>
Reviewed-by: Carlos Amedee <carlos@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
@bcmills
Copy link
Contributor Author

bcmills commented Nov 17, 2021

Many of the failure modes seem to have cleared up around 11 Nov.; it's not clear to me what fixed them.

One of the failures visible on the dashboard today is #49653; the other is the marked free object in span failure mode.

@bcmills
Copy link
Contributor Author

bcmills commented Nov 19, 2021

A few more failure modes that remain:
#22227 (unexpected signal in os.StartProcess)
#49684 (panic during panic)
#49691 (unexpected stale targets)

@gopherbot
Copy link
Contributor

Change https://golang.org/cl/369018 mentions this issue: src/cmd/go/internal/work: lock Builder output mutex consistently

gopherbot pushed a commit that referenced this issue Dec 6, 2021
@millerresearch
src/cmd/go/internal/work: lock Builder output mutex consistently
765cc72 
To prevent interleaving of output when 'go build' compiles several
packages in parallel, the output mutex in the Builder struct must
be locked around any calls to Builder.Print which could generate
arbitrary amounts of text (ie more than is guaranteed to be written
atomically to a pipe).

Fixes #49987
For #49338

Change-Id: I7947df57667deeff3f03f231824298d823f8a943
Reviewed-on: https://go-review.googlesource.com/c/go/+/369018
Reviewed-by: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Trust: Russ Cox <rsc@golang.org>
@gopherbot
Copy link
Contributor

Change https://golang.org/cl/380414 mentions this issue: message/pipeline: skip TestFullCycle on plan9-arm

gopherbot pushed a commit to golang/text that referenced this issue Jan 24, 2022
message/pipeline: skip TestFullCycle on plan9-arm
d1c84af 
This test has timed out several times recently on this builder. The
test is pretty slow even on Linux, and may be especially
filesystem-intensive.

For golang/go#49338

Change-Id: Ife2bb399b10f369f815055bb0ad44bb007f606b7
Reviewed-on: https://go-review.googlesource.com/c/text/+/380414
Trust: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Reviewed-by: Ian Lance Taylor <iant@golang.org>
@bcmills
Copy link
Contributor Author

bcmills commented Jan 27, 2022

A sampling from the past week or so. Undiagnosed failures in bold.

greplogs --dashboard -md -l -e \\Aplan9-arm -E . --since=2022-01-20

2022-01-27T05:30:27-be5769c-a991d9d/plan9-arm

panic: test timed out after 10m0s
…
goroutine 6 [select, 9 minutes]:
…
golang.org/x/tools/go/packages.goListDriver(0x1695ab84, {0x175c8c78, 0x1, 0x1})
	/boot/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:200 +0x7b0
…
FAIL	golang.org/x/tools/gopls/doc	600.515s

That's stuck running go list:
https://cs.opensource.google/go/x/tools/+/master:go/packages/golist.go;l=447;drc=eb48d3f608bba06c3bb4f5627f9fc2562cc84dd2

2022-01-27T05:30:27-bbe1937-a991d9d/plan9-arm (#50857)
2022-01-27T05:30:27-aa10faf-a991d9d/plan9-arm (#50857)
2022-01-27T00:03:31-bbe1937-f4aa021/plan9-arm (#50857)
2022-01-26T23:43:39-be5769c-db48840/plan9-arm (probably #46520, not specific to plan9)
2022-01-26T23:43:39-bbe1937-db48840/plan9-arm (#50857)
2022-01-26T22:33:26-ef0b09c/plan9-arm (possibly #22227?)
2022-01-26T22:09:36-bbe1937-ca6a5c0/plan9-arm (#50857)
2022-01-26T21:43:32-be5769c-c8b0dce/plan9-arm (#46520, not specific to plan9)
2022-01-26T20:51:54-fe74b5f-c8b0dce/plan9-arm (#46520, not specific to plan9)
2022-01-26T17:58:00-bbe1937-719e989/plan9-arm (#50857)
2022-01-25T22:56:45-c20fd7c-6eb58cd/plan9-arm (#46520, not specific to plan9)
2022-01-25T22:04:10-c20fd7c-38729cf/plan9-arm (#46520, not specific to plan9)
2022-01-25T00:39:08-97de9ec-16d6a52/plan9-arm (#46520, not specific to plan9)
2022-01-24T21:27:20-cdd9e93/plan9-arm

--- FAIL: TestIntendedInlining (15.35s)
    inl_test.go:267: exit status: 'go 32037: 2'
FAIL
FAIL	cmd/compile/internal/test	119.720s

2022-01-24T16:42:11-2cc1836-19d819d/plan9-arm (#50775, mitigated)
2022-01-21T23:16:33-3c751cd-b7fa0f9/plan9-arm (#50775, mitigated)
2022-01-21T21:58:14-3c751cd-35b0db7/plan9-arm (#50775, mitigated)
2022-01-21T21:58:14-35b0db7/plan9-arm

panic: test timed out after 18m0s
…
goroutine 185 [chan receive, 17 minutes]:
…
os/exec.(*Cmd).CombinedOutput(0x110ae000)
	/boot/workdir/go/src/os/exec/exec.go:567 +0x98 fp=0x11105e2c sp=0x11105e18 pc=0x12b1dc
cmd/compile/internal/test.TestCode(0x10c02f00)
	/boot/workdir/go/src/cmd/compile/internal/test/ssa_test.go:171 +0x9fc fp=0x11105f98 sp=0x11105e2c pc=0x3af55c
…
FAIL	cmd/compile/internal/test	1080.192s

That's running a go test -c subprocess, but without a timeout so we don't get a useful goroutine dump to debug it 😞:
https://cs.opensource.google/go/go/+/master:src/cmd/compile/internal/test/ssa_test.go;l=171;drc=16a3cefc93d9b896b2053320e387d0e449904aba

2022-01-21T21:27:57-e7c9de2-9eba5ff/plan9-arm (#46520, not specific to plan9)
2022-01-21T21:08:53-3425967-9eba5ff/plan9-arm (#50775, mitigated)
2022-01-21T16:59:19-9f83dd3-9eba5ff/plan9-arm (#50775, mitigated)
2022-01-20T20:23:52-80963bc-2c2e081/plan9-arm (#46520, not specific to plan9)
2022-01-20T14:59:17-ab35822-9284279/plan9-arm (#46520, not specific to plan9)
2022-01-20T14:52:25-ab35822-e7d5857/plan9-arm (possibly #45211? if so, not specific to plan9)

@gopherbot
Copy link
Contributor

Change https://go.dev/cl/408697 mentions this issue: dashboard: add known issues for plan9-arm

gopherbot pushed a commit to golang/build that referenced this issue May 26, 2022
@gopherbot
dashboard: add known issue for plan9-arm
560d411 
For golang/go#52653.
Updates golang/go#49338.

Change-Id: Ib23be56bd79bce8b3168cb40064916a2a91dbb88
Reviewed-on: https://go-review.googlesource.com/c/build/+/408697
Auto-Submit: Bryan Mills <bcmills@google.com>
Reviewed-by: Alex Rakoczy <alex@golang.org>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
@seankhliao seankhliao added this to the Unplanned milestone Aug 20, 2022
xhit pushed a commit to xhit/text that referenced this issue Oct 10, 2022
@xhit
message/pipeline: skip TestFullCycle on plan9-arm
dfea723 
This test has timed out several times recently on this builder. The
test is pretty slow even on Linux, and may be especially
filesystem-intensive.

For golang/go#49338

Change-Id: Ife2bb399b10f369f815055bb0ad44bb007f606b7
Reviewed-on: https://go-review.googlesource.com/c/text/+/380414
Trust: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Reviewed-by: Ian Lance Taylor <iant@golang.org>
@gopherbot

This comment was marked as resolved.

Sign in to view
@bcmills bcmills added the arch-arm Issues solely affecting the 32-bit arm architecture. label Dec 6, 2022
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-05 22:01 plan9-arm go@185e1a7b os/exec.TestExtraFilesRace (log) 
--- FAIL: TestExtraFilesRace (0.50s)
    exec_test.go:850: iteration 2, process B got:

        want:
        fd3: listener 127.0.0.1:40881

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-06 20:08 plan9-arm net@1e63c2f0 go@a4a86c7b x/net/http2.TestTransportUsesGoAwayDebugError_Body (log) 
--- FAIL: TestTransportUsesGoAwayDebugError_Body (0.03s)
    transport_test.go:2861: RoundTrip error = http2.GoAwayError: http2.GoAwayError{LastStreamID:0x5, ErrCode:0x0, DebugData:"some debug data"}, want http2.GoAwayError (http2.GoAwayError{LastStreamID:0x5, ErrCode:0xd, DebugData:"some debug data"})

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-22 15:34 plan9-arm benchmarks@03c43f28 go@f721fa3b (log) 
runtime: signal received on thread not created by Go.

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-01 20:58 plan9-arm go@cc1771e2 net/http.TestOmitHTTP2Vet (log) 
http.test 26576: warning: process exceeds 100 file descriptors
--- FAIL: TestOmitHTTP2Vet (20.57s)
    http_test.go:135: go vet failed: exit status: 'go 26635: 2', fatal error: all goroutines are asleep - deadlock!

        runtime stack:
        runtime.fatal({0x6104f8, 0x25})
        	/boot/workdir/go/src/runtime/panic.go:1066 +0x4c fp=0x3ffffc1c sp=0x3ffffc08 pc=0x3ad1c
        runtime.checkdead()
        	/boot/workdir/go/src/runtime/proc.go:5265 +0x318 fp=0x3ffffc5c sp=0x3ffffc1c pc=0x49858
        runtime.mput(0x983c000)
        	/boot/workdir/go/src/runtime/proc.go:5700 +0x44 fp=0x3ffffc60 sp=0x3ffffc5c pc=0x4b34c
        runtime.stopm()
        	/boot/workdir/go/src/runtime/proc.go:2332 +0x5c fp=0x3ffffc74 sp=0x3ffffc60 pc=0x42148
        runtime.findRunnable()
        	/boot/workdir/go/src/runtime/proc.go:3007 +0xd44 fp=0x3ffffd14 sp=0x3ffffc74 pc=0x43c9c
        runtime.schedule()
        	/boot/workdir/go/src/runtime/proc.go:3360 +0xac fp=0x3ffffd30 sp=0x3ffffd14 pc=0x44f94
        runtime.park_m(0x96130e0)
        	/boot/workdir/go/src/runtime/proc.go:3511 +0x150 fp=0x3ffffd44 sp=0x3ffffd30 pc=0x45784
        runtime.mcall()
        	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffd4c sp=0x3ffffd44 pc=0x69814
2022-12-12 22:32 plan9-arm crypto@23edec0b go@357ea858 (log) 
runtime: program exceeds 0-thread limit
fatal error: thread exhaustion

runtime stack:
runtime.throw({0x6018dc, 0x11})
	/boot/workdir/go/src/runtime/panic.go:1047 +0x4c fp=0x3ffffd84 sp=0x3ffffd70 pc=0x3ac58
runtime.checkmcount()
	/boot/workdir/go/src/runtime/proc.go:789 +0x94 fp=0x3ffffd94 sp=0x3ffffd84 pc=0x3eef0
runtime.mReserveID()
	/boot/workdir/go/src/runtime/proc.go:805 +0x74 fp=0x3ffffda8 sp=0x3ffffd94 pc=0x3ef90
runtime.startm(0x9433300, 0x1)
	/boot/workdir/go/src/runtime/proc.go:2403 +0xb4 fp=0x3ffffdd4 sp=0x3ffffda8 pc=0x422d4
runtime.handoffp(0x9433300)
	/boot/workdir/go/src/runtime/proc.go:2463 +0x390 fp=0x3ffffdfc sp=0x3ffffdd4 pc=0x42870
runtime.retake(0x17310608ee127184)
	/boot/workdir/go/src/runtime/proc.go:5494 +0x2f0 fp=0x3ffffe20 sp=0x3ffffdfc pc=0x4a58c
runtime.sysmon()
	/boot/workdir/go/src/runtime/proc.go:5402 +0x5c0 fp=0x3ffffe8c sp=0x3ffffe20 pc=0x4a0ac
runtime.mstart1()
	/boot/workdir/go/src/runtime/proc.go:1498 +0x7c fp=0x3ffffe9c sp=0x3ffffe8c pc=0x40b88
runtime.mstart0()
	/boot/workdir/go/src/runtime/proc.go:1455 +0x64 fp=0x3ffffeac sp=0x3ffffe9c pc=0x40afc
runtime.mstart()
	/boot/workdir/go/src/runtime/asm_arm.s:210 +0x8 fp=0x3ffffeb0 sp=0x3ffffeac pc=0x697b4
2022-12-12 23:10 plan9-arm go@b16e94d1 (log) 
fatal error: all goroutines are asleep - deadlock!

runtime stack:
runtime.fatal({0x6105a0, 0x25})
	/boot/workdir/go/src/runtime/panic.go:1066 +0x4c fp=0x3ffffbf4 sp=0x3ffffbe0 pc=0x3ad1c
runtime.checkdead()
	/boot/workdir/go/src/runtime/proc.go:5261 +0x318 fp=0x3ffffc34 sp=0x3ffffbf4 pc=0x49858
runtime.mput(0x969c240)
	/boot/workdir/go/src/runtime/proc.go:5696 +0x44 fp=0x3ffffc38 sp=0x3ffffc34 pc=0x4b34c
runtime.stopm()
	/boot/workdir/go/src/runtime/proc.go:2332 +0x5c fp=0x3ffffc4c sp=0x3ffffc38 pc=0x42148
runtime.findRunnable()
	/boot/workdir/go/src/runtime/proc.go:3007 +0xd44 fp=0x3ffffcec sp=0x3ffffc4c pc=0x43c9c
runtime.schedule()
	/boot/workdir/go/src/runtime/proc.go:3360 +0xac fp=0x3ffffd08 sp=0x3ffffcec pc=0x44f94
runtime.park_m(0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:3511 +0x150 fp=0x3ffffd1c sp=0x3ffffd08 pc=0x45784
runtime.mcall()
	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffd24 sp=0x3ffffd1c pc=0x69814
2022-12-13 21:00 plan9-arm benchmarks@555ee2b5 go@357ea858 (log) 
../../../../pkg/mod/cloud.google.com/go@v0.97.0/iam/iam.go:30:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/internal/proto/error.pb.go:27:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/apierror.go:40:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/google.golang.org/grpc@v1.40.0/status/status.go:34:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:28:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/iam.go:24:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
2022-12-15 00:54 plan9-arm tools@5899b6a2 go@ea14d1b6 (log)
2022-12-23 17:16 plan9-arm go@38cfb3be net.TestPipe (log) 
--- FAIL: TestPipe (120.26s)
    --- FAIL: TestPipe/PresentTimeout (119.92s)
        conntest.go:57: test timed out; terminating pipe
        conntest.go:279: got *errors.errorString: io: read/write on closed pipe, want net.Error
        conntest.go:268: got *errors.errorString: io: read/write on closed pipe, want net.Error
2022-12-29 17:47 plan9-arm go@642fd5f7 net/http.TestServerReadTimeout (log) 
http.test 33195: warning: process exceeds 100 file descriptors
--- FAIL: TestServerReadTimeout (0.00s)
    --- FAIL: TestServerReadTimeout/h1 (1.60s)
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:35260: write tcp 127.0.0.1:35327->127.0.0.1:35260: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:35327": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:61614: write tcp 127.0.0.1:63071->127.0.0.1:61614: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:63071": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:48011: write tcp 127.0.0.1:60477->127.0.0.1:48011: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60477": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:58029: read tcp 127.0.0.1:60830->127.0.0.1:58029: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60830": write tcp 127.0.0.1:58029->127.0.0.1:60830: write /net/tcp/106/data: i/o on hungup channel
        serve_test.go:746: server timed out reading request body: got err client disconnected; want os.ErrDeadlineExceeded
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:64770": unexpected EOF

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-20 21:10 plan9-arm benchmarks@33cb3306 go@27b6ace2 (log) 
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.zip: mkdir /boot/workdir/gopath/pkg/mod/github.com/biogo/biogo@v1.0.4/align/matrix/matrices: '/boot/workdir' fossil/fossil: walk: newfid 0x414 in use
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/gomodule/redigo/@v/v1.8.5.zip: open /boot/workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go: '.../workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go' clone failed
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/google/pprof/@v/v0.0.0-20211122183932-1daafda22083.zip: open /boot/workdir/gopath/pkg/mod/github.com/google/pprof@v0.0.0-20211122183932-1daafda22083/internal/driver/driver_focus.go: '.../internal/driver/driver_focus.go' clone failed
go: writing go.mod cache: open /boot/workdir/gopath/pkg/mod/cache/download/cloud.google.com/go/storage/@v/v1.18.2.mod867510410.tmp: '.../cache/download/cloud.google.com/go/storage/@v/v1.18.2.mod867510410.tmp' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/!roaring!bitmap: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/!roaring!bitmap' clone failed
go: writing go.mod cache: open /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.mod315910635.tmp: '.../mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.mod315910635.tmp' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/store/@v: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/store/@v' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch/segment: '.../workdir/gopath/pkg/mod/cache/download/github.com/blevesearch/segment' clone failed
...
sweet/benchmarks/tile38/main.go:27:2: unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/gomodule/redigo/@v/v1.8.5.zip: open /boot/workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go: '.../workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go' clone failed
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/apierror.go:39:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/bucket.go:32:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/bucket.go:33:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/doc.go:62:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:26:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/acl.go:24:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/storage.go:50:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:27:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/storage.go:51:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-05 16:42 plan9-arm net@f8411da7 go@cc82867f x/net/http2/h2c.TestPropagation (log) 
2023/01/25 15:10:33 http2: server connection error from 127.0.0.1:36015: connection error: COMPRESSION_ERROR
2023/01/25 15:10:33 http2: server connection error from 127.0.0.1:33357: connection error: COMPRESSION_ERROR
2023/01/25 15:10:34 http2: server connection error from 127.0.0.1:60254: connection error: COMPRESSION_ERROR
2023/01/25 15:10:36 http2: server connection error from 127.0.0.1:59038: connection error: COMPRESSION_ERROR
2023/01/25 15:10:40 http2: server connection error from 127.0.0.1:57344: connection error: COMPRESSION_ERROR
2023/01/25 15:10:48 http2: server connection error from 127.0.0.1:42738: connection error: COMPRESSION_ERROR
panic: test timed out after 30m0s
running tests:
	TestPropagation (30m0s)

golang.org/x/net/http2.(*clientConnPool).getClientConn(0x9212160, 0x920a100, {0x920e0d0, 0xf}, 0x1)
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:97 +0x1e4
golang.org/x/net/http2.(*clientConnPool).GetClientConn(0x9212160, 0x920a100, {0x920e0d0, 0xf})
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:55 +0x3c
golang.org/x/net/http2.(*Transport).RoundTripOpt(0x92140c0, 0x920a100, {0x0})
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:554 +0x198
golang.org/x/net/http2.(*Transport).RoundTrip(0x92140c0, 0x920a100)
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:513 +0x2c
net/http.send(0x920a100, {0x3c0628, 0x92140c0}, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:252 +0x52c
net/http.(*Client).send(0x9212100, 0x920a100, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:176 +0x94
net/http.(*Client).do(0x9212100, 0x920a100)
	/boot/workdir/go/src/net/http/client.go:716 +0x948
net/http.(*Client).Do(...)
	/boot/workdir/go/src/net/http/client.go:582
golang.org/x/net/http2/h2c.TestPropagation(0x92080f0)
	/boot/workdir/gopath/src/golang.org/x/net/http2/h2c/h2c_test.go:133 +0x500
testing.tRunner(0x92080f0, 0x36d90c)
2023-01-19 20:43 plan9-arm go@f89badf6 (log) 
0x9abe000 0x9bc0000
fatal error: bad span state

runtime stack:
runtime.throw({0x5ff570, 0xe})
	/boot/workdir/go/src/runtime/panic.go:1047 +0x4c fp=0x3ffffbdc sp=0x3ffffbc8 pc=0x3ac58
runtime.stackfree({0x9bc0000, 0x9be0000})
	/boot/workdir/go/src/runtime/stack.go:502 +0x1d0 fp=0x3ffffc20 sp=0x3ffffbdc pc=0x524a0
runtime.gfput(0x9436000, 0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:4395 +0x5c fp=0x3ffffc50 sp=0x3ffffc20 pc=0x47a78
runtime.goexit0(0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:3671 +0x2e8 fp=0x3ffffc88 sp=0x3ffffc50 pc=0x460f0
runtime.mcall()
	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffc90 sp=0x3ffffc88 pc=0x69814
2023-01-19 20:46 plan9-arm go@e08642ca (log)
2023-01-20 02:42 plan9-arm tools@a7f033af go@c641d48a x/tools/gopls/internal/lsp/filecache.TestConcurrency (log) 
--- FAIL: TestConcurrency (2.30s)
    filecache_test.go:99: open /tmp/gopls/eb948799/TestConcurrency/e0/e05ac03a87bbe7ab6768fe0fb083c0bbd4d325061645abf87964477a4bd35143: '/tmp/gopls' mount rpc error
2023-01-20 17:52 plan9-arm go@1011ccad os.TestDirFS (log) 
os.test 38819: warning: process exceeds 100 file descriptors
os.test 38819: warning: process exceeds 200 file descriptors
os.test 38819: warning: process exceeds 300 file descriptors
os.test 38819: warning: process exceeds 400 file descriptors
os.test 38819: warning: process exceeds 500 file descriptors
os.test 38819: warning: process exceeds 600 file descriptors
os.test 38819: warning: process exceeds 700 file descriptors
os.test 38819: warning: process exceeds 800 file descriptors
os.test 38819: warning: process exceeds 900 file descriptors
os.test 38819: warning: process exceeds 1000 file descriptors
os.test 38819: warning: process exceeds 1100 file descriptors
os.test 38819: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.11s)
    os_test.go:2799: TestFS found errors:
        b: fsys.Stat: stat b: './testdata' file does not exist
2023-01-20 19:38 plan9-arm go@f07910bd os.TestDirFS (log) 
os.test 38798: warning: process exceeds 100 file descriptors
os.test 38798: warning: process exceeds 200 file descriptors
os.test 38798: warning: process exceeds 300 file descriptors
os.test 38798: warning: process exceeds 400 file descriptors
os.test 38798: warning: process exceeds 500 file descriptors
os.test 38798: warning: process exceeds 600 file descriptors
os.test 38798: warning: process exceeds 700 file descriptors
os.test 38798: warning: process exceeds 800 file descriptors
os.test 38798: warning: process exceeds 900 file descriptors
os.test 38798: warning: process exceeds 1000 file descriptors
os.test 38798: warning: process exceeds 1100 file descriptors
os.test 38798: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.07s)
    os_test.go:2799: TestFS found errors:
        dir: fsys.Stat: stat dir: './testdata' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestWriteAtInAppendMode (log) 
--- FAIL: TestWriteAtInAppendMode (0.00s)
    os_test.go:920: chtmpdir: chdir /boot/workdir/go/src/os: '/boot/workdir/go/src/os' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestOpenFileLimit (log) 
--- FAIL: TestOpenFileLimit (0.00s)
    rlimit_test.go:31: open rlimit.go: 'rlimit.go' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestDirFSRootDir (log) 
--- FAIL: TestDirFSRootDir (0.00s)
    os_test.go:2846: open tmp/test3257637846/testdata/dirfs/a: '/tmp/test3257637846/testdata' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReaddirSmallSeek (log) 
--- FAIL: TestReaddirSmallSeek (0.00s)
    os_test.go:2706: open /tmp/test3257637846/testdata/issue37161: '/tmp/test3257637846/testdata' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestDirFS (log) 
--- FAIL: TestDirFS (0.00s)
    os_test.go:2799: TestFS found errors:
        .: Open: open .: './testdata' file does not exist
        expected but not found: a
        expected but not found: b
        expected but not found: dir/x
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReadDir (log) 
--- FAIL: TestReadDir (0.00s)
    read_test.go:129: ReadDir .: read_test.go file not found
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReadFile (log) 
--- FAIL: TestReadFile (0.00s)
    read_test.go:36: ReadFile read_test.go: open read_test.go: 'read_test.go' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReaddir (log) 
--- FAIL: TestFileReaddir (0.02s)
    --- FAIL: TestFileReaddir/. (0.00s)
        os_test.go:399: could not find dir_unix.go
        os_test.go:399: could not find env.go
        os_test.go:399: could not find error.go
        os_test.go:399: could not find file.go
        os_test.go:399: could not find os_test.go
        os_test.go:399: could not find types.go
        os_test.go:399: could not find stat_darwin.go
        os_test.go:399: could not find stat_linux.go
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReaddirnames (log) 
--- FAIL: TestFileReaddirnames (0.00s)
    --- FAIL: TestFileReaddirnames/. (0.00s)
        os_test.go:362: could not find dir_unix.go
        os_test.go:362: could not find env.go
        os_test.go:362: could not find error.go
        os_test.go:362: could not find file.go
        os_test.go:362: could not find os_test.go
        os_test.go:362: could not find types.go
        os_test.go:362: could not find stat_darwin.go
        os_test.go:362: could not find stat_linux.go
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReadDir (log) 
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.00s)
        os_test.go:454: could not find dir_unix.go
        os_test.go:454: could not find env.go
        os_test.go:454: could not find error.go
        os_test.go:454: could not find file.go
        os_test.go:454: could not find os_test.go
        os_test.go:454: could not find types.go
        os_test.go:454: could not find stat_darwin.go
        os_test.go:454: could not find stat_linux.go
2023/01/21 02:05:04 open testdata/hello: 'testdata' file does not exist
2023-01-23 18:50 plan9-arm go@b90971b2 os.TestDirFS (log) 
os.test 38679: warning: process exceeds 100 file descriptors
os.test 38679: warning: process exceeds 200 file descriptors
os.test 38679: warning: process exceeds 300 file descriptors
os.test 38679: warning: process exceeds 400 file descriptors
os.test 38679: warning: process exceeds 500 file descriptors
os.test 38679: warning: process exceeds 600 file descriptors
os.test 38679: warning: process exceeds 700 file descriptors
os.test 38679: warning: process exceeds 800 file descriptors
os.test 38679: warning: process exceeds 900 file descriptors
os.test 38679: warning: process exceeds 1000 file descriptors
os.test 38679: warning: process exceeds 1100 file descriptors
os.test 38679: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.13s)
    os_test.go:2799: testing fs.Sub(fsys, dir): TestFS found errors:
        .: fs.ReadDir: open .: './testdata' file does not exist

— watchflakes

@bcmills bcmills mentioned this issue Jan 25, 2023
Closed
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-24 19:29 plan9-arm go@083d94f6 (log) 
go: no such tool "compile"
go tool dist: Failed: exit status: 'go 24782: 2'

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-20 09:27 plan9-arm go@1bef0707 os.TestDirFS (log) 
os.test 38845: warning: process exceeds 100 file descriptors
os.test 38845: warning: process exceeds 200 file descriptors
os.test 38845: warning: process exceeds 300 file descriptors
os.test 38845: warning: process exceeds 400 file descriptors
os.test 38845: warning: process exceeds 500 file descriptors
os.test 38845: warning: process exceeds 600 file descriptors
os.test 38845: warning: process exceeds 700 file descriptors
os.test 38845: warning: process exceeds 800 file descriptors
os.test 38845: warning: process exceeds 900 file descriptors
os.test 38845: warning: process exceeds 1000 file descriptors
os.test 38845: warning: process exceeds 1100 file descriptors
os.test 38845: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.08s)
    os_test.go:2799: TestFS found errors:
        b: second Open: open b: './testdata' file does not exist
2023-01-25 16:38 plan9-arm go@1d3088ef os.TestFileReadDir (log) 
os.test 38568: warning: process exceeds 100 file descriptors
os.test 38568: warning: process exceeds 200 file descriptors
os.test 38568: warning: process exceeds 300 file descriptors
os.test 38568: warning: process exceeds 400 file descriptors
os.test 38568: warning: process exceeds 500 file descriptors
os.test 38568: warning: process exceeds 600 file descriptors
os.test 38568: warning: process exceeds 700 file descriptors
os.test 38568: warning: process exceeds 800 file descriptors
os.test 38568: warning: process exceeds 900 file descriptors
os.test 38568: warning: process exceeds 1000 file descriptors
os.test 38568: warning: process exceeds 1100 file descriptors
os.test 38568: warning: process exceeds 1200 file descriptors
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.01s)
        os_test.go:436: stat ./env.go: './env.go' file does not exist
2023-01-25 18:50 plan9-arm go@3c7884a2 (log)
2023-01-26 01:06 plan9-arm go@89de906a os.TestDirFS (log) 
os.test 38675: warning: process exceeds 100 file descriptors
os.test 38675: warning: process exceeds 200 file descriptors
os.test 38675: warning: process exceeds 300 file descriptors
os.test 38675: warning: process exceeds 400 file descriptors
os.test 38675: warning: process exceeds 500 file descriptors
os.test 38675: warning: process exceeds 600 file descriptors
os.test 38675: warning: process exceeds 700 file descriptors
os.test 38675: warning: process exceeds 800 file descriptors
os.test 38675: warning: process exceeds 900 file descriptors
os.test 38675: warning: process exceeds 1000 file descriptors
os.test 38675: warning: process exceeds 1100 file descriptors
os.test 38675: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.07s)
    os_test.go:2799: TestFS found errors:
        dir: Open: open dir: './testdata' file does not exist
2023-01-26 19:45 plan9-arm go@627f1286 os.TestFileReadDir (log) 
os.test 38900: warning: process exceeds 100 file descriptors
os.test 38900: warning: process exceeds 200 file descriptors
os.test 38900: warning: process exceeds 300 file descriptors
os.test 38900: warning: process exceeds 400 file descriptors
os.test 38900: warning: process exceeds 500 file descriptors
os.test 38900: warning: process exceeds 600 file descriptors
os.test 38900: warning: process exceeds 700 file descriptors
os.test 38900: warning: process exceeds 800 file descriptors
os.test 38900: warning: process exceeds 900 file descriptors
os.test 38900: warning: process exceeds 1000 file descriptors
os.test 38900: warning: process exceeds 1100 file descriptors
os.test 38900: warning: process exceeds 1200 file descriptors
--- FAIL: TestFileReadDir (0.00s)
    --- FAIL: TestFileReadDir/. (0.02s)
        os_test.go:436: stat ./dir_unix.go: './dir_unix.go' file does not exist
2023-01-26 21:33 plan9-arm net@296f09aa go@dd44d981 x/net/http2/h2c.TestPropagation (log) 
2023/02/02 01:48:51 http2: server connection error from 127.0.0.1:38262: connection error: COMPRESSION_ERROR
2023/02/02 01:48:51 http2: server connection error from 127.0.0.1:61518: connection error: COMPRESSION_ERROR
panic: test timed out after 30m0s
running tests:
	TestPropagation (30m0s)

golang.org/x/net/http2.(*clientConnPool).getClientConn(0x918e1a0, 0x918a100, {0x9184110, 0xf}, 0x1)
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:97 +0x1e4
golang.org/x/net/http2.(*clientConnPool).GetClientConn(0x918e1a0, 0x918a100, {0x9184110, 0xf})
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:55 +0x3c
golang.org/x/net/http2.(*Transport).RoundTripOpt(0x918c120, 0x918a100, {0x0})
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:554 +0x198
golang.org/x/net/http2.(*Transport).RoundTrip(0x918c120, 0x918a100)
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:513 +0x2c
net/http.send(0x918a100, {0x3bb8b0, 0x918c120}, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:252 +0x52c
net/http.(*Client).send(0x918e140, 0x918a100, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:176 +0x94
net/http.(*Client).do(0x918e140, 0x918a100)
	/boot/workdir/go/src/net/http/client.go:716 +0x944
net/http.(*Client).Do(...)
	/boot/workdir/go/src/net/http/client.go:582
golang.org/x/net/http2/h2c.TestPropagation(0x91940f0)
	/boot/workdir/gopath/src/golang.org/x/net/http2/h2c/h2c_test.go:133 +0x500
testing.tRunner(0x91940f0, 0x367b44)
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestWriteAtInAppendMode (log) 
--- FAIL: TestWriteAtInAppendMode (0.00s)
    os_test.go:920: chtmpdir: chdir /boot/workdir/go/src/os: '/boot/workdir/go/src/os' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestOpenFileLimit (log) 
--- FAIL: TestOpenFileLimit (0.00s)
    rlimit_test.go:31: open rlimit.go: 'rlimit.go' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReadDir (log) 
--- FAIL: TestReadDir (0.00s)
    read_test.go:129: ReadDir .: read_test.go file not found
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReadFile (log) 
--- FAIL: TestReadFile (0.00s)
    read_test.go:36: ReadFile read_test.go: open read_test.go: 'read_test.go' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestDirFSRootDir (log) 
--- FAIL: TestDirFSRootDir (0.00s)
    os_test.go:2846: open tmp/test3691254424/testdata/dirfs/a: '/tmp/test3691254424/testdata' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestDirFS (log) 
--- FAIL: TestDirFS (0.00s)
    os_test.go:2799: TestFS found errors:
        .: Open: open .: './testdata' file does not exist
        expected but not found: a
        expected but not found: b
        expected but not found: dir/x
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReaddirSmallSeek (log) 
--- FAIL: TestReaddirSmallSeek (0.00s)
    os_test.go:2706: open /tmp/test3691254424/testdata/issue37161: '/tmp/test3691254424/testdata' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReadDir (log) 
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.00s)
        os_test.go:454: could not find dir_unix.go
        os_test.go:454: could not find env.go
        os_test.go:454: could not find error.go
        os_test.go:454: could not find file.go
        os_test.go:454: could not find os_test.go
        os_test.go:454: could not find types.go
        os_test.go:454: could not find stat_darwin.go
        os_test.go:454: could not find stat_linux.go
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReaddir (log) 
--- FAIL: TestFileReaddir (0.01s)
    --- FAIL: TestFileReaddir/. (0.00s)
        os_test.go:399: could not find dir_unix.go
        os_test.go:399: could not find env.go
        os_test.go:399: could not find error.go
        os_test.go:399: could not find file.go
        os_test.go:399: could not find os_test.go
        os_test.go:399: could not find types.go
        os_test.go:399: could not find stat_darwin.go
        os_test.go:399: could not find stat_linux.go
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReaddirnames (log) 
--- FAIL: TestFileReaddirnames (0.01s)
    --- FAIL: TestFileReaddirnames/. (0.00s)
        os_test.go:362: could not find dir_unix.go
        os_test.go:362: could not find env.go
        os_test.go:362: could not find error.go
        os_test.go:362: could not find file.go
        os_test.go:362: could not find os_test.go
        os_test.go:362: could not find types.go
        os_test.go:362: could not find stat_darwin.go
        os_test.go:362: could not find stat_linux.go
2023/01/28 18:19:03 open testdata/hello: 'testdata' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os/exec (log) 
fork/exec /tmp/go-build985727719/b124/exec.test: '/boot/workdir/go/src/os' does not exist
2023-01-27 03:32 plan9-arm go@4e3abee2 os.TestDirFS (log) 
os.test 36915: warning: process exceeds 100 file descriptors
os.test 36915: warning: process exceeds 200 file descriptors
os.test 36915: warning: process exceeds 300 file descriptors
os.test 36915: warning: process exceeds 400 file descriptors
os.test 36915: warning: process exceeds 500 file descriptors
os.test 36915: warning: process exceeds 600 file descriptors
os.test 36915: warning: process exceeds 700 file descriptors
os.test 36915: warning: process exceeds 800 file descriptors
os.test 36915: warning: process exceeds 900 file descriptors
os.test 36915: warning: process exceeds 1000 file descriptors
os.test 36915: warning: process exceeds 1100 file descriptors
os.test 36915: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.16s)
    os_test.go:2799: testing fs.Sub(fsys, dir): TestFS found errors:
        x: Open: open x: './testdata' file does not exist
2023-01-30 16:32 plan9-arm go@87860873 net/http.TestServerReadTimeout (log) 
http.test 28542: warning: process exceeds 100 file descriptors
--- FAIL: TestServerReadTimeout (0.00s)
    --- FAIL: TestServerReadTimeout/h2 (1.22s)
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:43789: write tcp 127.0.0.1:40901->127.0.0.1:43789: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:40901": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:65498: write tcp 127.0.0.1:48431->127.0.0.1:65498: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:48431": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:55311: write tcp 127.0.0.1:60716->127.0.0.1:55311: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60716": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:56933: write tcp 127.0.0.1:57942->127.0.0.1:56933: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:57942": EOF
        serve_test.go:746: server timed out reading request body: got err client disconnected; want os.ErrDeadlineExceeded
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:41059": local error: tls: bad record MAC
2023-01-30 20:09 plan9-arm go@45bee5e7 os.TestReadFile (log) 
os.test 31035: warning: process exceeds 100 file descriptors
os.test 31035: warning: process exceeds 200 file descriptors
os.test 31035: warning: process exceeds 300 file descriptors
os.test 31035: warning: process exceeds 400 file descriptors
os.test 31035: warning: process exceeds 500 file descriptors
os.test 31035: warning: process exceeds 600 file descriptors
os.test 31035: warning: process exceeds 700 file descriptors
os.test 31035: warning: process exceeds 800 file descriptors
os.test 31035: warning: process exceeds 900 file descriptors
os.test 31035: warning: process exceeds 1000 file descriptors
os.test 31035: warning: process exceeds 1100 file descriptors
os.test 31035: warning: process exceeds 1200 file descriptors
--- FAIL: TestReadFile (0.01s)
    read_test.go:17: Stat "read_test.go" (looking for size 3171): stat read_test.go: 'read_test.go' file does not exist
2023-01-31 19:43 plan9-arm go@b89a840d (log) 
go: no such tool "vet"
go: no such tool "compile"
go tool dist: Failed: exit status: 'go 15678: 2'

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-02-02 23:42 plan9-arm tools@81111180 go@a9648761 x/tools/cmd/bundle.TestBundle (log) 
--- FAIL: TestBundle (5.10s)
    --- FAIL: TestBundle/Modules (1.30s)
        main_test.go:50: failed to load source package

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-23 15:08 gotip-plan9-arm go@eef35e3b cmd/link.TestStrictDup (log) 
=== RUN   TestStrictDup
=== PAUSE TestStrictDup
=== CONT  TestStrictDup
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -ldflags=-strictdups=2
    link_test.go:626: unexpected output:
--- FAIL: TestStrictDup (2430.38s)
2024-12-23 15:08 gotip-plan9-arm go@eef35e3b cmd/link/internal/ld.TestMemProfileCheck/with_memprofile_runtime_pprof_lookupheap (log) 
=== RUN   TestMemProfileCheck/with_memprofile_runtime_pprof_lookupheap
=== PAUSE TestMemProfileCheck/with_memprofile_runtime_pprof_lookupheap
=== CONT  TestMemProfileCheck/with_memprofile_runtime_pprof_lookupheap
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go run /tmp/TestMemProfileCheckwith_memprofile_runtime_pprof_lookupheap3219835578/001/x.go
    ld_test.go:365: exit status: 'go 33509: kill'
--- FAIL: TestMemProfileCheck/with_memprofile_runtime_pprof_lookupheap (2361.39s)
2024-12-23 15:08 gotip-plan9-arm go@eef35e3b encoding/asn1 (log) 
cpu: can't authenticate: pi4h: fd out of range or not open
FAIL	encoding/asn1	0.093s

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-23 19:37 x_tools-go1.23-plan9-arm tools@81940297 release-branch.go1.23@1576793c x/tools/cmd/stringer.TestMultifileStringer/x_test_package_only (log) 
=== RUN   TestMultifileStringer/x_test_package_only
    multifile_test.go:406: stringer: starting GOROOT= GOPATH= GO111MODULE=off GOPROXY= PWD=/tmp/TestMultifileStringerx_test_package_only3887804057/001 go list -e -f {{context.ReleaseTags}} -- unsafe
        stringer: starting GOROOT= GOPATH= GO111MODULE= GOPROXY= PWD=/tmp/TestMultifileStringerx_test_package_only3887804057/001 go list -tags= -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
        stringer: 1.281644846s for GOROOT= GOPATH= GO111MODULE=off GOPROXY= PWD=/tmp/TestMultifileStringerx_test_package_only3887804057/001 go list -e -f {{context.ReleaseTags}} -- unsafe
        stringer: starting GOROOT= GOPATH= GO111MODULE= GOPROXY= PWD=/tmp/TestMultifileStringerx_test_package_only3887804057/001 go list -tags= -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,DepOnly,Imports,ImportMap,TestImports,XTestImports,Export,Module -compiled=true -test=true -export=true -deps=true -find=false -pgo=off -tags= -- /tmp/TestMultifileStringerx_test_package_only3887804057/001
        stringer: 2.30002693s for GOROOT= GOPATH= GO111MODULE= GOPROXY= PWD=/tmp/TestMultifileStringerx_test_package_only3887804057/001 go list -tags= -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
        stringer: 9.475554471s for GOROOT= GOPATH= GO111MODULE= GOPROXY= PWD=/tmp/TestMultifileStringerx_test_package_only3887804057/001 go list -tags= -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,DepOnly,Imports,ImportMap,TestImports,XTestImports,Export,Module -compiled=true -test=true -export=true -deps=true -find=false -pgo=off -tags= -- /tmp/TestMultifileStringerx_test_package_only3887804057/001
        stringer: error: no packages matching /tmp/TestMultifileStringerx_test_package_only3887804057/001
    multifile_test.go:408: run stringer: /home/swarming/.swarming/w/ir/x/t/go-build1200452163/b376/stringer.test -type=Foo /tmp/TestMultifileStringerx_test_package_only3887804057/001: exit status: 'stringer.test 11415: 1'
--- FAIL: TestMultifileStringer/x_test_package_only (10.90s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-23 22:56 x_tools-go1.23-plan9-arm tools@20cd540c release-branch.go1.23@1576793c x/tools/internal/refactor/inline.TestData/std-internal.txtar [ABORT] (log) 
=== RUN   TestData/std-internal.txtar
=== PAUSE TestData/std-internal.txtar
=== CONT  TestData/std-internal.txtar

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-23 17:52 x_tools-go1.24-plan9-arm tools@b75baa00 release-branch.go1.24@16afa6a7 x/tools/cmd/stringer.TestEndToEnd/unum2.go (log) 
=== RUN   TestEndToEnd/unum2.go
    endtoend_test.go:345: run: unum2.go Unum2
    endtoend_test.go:353: stringer: starting GOROOT= GOPATH= GO111MODULE= GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/cmd/stringer go list -tags= -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
        stringer: starting GOROOT= GOPATH= GO111MODULE=off GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/cmd/stringer go list -e -f {{context.ReleaseTags}} -- unsafe
        stringer: 240.629007ms for GOROOT= GOPATH= GO111MODULE=off GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/cmd/stringer go list -e -f {{context.ReleaseTags}} -- unsafe
        stringer: starting GOROOT= GOPATH= GO111MODULE= GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/cmd/stringer go list -tags= -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,DepOnly,Imports,ImportMap,TestImports,XTestImports,Export,Module -compiled=true -test=true -export=true -deps=true -find=false -pgo=off -tags= -- /tmp/TestEndToEndunum2.go428126578/001/unum2.go
        stringer: 1.392577263s for GOROOT= GOPATH= GO111MODULE= GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/cmd/stringer go list -tags= -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
        stringer: 2.297714605s for GOROOT= GOPATH= GO111MODULE= GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/cmd/stringer go list -tags= -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,DepOnly,Imports,ImportMap,TestImports,XTestImports,Export,Module -compiled=true -test=true -export=true -deps=true -find=false -pgo=off -tags= -- /tmp/TestEndToEndunum2.go428126578/001/unum2.go
        stringer: error: no packages matching /tmp/TestEndToEndunum2.go428126578/001/unum2.go
    endtoend_test.go:355: /home/swarming/.swarming/w/ir/x/t/go-build4203016848/b402/stringer.test -type Unum2 -output /tmp/TestEndToEndunum2.go428126578/001/Unum2_string.go /tmp/TestEndToEndunum2.go428126578/001/unum2.go: exit status: 'stringer.test 3011: 1'
--- FAIL: TestEndToEnd/unum2.go (2.75s)
2024-12-23 17:52 x_tools-go1.24-plan9-arm tools@b75baa00 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestCodeAction (log) 
=== RUN   TestCodeAction
=== PAUSE TestCodeAction
=== CONT  TestCodeAction
    integration_test.go:1021: gopls codeaction -kind=quickfix -exec b.go:#40: exited with code 1, want success: true (gopls codeaction -kind=quickfix -exec b.go:#40: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo400759693/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build3866923641/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 430 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        panic: /home/swarming/.swarming/w/ir/x/w/targetrepo400759693/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build3866923641/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 430 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/gopls/internal/cache/check.go:1074 +0x2b4
        panic({0xbd4bf0, 0x1835458})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:787 +0xfc
...
        	/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/gopls/internal/cache/check.go:1270 +0x180
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x84376b0, {0xff9ad0, 0x82ff920}, 0x18369a0)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo400759693/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 383
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
--- FAIL: TestCodeAction (168.61s)
2024-12-23 20:01 x_tools-go1.24-plan9-arm tools@93cc684c release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestSignature (log) 
=== RUN   TestSignature
=== PAUSE TestSignature
=== CONT  TestSignature
    integration_test.go:671: gopls signature a.go:4:15: exited with code 1, want success: true (gopls signature a.go:4:15: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo1727281587/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1895863309/b735/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 600 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1727281587/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1727281587/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 572
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:672: gopls signature a.go:4:15: stdout does not match [Println\(a ...]; got <<>>
    integration_test.go:673: gopls signature a.go:4:15: stdout does not match [Println formats using the default formats...]; got <<>>
--- FAIL: TestSignature (30.65s)
2024-12-23 21:52 x_tools-go1.24-plan9-arm tools@02033b26 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestCodeLens (log) 
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens
    integration_test.go:215: gopls codelens ./a/a_test.go: exited with code 1, want success: true (gopls codelens ./a/a_test.go: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo804857793/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1968243301/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 657 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo804857793/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo804857793/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 635
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:216: gopls codelens ./a/a_test.go: stdout does not match [a_test.go:3: "run test" \[gopls.test\]]; got <<>>
    integration_test.go:217: gopls codelens ./a/a_test.go: stdout does not match [a_test.go:4: "run test" \[gopls.test\]]; got <<>>
--- FAIL: TestCodeLens (149.80s)
2024-12-23 22:56 x_tools-go1.24-plan9-arm tools@20cd540c release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestExecute [ABORT] (log) 
=== RUN   TestExecute
=== PAUSE TestExecute
=== CONT  TestExecute
2024-12-23 22:56 x_tools-go1.24-plan9-arm tools@20cd540c release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestStats (log) 
=== RUN   TestStats
=== PAUSE TestStats
=== CONT  TestStats
    integration_test.go:900: BugReports does not contain "cmd/info.go". Got:<<[]>>
--- FAIL: TestStats (67.13s)
2024-12-23 22:56 x_tools-go1.24-plan9-arm tools@20cd540c release-branch.go1.24@16afa6a7 x/tools/internal/refactor/inline.TestData/method.txtar (log) 
=== RUN   TestData/method.txtar
=== PAUSE TestData/method.txtar
=== CONT  TestData/method.txtar
    inline_test.go:76: Load: err: exit status: 'go 23576: 1': stderr: go: error obtaining buildID for go tool compile: exit status: 'compile 23607: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: Bad fid'
--- FAIL: TestData/method.txtar (2.51s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-23 20:01 x_tools-go1.24-plan9-arm tools@3cad8592 release-branch.go1.24@16afa6a7 x/tools/go/ssa.TestGenericBodies/p08 [ABORT] (log) 
=== RUN   TestGenericBodies/p08
=== PAUSE TestGenericBodies/p08
=== CONT  TestGenericBodies/p08

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-23 19:37 x_tools-go1.24-plan9-arm tools@81940297 release-branch.go1.24@16afa6a7 x/tools/go/analysis/internal/checker.TestRunDespiteErrors [ABORT] (log) 
=== RUN   TestRunDespiteErrors
-: # command-line-arguments
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
-: # command-line-arguments
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
-: # command-line-arguments
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
-: package xyz is not in std (/home/swarming/.swarming/w/ir/x/w/goroot/src/xyz)
-: package abc is not in std (/home/swarming/.swarming/w/ir/x/w/goroot/src/abc)
-: package xyz is not in std (/home/swarming/.swarming/w/ir/x/w/goroot/src/xyz)
-: package abc is not in std (/home/swarming/.swarming/w/ir/x/w/goroot/src/abc)
-: package xyz is not in std (/home/swarming/.swarming/w/ir/x/w/goroot/src/xyz)
-: # command-line-arguments
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
/tmp/analysistest2659972657/src/rderr/test.go:5:9: invalid operation: s + 1 (mismatched types string and untyped int)
2024/12/24 09:33:14 file=non/existing/dir matched no packages
*** Test killed with quit: ran too long (11m0s).
signal: killed
2024-12-23 19:37 x_tools-go1.24-plan9-arm tools@81940297 release-branch.go1.24@16afa6a7 x/tools/go/ssa.TestGenericBodies/p22 [ABORT] (log) 
=== RUN   TestGenericBodies/p22
=== PAUSE TestGenericBodies/p22
=== CONT  TestGenericBodies/p22

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-23 19:36 x_tools-gotip-plan9-arm tools@851152fe go@772f024c x/tools/go/ssa.TestInit [ABORT] (log) 
=== RUN   TestInit
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-23 22:56 x_tools-gotip-plan9-arm tools@20cd540c go@b9955f0a x/tools/go/analysis/unitchecker.TestExampleSeparateAnalysis (log) 
=== RUN   TestExampleSeparateAnalysis
    separate_test.go:58: go tool not available: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -o /dev/null /tmp/testenv-1232086230/main.go: exit status: 'go 18018: 2'
        runtime:stoplockedm: lockedg (atomicstatus=2) is not Grunnable or Gscanrunnable
        runtime:   gp: gp=0x1482ea8, goid=37, gp->atomicstatus=2
        runtime: getg:  g=0xbbcb80, goid=0,  g->atomicstatus=0
        fatal error: stoplockedm: not runnable
        
        runtime stack:
        runtime.throw({0x73ff37, 0x19})
        	runtime/panic.go:1099 +0x34 fp=0x3ffffe20 sp=0x3ffffe0c pc=0x7f49c
...
        fatal error: unexpected signal during runtime execution
        panic during panic
        [signal sys: trap: fault read code=0x0 addr=0x0 pc=0x6d508]
        
        runtime stack:
        runtime.throw({0x74f59e, 0x2a})
        	runtime/panic.go:1099 +0x34 fp=0x3ffffac8 sp=0x3ffffab4 pc=0x7f49c
        runtime.sigpanic()
        	runtime/os_plan9.go:76 +0x4bc fp=0x3ffffb08 sp=0x3ffffac8 pc=0x42f80
        runtime.(*unwinder).resolveInternal(0x3ffffc4c, 0x1, 0x0)
...
        runtime.goschedImpl(0x1482ea8, 0x1)
        	runtime/proc.go:4175 +0x1bc fp=0x3ffffe6c sp=0x3ffffe54 pc=0x51e2c
        runtime.gopreempt_m(...)
        	runtime/proc.go:4192
        runtime.newstack()
        	runtime/stack.go:1074 +0x410 fp=0x3fffff08 sp=0x3ffffe6c pc=0x61454
        runtime.morestack()
        	runtime/asm_arm.s:408 +0x60 fp=0x3fffff0c sp=0x3fffff08 pc=0x84008
        go 18088: suicide: sys: trap: fault write va=0xfffffffc pc=0x86868
--- FAIL: TestExampleSeparateAnalysis (3.77s)
2024-12-23 22:56 x_tools-gotip-plan9-arm tools@20cd540c go@b9955f0a x/tools/go/ssa.TestNoIndirectCreatePackage [ABORT] (log) 
=== RUN   TestNoIndirectCreatePackage
*** Test killed with quit: ran too long (11m0s).
signal: killed
2024-12-24 14:10 x_tools-gotip-plan9-arm tools@732f823c go@772f024c x/tools/gopls/internal/golang/completion/snippet (log) 
cpu: can't authenticate: pi4h: fd out of range or not open
FAIL	golang.org/x/tools/gopls/internal/golang/completion/snippet	0.085s

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-26 14:40 x_tools-go1.24-plan9-arm tools@e56f71af release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestCheck (log) 
=== RUN   TestCheck
=== PAUSE TestCheck
=== CONT  TestCheck
    integration_test.go:133: gopls check ./a.go ./b.go: stdout does not match [a.go:.* fmt.Sprintf format %s has arg 123 of wrong type int]; got <<>>
    integration_test.go:134: gopls check ./a.go ./b.go: stdout does not match [b.go:.* fmt.Sprintf format %d has arg "123" of wrong type string]; got <<>>
--- FAIL: TestCheck (110.23s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-26 14:40 x_tools-go1.23-plan9-arm tools@e56f71af release-branch.go1.23@1576793c x/tools/go/ssa.TestGenericBodies/p15 [ABORT] (log) 
=== RUN   TestGenericBodies/p15
=== PAUSE TestGenericBodies/p15
=== CONT  TestGenericBodies/p15
2024-12-26 18:51 x_tools-go1.23-plan9-arm tools@6d4eee4d release-branch.go1.23@1576793c x/tools/go/ssa.TestEnclosingFunction/Function_literal (log) 
=== RUN   TestEnclosingFunction/Function_literal
    testutil_test.go:117: err: exit status: 'go 27104: 2': stderr: fatal error: unexpected signal during runtime execution
        fatal error: unexpected signal during runtime execution
        panic during panic
        [signal sys: trap: fault read code=0x0 addr=0x0 pc=0x42320]
        
        runtime stack:
        runtime.throw({0x6eab78, 0x2a})
        	runtime/panic.go:1067 +0x34 fp=0x3ffff978 sp=0x3ffff964 pc=0x77d14
        runtime.sigpanic()
...
        os/exec.(*Cmd).Start.func2(0x1016200)
        	os/exec/exec.go:733 +0x30 fp=0x120bfe4 sp=0x120bfb4 pc=0x13c0a4
        os/exec.(*Cmd).Start.gowrap1()
        	os/exec/exec.go:745 +0x30 fp=0x120bfec sp=0x120bfe4 pc=0x13c048
        runtime.goexit({})
        	runtime/asm_arm.s:884 +0x4 fp=0x120bfec sp=0x120bfec pc=0x7f0e8
        created by os/exec.(*Cmd).Start in goroutine 34
        	os/exec/exec.go:732 +0x94c
        
--- FAIL: TestEnclosingFunction/Function_literal (2.39s)
2024-12-27 16:23 x_tools-go1.23-plan9-arm tools@412b5e97 release-branch.go1.23@1576793c x/tools/gopls/internal/cmd.TestRename (log) 
=== RUN   TestRename
=== PAUSE TestRename
=== CONT  TestRename
    integration_test.go:751: gopls rename a.go:1:9 newname: stderr does not match [cannot rename package: module path .* same as the package path, so .* no effect]; got <<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo1071961439/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build345292666/b705/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 152 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1071961439/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        panic: /home/swarming/.swarming/w/ir/x/w/targetrepo1071961439/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build345292666/b705/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 154 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1071961439/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1071961439/gopls/internal/cache/check.go:1074 +0x2b4
        panic({0xb7a798, 0x1c37470})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:785 +0xfc
...
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x20350b0, {0xf6e378, 0x208db30}, 0x1d72280)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1071961439/gopls/internal/cache/check.go:1120 +0x360
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1071961439/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 153
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>
--- FAIL: TestRename (28.32s)
2024-12-27 16:34 x_tools-go1.23-plan9-arm tools@a304b37f release-branch.go1.23@1576793c x/tools/go/analysis/passes/testinggoroutine.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2024-12-27 16:34 x_tools-go1.23-plan9-arm tools@a304b37f release-branch.go1.23@1576793c x/tools/gopls/internal/cmd.TestImports (log) 
=== RUN   TestImports
=== PAUSE TestImports
=== CONT  TestImports
    integration_test.go:552: gopls imports -diff a.go: exited with code 1, want success: true (gopls imports -diff a.go: exit=1 stdout=<<--- ./a.go.orig
        +++ ./a.go
        @@ -1,4 +1,6 @@
         package a
        +
        +import "fmt"
         func _() {
...
        	panic: invalid handle
        
        goroutine 106 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2525277333/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2525277333/gopls/internal/cache/check.go:1074 +0x2b4
        panic({0xb7a908, 0x2038418})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:785 +0xfc
        golang.org/x/tools/gopls/internal/util/bug.report({0x20180b0, 0xaa})
...
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x2020528, {0xf6e4d8, 0x1e325a0}, 0x1e9f0a0)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2525277333/gopls/internal/cache/check.go:1120 +0x360
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2525277333/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 123
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
--- FAIL: TestImports (34.47s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-26 18:51 x_tools-gotip-plan9-arm tools@6d4eee4d go@d7c3e93c x/tools/cmd/deadcode.Test/testdata/testflag.txtar/L3 [ABORT] (log) 
=== RUN   Test/testdata/testflag.txtar/L3
2024-12-26 18:51 x_tools-gotip-plan9-arm tools@6d4eee4d go@d7c3e93c x/tools/gopls/internal/cmd.TestHighlight (log) 
=== RUN   TestHighlight
=== PAUSE TestHighlight
=== CONT  TestHighlight
    integration_test.go:479: gopls highlight a.go:4:7: exited with code 1, want success: true (gopls highlight a.go:4:7: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo1531185209/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build4265929037/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 610 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1531185209/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1531185209/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 603
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:480: gopls highlight a.go:4:7: stdout does not match [a.go:4:6-13]; got <<>>
    integration_test.go:481: gopls highlight a.go:4:7: stdout does not match [a.go:5:6-13]; got <<>>
--- FAIL: TestHighlight (42.56s)
2024-12-27 16:23 x_tools-gotip-plan9-arm tools@412b5e97 go@39794819 x/tools/gopls/internal/cmd.TestStats (log) 
=== RUN   TestStats
=== PAUSE TestStats
=== CONT  TestStats
    integration_test.go:909: gopls stats -anon: exited with code 1, want success: true (gopls stats -anon: exit=1 stdout=<<>> stderr=<<Initializing workspace...     panic: /home/swarming/.swarming/w/ir/x/w/targetrepo1742269388/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build2662218201/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 137 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1742269388/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1742269388/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1742269388/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 122
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:913: failed to unmarshal JSON output of stats command: unexpected end of JSON input
--- FAIL: TestStats (26.60s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-26 20:33 gotip-plan9-arm go@cce75da3 go/build/constraint (log) 
cpu: can't authenticate: pi4h: fd out of range or not open
FAIL	go/build/constraint	0.090s
2024-12-27 13:44 gotip-plan9-arm go@d7c3e93c cmd/api.TestIssue64958 [ABORT] (log) 
=== RUN   TestIssue64958
panic: test timed out after 45m0s
	running tests:
		TestIssue64958 (44m19s)

goroutine 76 [running]:
testing.(*M).startAlarm.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/testing/testing.go:2484 +0x3a4
created by time.goFunc
	/home/swarming/.swarming/w/ir/x/w/goroot/src/time/sleep.go:215 +0x2c
...
syscall.await({0xaedd40, 0x200, 0x200})
	/home/swarming/.swarming/w/ir/x/w/goroot/src/syscall/zsyscall_plan9_arm.go:45 +0x48
syscall.Await(0xb805c0)
	/home/swarming/.swarming/w/ir/x/w/goroot/src/syscall/syscall_plan9.go:274 +0x50
syscall.startProcess.func1()
	/home/swarming/.swarming/w/ir/x/w/goroot/src/syscall/exec_plan9.go:517 +0x218
created by syscall.startProcess in goroutine 20
	/home/swarming/.swarming/w/ir/x/w/goroot/src/syscall/exec_plan9.go:492 +0xbc
*** Test killed with quit: ran too long (49m30s).
signal: killed
2024-12-27 16:31 gotip-plan9-arm go@7c03fe70 cmd/link.TestContentAddressableSymbols (log) 
=== RUN   TestContentAddressableSymbols
=== PAUSE TestContentAddressableSymbols
=== CONT  TestContentAddressableSymbols
    link_test.go:1009: command /home/swarming/.swarming/w/ir/x/w/goroot/bin/go run testdata/testHashedSyms/p.go failed: exit status: 'go 35625: 1'
        # command-line-arguments
        link: cannot read object file:read /home/swarming/.swarming/w/ir/x/w/gocache/7c/7c669c637bcb4b36a24f6c24b86d8c69b06473161748b9e8fd283ec63358fcfd-d: Bad fid
--- FAIL: TestContentAddressableSymbols (11.54s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-27 16:34 x_tools-go1.24-plan9-arm tools@a304b37f release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestReferences (log) 
=== RUN   TestReferences
=== PAUSE TestReferences
=== CONT  TestReferences
    integration_test.go:640: gopls references a.go:4:10: exited with code 1, want success: true (gopls references a.go:4:10: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo1851284605/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build16642232/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 884 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1851284605/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1851284605/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 870
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:641: gopls references a.go:4:10: stdout does not match [a.go:4:6-13]; got <<>>
    integration_test.go:642: gopls references a.go:4:10: stdout does not match [b.go:4:6-13]; got <<>>
--- FAIL: TestReferences (38.63s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-27 21:46 x_tools-go1.23-plan9-arm tools@c437d40e release-branch.go1.23@1576793c x/tools/go/analysis/passes/shadow.Test (log) 
=== RUN   Test
    analysistest.go:357: loading [a]: err: exit status: 'go 17968: 1': stderr: go: error obtaining buildID for go tool asm: exit status: 'asm 18139: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/asm: Bad fid'
--- FAIL: Test (20.11s)
2024-12-27 21:46 x_tools-go1.23-plan9-arm tools@c437d40e release-branch.go1.23@1576793c x/tools/gopls/internal/cmd.TestExecute (log) 
=== RUN   TestExecute
=== PAUSE TestExecute
=== CONT  TestExecute
    integration_test.go:352: gopls execute gopls.list_known_packages {"URI": "file:///tmp/TestExecute2832622653/001/hello.go"}: exited with code 1, want success: true (gopls execute gopls.list_known_packages {"URI": "file:///tmp/TestExecute2832622653/001/hello.go"}: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo2635157203/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1471027768/b705/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 634 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2635157203/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2635157203/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 596
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:353: gopls execute gopls.list_known_packages {"URI": "file:///tmp/TestExecute2832622653/001/hello.go"}: stdout does not match ["fmt"]; got <<>>
    integration_test.go:354: gopls execute gopls.list_known_packages {"URI": "file:///tmp/TestExecute2832622653/001/hello.go"}: stdout does not match ["encoding/json"]; got <<>>
--- FAIL: TestExecute (183.08s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-27 21:46 x_tools-go1.24-plan9-arm tools@c437d40e release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestCheck (log) 
=== RUN   TestCheck
=== PAUSE TestCheck
=== CONT  TestCheck
    integration_test.go:140: gopls check ./c/c2.go: exited with code 1, want success: true (gopls check ./c/c2.go: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build3814518703/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 607 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 626
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:141: gopls check ./c/c2.go: stdout does not match [c2.go:2:5-6: C redeclared in this block]; got <<>>
    integration_test.go:142: gopls check ./c/c2.go: stdout does not match [c.go:2:5-6: - other declaration of C]; got <<>>
--- FAIL: TestCheck (98.13s)
2024-12-27 21:46 x_tools-go1.24-plan9-arm tools@c437d40e release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestCodeLens (log) 
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens
    integration_test.go:236: gopls codelens -exec ./a/a_test.go:4 run test: stderr does not match [FAIL	example.com/a]; got <<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build3814518703/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 683 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        	panic: invalid handle
        
        goroutine 683 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/check.go:1074 +0x2b4
        panic({0xbdc020, 0x8894600})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:787 +0xfc
        golang.org/x/tools/gopls/internal/util/bug.report({0x88c2000, 0xaa})
...
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x8898b58, {0x1002e78, 0x87ade30}, 0x8129380)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo12670640/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 608
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>
--- FAIL: TestCodeLens (218.90s)
2024-12-27 21:46 x_tools-go1.24-plan9-arm tools@c437d40e release-branch.go1.24@16afa6a7 x/tools/refactor/importgraph.TestBuild (log) 
=== RUN   TestBuild
    graph_test.go:29: go tool not available: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -o /dev/null /tmp/testenv-771022367/main.go: exit status: 'go 25626: 1'
        go: error obtaining buildID for go tool asm: exit status: 'asm 25720: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/asm: Bad fid'
--- FAIL: TestBuild (6.95s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-28 01:23 gotip-plan9-arm go@2b794ed8 cmd/compile/internal/types2.TestSelf (log) 
=== RUN   TestSelf
    self_test.go:30: decl.go:11:2: could not import internal/buildcfg (can't find import: "internal/buildcfg": go: error obtaining buildID for go tool asm: exit status: 'asm 27698: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/asm: Bad fid'
        )
--- FAIL: TestSelf (56.44s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 17:36 x_tools-go1.23-plan9-arm tools@818ab3b3 release-branch.go1.23@1576793c x/tools/internal/refactor/inline.TestData/import-shadow.txtar (log) 
=== RUN   TestData/import-shadow.txtar
=== PAUSE TestData/import-shadow.txtar
=== CONT  TestData/import-shadow.txtar
    inline_test.go:76: Load: err: exit status: 'go 25592: 1': stderr: go: error obtaining buildID for go tool compile: exit status: 'compile 25724: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: Bad fid'
--- FAIL: TestData/import-shadow.txtar (4.00s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-27 21:46 x_tools-gotip-plan9-arm tools@c437d40e go@2b794ed8 x/tools/gopls/internal/cmd (log) 
PASS
*** Test killed with quit: ran too long (11m0s).
signal: killed
FAIL	golang.org/x/tools/gopls/internal/cmd	720.011s
2024-12-27 21:47 x_tools-gotip-plan9-arm tools@a6adab9c go@7c03fe70 x/tools/gopls/internal/cmd.TestCodeLens [ABORT] (log) 
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens
2024-12-30 17:57 x_tools-gotip-plan9-arm tools@d6cc3cdc go@5efb4239 x/tools/internal/refactor/inline.TestData/crosspkg.txtar [ABORT] (log) 
=== RUN   TestData/crosspkg.txtar
=== PAUSE TestData/crosspkg.txtar
=== CONT  TestData/crosspkg.txtar
2024-12-30 21:00 x_tools-gotip-plan9-arm tools@f202b363 go@856a7bc8 x/tools/gopls/internal/cmd.TestCodeAction (log) 
=== RUN   TestCodeAction
=== PAUSE TestCodeAction
=== CONT  TestCodeAction
    integration_test.go:1011: gopls codeaction -kind=quickfix a.go:#15: exited with code 1, want success: true (gopls codeaction -kind=quickfix a.go:#15: exit=1 stdout=<<>> stderr=<<gopls: ./a.go:#15: read /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/traceruntime.go: Bad fid
        >>)
    integration_test.go:1015: codeaction: got <<>>, want <<edit	"Fill in return values" [quickfix]
        >>
        stderr:
        gopls: ./a.go:#15: read /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/traceruntime.go: Bad fid
--- FAIL: TestCodeAction (193.62s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 16:49 x_net-gotip-plan9-arm net@c2be9921 go@fd5e0d26 x/net/internal/socks.TestDial/Cancel (log) 
=== RUN   TestDial/Cancel
    dial_test.go:92: got <nil>; want context.Canceled or equivalent
--- FAIL: TestDial/Cancel (0.12s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-31 00:04 x_tools-gotip-plan9-arm tools@4f820dba go@856a7bc8 x/tools/gopls/internal/cmd.TestCodeLens (log) 
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens
    integration_test.go:228: gopls -v codelens -exec ./a/a_test.go:3 run test: exited with code 1, want success: true (gopls -v codelens -exec ./a/a_test.go:3 run test: exit=1 stdout=<<>> stderr=<<2024/12/31 05:18:31 Info:2024/12/31 05:18:31 Created View (#1)
        	directory=.
        	view_type="GoMod"
        	root_dir="file://."
        	go_version="go version devel 856a7bc8e975d29b7c221264f8b0c62df2d60e42 plan9/arm"
        	build_flags=[]
        	env={GOOS:plan9 GOARCH:arm GOCACHE:/home/swarming/.swarming/w/ir/x/w/gocache GOMODCACHE:/usr/swarming/go/pkg/mod GOPATH:/usr/swarming/go GOPRIVATE: GOFLAGS: GO111MODULE: GOTOOLCHAIN:local GOROOT:/home/swarming/.swarming/w/ir/x/w/goroot GoVersion:24 GoVersionOutput:go version devel 856a7bc8e975d29b7c221264f8b0c62df2d60e42 plan9/arm
...
        # example.com/a.test
        link: cannot read object file:read /home/swarming/.swarming/w/ir/x/w/gocache/ae/ae5eeb375c8f81cd4e6fec5eab9ed5faa89d131ef278829aa56940189471a834-d: Bad fid
        FAIL	example.com/a [build failed]
        FAIL
        
        2024/12/31 05:19:17 Info:2024/12/31 05:19:17 background imports cache refresh starting
        2024/12/31 05:19:21 Info:2024/12/31 05:19:21 background refresh finished after 19.953634488s
        gopls: gopls.test command failed
        >>
--- FAIL: TestCodeLens (177.07s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 17:36 x_tools-go1.24-plan9-arm tools@818ab3b3 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestDefinition (log) 
=== RUN   TestDefinition
=== PAUSE TestDefinition
=== CONT  TestDefinition
    integration_test.go:275: gopls definition a.go:4:7: exited with code 1, want success: true (gopls definition a.go:4:7: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo585962957/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build3228142101/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 559 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo585962957/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo585962957/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 590
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:276: gopls definition a.go:4:7: stdout does not match [print.go.* defined here as func fmt.Println]; got <<>>
    integration_test.go:277: gopls definition a.go:4:7: stdout does not match [Println formats using the default formats for its operands]; got <<>>
--- FAIL: TestDefinition (75.56s)
2024-12-30 17:57 x_tools-go1.24-plan9-arm tools@d6cc3cdc release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestExecute (log) 
=== RUN   TestExecute
=== PAUSE TestExecute
=== CONT  TestExecute
    integration_test.go:361: gopls execute gopls.run_tests {"URI": "file:///tmp/TestExecute3536581154/001/hello_test.go", "Tests": ["TestHello"]}: stderr does not match [hello_test.go:4: oops]; got <<Info: 1 / 1 tests failed
        # example.com.test
        link: cannot read object file:read /home/swarming/.swarming/w/ir/x/w/gocache/e1/e1915933b8e2967a229d8e5331c055ae0fd0985b3619ccb3555f4f8f10869a18-d: fd out of range or not open
        FAIL	example.com [build failed]
        FAIL
        
        gopls: gopls.test command failed
        >>
--- FAIL: TestExecute (199.97s)
2024-12-30 21:00 x_tools-go1.24-plan9-arm tools@f202b363 release-branch.go1.24@16afa6a7 x/tools/go/ssa.TestLabels [ABORT] (log) 
=== RUN   TestLabels
*** Test killed with quit: ran too long (11m0s).
signal: killed
2024-12-30 21:00 x_tools-go1.24-plan9-arm tools@f202b363 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestExecute [ABORT] (log) 
=== RUN   TestExecute
=== PAUSE TestExecute
=== CONT  TestExecute
2024-12-30 21:00 x_tools-go1.24-plan9-arm tools@f202b363 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestPrepareRename (log) 
=== RUN   TestPrepareRename
=== PAUSE TestPrepareRename
=== CONT  TestPrepareRename
    integration_test.go:711: gopls prepare_rename a.go:2:9: exited with code 1, want success: true (gopls prepare_rename a.go:2:9: exit=1 stdout=<<>> stderr=<<panic: runtime error: invalid memory address or nil pointer dereference
        [signal sys: trap: fault read code=0x0 addr=0x0 pc=0xcf30c]
        
        goroutine 141 [running]:
        os.(*File).incref(0x1a20848, {0xcf32aa, 0x4})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/os/file_mutex_plan9.go:17 +0x20
        os.(*File).checkValid(0x1a20848, {0xcf32aa, 0x4})
...
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/io/io.go:411 +0x1bc
        io.Copy(...)
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/io/io.go:388
        golang.org/x/tools/internal/gocommand.runCmdContext.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo307462156/internal/gocommand/invoke.go:322 +0x60
        created by golang.org/x/tools/internal/gocommand.runCmdContext in goroutine 139
        	/home/swarming/.swarming/w/ir/x/w/targetrepo307462156/internal/gocommand/invoke.go:321 +0x150
        >>)
    integration_test.go:712: gopls prepare_rename a.go:2:9: stdout does not match [a.go:2:6-13]; got <<>>
--- FAIL: TestPrepareRename (16.33s)
2024-12-31 00:04 x_tools-go1.24-plan9-arm tools@4f820dba release-branch.go1.24@16afa6a7 x/tools/go/ssa/ssautil.TestCreateProgram (log) 
=== RUN   TestCreateProgram
read /home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/select.go: Bad fid
    deprecated_test.go:34: couldn't load packages due to errors: runtime
--- FAIL: TestCreateProgram (24.23s)
2024-12-31 00:04 x_tools-go1.24-plan9-arm tools@4f820dba release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestCodeLens (log) 
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens
    integration_test.go:236: gopls codelens -exec ./a/a_test.go:4 run test: stderr does not match [FAIL	example.com/a]; got <<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo1753112599/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1837691775/b731/cmd.test: fd out of range or not open
        	panic: invalid handle
        
        goroutine 654 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1753112599/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        panic: /home/swarming/.swarming/w/ir/x/w/targetrepo1753112599/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1837691775/b731/cmd.test: fd out of range or not open
        	panic: invalid handle
        
        goroutine 650 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1753112599/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1753112599/gopls/internal/cache/check.go:1074 +0x2b4
        panic({0xbdd6a8, 0x19c79f8})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:787 +0xfc
...
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x8ab61c8, {0x1004c78, 0x891d4d0}, 0x8a91cc0)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1753112599/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo1753112599/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 1
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>
--- FAIL: TestCodeLens (233.33s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 17:19 gotip-plan9-arm go@fd5e0d26 internal/runtime/math (log) 
cpu: can't authenticate: pi4h: fd out of range or not open
FAIL	internal/runtime/math	0.077s
2024-12-30 20:50 gotip-plan9-arm go@0d8aa8cc cmd/link/internal/ld.TestMemProfileCheck/with_memprofile (log) 
=== RUN   TestMemProfileCheck/with_memprofile
=== PAUSE TestMemProfileCheck/with_memprofile
=== CONT  TestMemProfileCheck/with_memprofile
    ld_test.go:365: exit status: 'go 32976: 1'
--- FAIL: TestMemProfileCheck/with_memprofile (9.70s)
2024-12-30 20:50 gotip-plan9-arm go@0d8aa8cc cmd/vet.TestVet/shift (log) 
=== RUN   TestVet/shift
=== PAUSE TestVet/shift
=== CONT  TestVet/shift
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go vet -vettool=/home/swarming/.swarming/w/ir/x/t/go-build728654767/b3358/vet.test -printfuncs=Warn,Warnf cmd/vet/testdata/shift
    vet_test.go:195: error check failed: 
        shift.go:12: missing error ".i8 . 1. .8 bits. too small for shift of 8"
        Unmatched Errors:
        go 37419: suicide: invalid address 0xffffff28/216 in sys call pc=0x83fac
        go 37419: suicide: notify stack address 0xffffff28
--- FAIL: TestVet/shift (2365.66s)
2024-12-30 20:50 gotip-plan9-arm go@0d8aa8cc net/http.TestOmitHTTP2Vet (log) 
=== RUN   TestOmitHTTP2Vet
=== PAUSE TestOmitHTTP2Vet
=== CONT  TestOmitHTTP2Vet
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go vet -tags=nethttpomithttp2 net/http
    http_test.go:105: go vet failed: exit status: 'go 10840: kill', 
--- FAIL: TestOmitHTTP2Vet (2419.22s)
2024-12-30 20:51 gotip-plan9-arm go@5efb4239 cmd/link.TestXFlag (log) 
=== RUN   TestXFlag
=== PAUSE TestXFlag
=== CONT  TestXFlag
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -ldflags=-X=main.X=meow -o /tmp/TestXFlag2581141026/001/main /tmp/TestXFlag2581141026/001/main.go
    link_test.go:348: [/home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -ldflags=-X=main.X=meow -o /tmp/TestXFlag2581141026/001/main /tmp/TestXFlag2581141026/001/main.go]: exit status: 'go 73490: kill':
--- FAIL: TestXFlag (2413.72s)
2024-12-30 23:59 gotip-plan9-arm go@856a7bc8 cmd/link/internal/ld.TestStackCheckOutput (log) 
=== RUN   TestStackCheckOutput
=== PAUSE TestStackCheckOutput
=== CONT  TestStackCheckOutput
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -o /dev/null ./testdata/stackcheck
    stackcheck_test.go:33: linker output:
    stackcheck_test.go:39: no overflow errors in output
--- FAIL: TestStackCheckOutput (2428.41s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 17:51 x_tools-go1.24-plan9-arm tools@666fab23 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestExecute (log) 
=== RUN   TestExecute
=== PAUSE TestExecute
=== CONT  TestExecute
    integration_test.go:352: gopls execute gopls.list_known_packages {"URI": "file:///tmp/TestExecute407603450/001/hello.go"}: exited with code 1, want success: true (gopls execute gopls.list_known_packages {"URI": "file:///tmp/TestExecute407603450/001/hello.go"}: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo2413424616/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build3308642102/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 672 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2413424616/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2413424616/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 637
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:353: gopls execute gopls.list_known_packages {"URI": "file:///tmp/TestExecute407603450/001/hello.go"}: stdout does not match ["fmt"]; got <<>>
    integration_test.go:354: gopls execute gopls.list_known_packages {"URI": "file:///tmp/TestExecute407603450/001/hello.go"}: stdout does not match ["encoding/json"]; got <<>>
--- FAIL: TestExecute (224.31s)
2024-12-30 17:51 x_tools-go1.24-plan9-arm tools@666fab23 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestImplementations (log) 
=== RUN   TestImplementations
=== PAUSE TestImplementations
=== CONT  TestImplementations
    integration_test.go:506: gopls implementation a.go:4:10: exited with code 1, want success: true (gopls implementation a.go:4:10: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo2413424616/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build3308642102/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 603 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2413424616/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo2413424616/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 609
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:509: gopls implementation a.go:4:10: stdout does not match [fmt.print.go:]; got <<>>
    integration_test.go:510: gopls implementation a.go:4:10: stdout does not match [runtime.error.go:]; got <<>>
--- FAIL: TestImplementations (37.93s)
2024-12-30 17:51 x_tools-go1.24-plan9-arm tools@666fab23 release-branch.go1.24@16afa6a7 x/tools/gopls/internal/cmd.TestSignature (log) 
=== RUN   TestSignature
=== PAUSE TestSignature
=== CONT  TestSignature
    integration_test.go:671: gopls signature a.go:4:15: exited with code 1, want success: true (gopls signature a.go:4:15: exit=1 stdout=<<>> stderr=<<gopls: ./a.go:4:15: not a function
        
        gopls is a Go language server.
        
        It is typically used with an editor to provide language features. When no
        command is specified, gopls will default to the 'serve' command. The language
        features can also be accessed via the gopls command-line interface.
...
          -rpc.trace
            	print the full rpc trace in lsp inspector format
          -v,-verbose
            	verbose output
          -vv,-veryverbose
            	very verbose output
        >>)
    integration_test.go:672: gopls signature a.go:4:15: stdout does not match [Println\(a ...]; got <<>>
    integration_test.go:673: gopls signature a.go:4:15: stdout does not match [Println formats using the default formats...]; got <<>>
--- FAIL: TestSignature (15.89s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 20:38 gotip-plan9-arm go@8857a5a3 cmd/vet.TestVet/assign (log) 
=== RUN   TestVet/assign
=== PAUSE TestVet/assign
=== CONT  TestVet/assign
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go vet -vettool=/home/swarming/.swarming/w/ir/x/t/go-build1272659141/b3358/vet.test -printfuncs=Warn,Warnf cmd/vet/testdata/assign
    vet_test.go:195: error check failed: 
        assign.go:18: missing error "self-assignment of x to x"
        assign.go:20: missing error "self-assignment of s.x to s.x"
        assign.go:22: missing error "self-assignment of s.l.0. to s.l.0."
--- FAIL: TestVet/assign (2376.60s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-31 00:04 x_tools-gotip-plan9-arm tools@4f820dba go@5efb4239 x/tools/cmd/stringer.TestEndToEnd [ABORT] (log) 
=== RUN   TestEndToEnd
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 20:32 gotip-plan9-arm go@3c4102bf cmd/compile/internal/test.TestPGOPreprocessDevirtualize (log) 
=== RUN   TestPGOPreprocessDevirtualize
=== PAUSE TestPGOPreprocessDevirtualize
=== CONT  TestPGOPreprocessDevirtualize
    pgo_devirtualize_test.go:45: Test without PGO:
        # example.com/pgo/devirtualize.test
        link: cannot read object file:read /home/swarming/.swarming/w/ir/x/w/gocache/13/13d1c4c3f54c7d1a77f51688882267ebfd1e8377d78dbc49a70833a8ffa9ce3e-d: Bad fid
        FAIL	example.com/pgo/devirtualize [build failed]
        FAIL
    pgo_devirtualize_test.go:47: Test failed without PGO: exit status: 'go 28366: 1'
--- FAIL: TestPGOPreprocessDevirtualize (26.83s)
2024-12-30 20:32 gotip-plan9-arm go@3c4102bf cmd/link.TestMachOBuildVersion (log) 
=== RUN   TestMachOBuildVersion
=== PAUSE TestMachOBuildVersion
=== CONT  TestMachOBuildVersion
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -ldflags=-linkmode=internal -o /tmp/TestMachOBuildVersion1458329890/001/main /tmp/TestMachOBuildVersion1458329890/001/main.go
    link_test.go:378: [/home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -ldflags=-linkmode=internal -o /tmp/TestMachOBuildVersion1458329890/001/main /tmp/TestMachOBuildVersion1458329890/001/main.go]: exit status: 'go 35676: kill':
--- FAIL: TestMachOBuildVersion (2387.27s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-31 00:04 x_tools-gotip-plan9-arm tools@4f820dba go@0d8aa8cc x/tools/internal/refactor/inline.TestData/crosspkg.txtar [ABORT] (log) 
=== RUN   TestData/crosspkg.txtar
=== PAUSE TestData/crosspkg.txtar
=== CONT  TestData/crosspkg.txtar

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 20:23 gotip-plan9-arm go@b702a26c cmd/vet.TestVet/lostcancel (log) 
=== RUN   TestVet/lostcancel
=== PAUSE TestVet/lostcancel
=== CONT  TestVet/lostcancel
    vet_test.go:195: error check failed: 
        lostcancel.go:10: missing error "the cancel function is not used on all paths \\(possible context leak\\)"
        lostcancel.go:14: missing error "this return statement may be reached without using the cancel var defined on line 10"
        Unmatched Errors:
        go: error obtaining buildID for go tool compile: exit status: 'compile 41445: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: Bad fid'
--- FAIL: TestVet/lostcancel (3.81s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 20:21 gotip-plan9-arm go@15f23245 go/types.TestSelf (log) 
=== RUN   TestSelf
    self_test.go:33: version.go:9:2: could not import go/version (can't find import: "go/version": go: error obtaining buildID for go tool asm: exit status: 'asm 62711: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/asm: Bad fid'
        )
--- FAIL: TestSelf (106.63s)
2024-12-31 00:04 x_tools-gotip-plan9-arm tools@4f820dba go@3c4102bf x/tools/gopls/internal/cmd.TestCodeLens (log) 
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens
    integration_test.go:228: gopls -v codelens -exec ./a/a_test.go:3 run test: exited with code 1, want success: true (gopls -v codelens -exec ./a/a_test.go:3 run test: exit=1 stdout=<<>> stderr=<<2024/12/31 17:56:41 Info:2024/12/31 17:56:41 Created View (#1)
        	directory=.
        	view_type="GoMod"
        	root_dir="file://."
        	go_version="go version devel 3c4102bfd4dc87cba19152af834754170b863b39 plan9/arm"
        	build_flags=[]
        	env={GOOS:plan9 GOARCH:arm GOCACHE:/home/swarming/.swarming/w/ir/x/w/gocache GOMODCACHE:/usr/swarming/go/pkg/mod GOPATH:/usr/swarming/go GOPRIVATE: GOFLAGS: GO111MODULE: GOTOOLCHAIN:local GOROOT:/home/swarming/.swarming/w/ir/x/w/goroot GoVersion:24 GoVersionOutput:go version devel 3c4102bfd4dc87cba19152af834754170b863b39 plan9/arm
...
        # example.com/a.test
        link: cannot read object file:read /home/swarming/.swarming/w/ir/x/w/gocache/3e/3e294766eee22cf59c9eefd66e040a2d380d33cdc15ffd471e5938514e02e1ec-d: Bad fid
        FAIL	example.com/a [build failed]
        FAIL
        
        2024/12/31 17:58:01 Info:2024/12/31 17:58:01 background imports cache refresh starting
        2024/12/31 17:58:04 Info:2024/12/31 17:58:04 background refresh finished after 53.375954139s
        gopls: gopls.test command failed
        >>
--- FAIL: TestCodeLens (254.31s)
2024-12-31 00:04 x_tools-gotip-plan9-arm tools@4f820dba go@3c4102bf x/tools/gopls/internal/cmd.TestExecute (log) 
=== RUN   TestExecute
=== PAUSE TestExecute
=== CONT  TestExecute
    integration_test.go:361: gopls execute gopls.run_tests {"URI": "file:///tmp/TestExecute1683504634/001/hello_test.go", "Tests": ["TestHello"]}: stderr does not match [hello_test.go:4: oops]; got <<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo81529166/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1716645986/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 745 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo81529166/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        	panic: invalid handle
        
        goroutine 745 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo81529166/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo81529166/gopls/internal/cache/check.go:1074 +0x2b4
        panic({0xbdd9d0, 0x9efc700})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:787 +0xfc
        golang.org/x/tools/gopls/internal/util/bug.report({0x1990420, 0xaa})
...
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x9efe6f0, {0x1005244, 0x9efb1a0}, 0x92fdd00)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo81529166/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo81529166/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 727
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>
--- FAIL: TestExecute (177.61s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-30 17:36 x_tools-gotip-plan9-arm tools@818ab3b3 go@856a7bc8 x/tools/go/analysis/passes/stdmethods.TestAnalyzeEncodingXML [ABORT] (log) 
=== RUN   TestAnalyzeEncodingXML
*** Test killed with quit: ran too long (11m0s).
signal: killed
2024-12-30 17:51 x_tools-gotip-plan9-arm tools@666fab23 go@856a7bc8 x/tools/go/types/objectpath.TestOrdering (log) 
=== RUN   TestOrdering
    testfiles.go:141: err: exit status: 'go 112294: 1': stderr: go: error obtaining buildID for go tool compile: exit status: 'compile 112304: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: Bad fid'
        
--- FAIL: TestOrdering (1.39s)
2024-12-31 00:04 x_tools-gotip-plan9-arm tools@4f820dba go@fd5e0d26 x/tools/gopls/internal/cmd.TestCodeAction (log) 
=== RUN   TestCodeAction
=== PAUSE TestCodeAction
=== CONT  TestCodeAction
    integration_test.go:981: gopls codeaction -title=Browse.*doc a.go: exited with code 1, want success: true (gopls codeaction -title=Browse.*doc a.go: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo3401199449/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1225913562/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 413 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo3401199449/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        panic: /home/swarming/.swarming/w/ir/x/w/targetrepo3401199449/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1225913562/b731/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 413 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo3401199449/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo3401199449/gopls/internal/cache/check.go:1074 +0x2b4
        panic({0xbdd9d0, 0x84ef288})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:787 +0xfc
...
        	/home/swarming/.swarming/w/ir/x/w/targetrepo3401199449/gopls/internal/cache/check.go:1270 +0x180
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x837bd28, {0x1005244, 0x1acf6b0}, 0x8694d80)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo3401199449/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo3401199449/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 382
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
--- FAIL: TestCodeAction (198.97s)
2024-12-31 00:04 x_tools-gotip-plan9-arm tools@4f820dba go@fd5e0d26 x/tools/internal/refactor/inline.TestData/embed.txtar [ABORT] (log) 
=== RUN   TestData/embed.txtar
=== PAUSE TestData/embed.txtar
=== CONT  TestData/embed.txtar

— watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-arm Issues solely affecting the 32-bit arm architecture. NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Plan9
Projects
Test Flakes
Status: Active
Milestone
Unplanned
Development

No branches or pull requests
5 participants
@bcmills @oridb @gopherbot @seankhliao @millerresearch