[v4] Error: Write EPIPE #1280

houserx-jmcc · 2024-02-08T16:27:28Z

When switching from a working v3 setup to the new v4, we encounter this error 10-20% of the time in a high volume monorepo. Re-runs succeed on the 2nd or 3rd try. We do host our own GitHub runners.

Also a quick shoutout for #926 - if we had builtin retries this would be much less of a problem.

==> linux OS detected
https://cli.codecov.io/latest/linux/codecov.SHA256SUM
Received SHA256SUM 103bfefcc56f76473179e600b96eb8150b0f349ad94836b0f63f03ffac469ad7  codecov
Received SHA256SUM signature -----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEJwNOf9uFDgu8LGL/gGuyiu13mGkFAmW8+QUACgkQgGuyiu13
mGll6A/8CVDQ3LQaqpgQEIekCJUNKU/+tpF1EGpuUsMi7DZZ0RA6cmazUJFUlZK2
GS7Ptcwly+SYTT+a61SzeVlewPLa47XZIFyC+7tgSO6XgUNlJ+KTevyeL6GG0Qs1
YaciuJv8IHAqaaYT49iKpWE99OME1VXY3fIm4uEHlc4pgnmLv+FNdxnit4AYLGlw
2JHzdDMd5aHlnYYIyYJ9UbM8fFVWgddL1venoYl59NKc5gXjH1/+yPPWz2R+4f[22](https://github.com/houserx/micro-services/actions/runs/7832462490/job/21371233166#step:15:23)
jZfofI04aEJxNhGinfV5Vykb9asyfMupmLUweArgTIF3wzIEoYo/pK0nVgRBiROE
1hiaH5lti8brA2NF+pzp4+xFEyCU1m/mgN/rj1VRkDs0CW4S86eYWVbfuHEb0ymQ
o7Oe/rST6IjqM72B8eleEdT1DKdeX8DYSXnKvR2J1POyoPMMt/HUoCxphiNOq6Ei
416xOCgqWwOEGbeZ1pxp4Eovf6fffbd2F9MUcJTzgWocOqLh3lZB/EX3G9eLKsyf
WLW3s3NXzajS9j4zEPZxGPmnqAadfm9dzffwokFZnqMTJ7HB4qXH87BPgwPbq8R+
y/1Hv7hHEbJJhbE1fitwHFMg4gfUP6q39VtrfooQSBRYYDzrstowO/L2xsr+AkwW
EQGY70I4SY4XPKKzs8tF3Jch7Oa+xgeNMM1qSGyb2Vjn0KKSDMk=
=jEIQ
-----END PGP SIGNATURE-----

==> Running version latest
gpg: directory '/home/runner/.gnupg' created
gpg: keybox '/home/runner/.gnupg/pubring.kbx' created
gpg: /home/runner/.gnupg/trustdb.gpg: trustdb created
gpg: key 806BB[28](https://github.com/houserx/micro-services/actions/runs/7832462490/job/21371233166#step:15:29)AED779869: public key "Codecov Uploader (Codecov Uploader Verification Key) <security@codecov.io>" imported
gpg: Total number processed: 1
gpg:               imported: 1

Error: write EPIPE
    at afterWriteDispatched (node:internal/stream_base_commons:160:15)
    at writeGeneric (node:internal/stream_base_commons:151:3)
    at Socket._writeGeneric (node:net:952:11)
    at Socket._write (node:net:964:8)
    at writeOrBuffer (node:internal/streams/writable:447:12)
    at _write (node:internal/streams/writable:389:10)
    at Socket.Writable.end (node:internal/streams/writable:665:17)
    at Socket.end (node:net:722:[31](https://github.com/houserx/micro-services/actions/runs/7832462490/job/21371233166#step:15:32))
    at module.exports (/runner/_work/_actions/codecov/codecov-action/v4/node_modules/gpg/lib/spawnGPG.js:[50](https://github.com/houserx/micro-services/actions/runs/7832462490/job/21371233166#step:15:51):1)
    at Object.call (/runner/_work/_actions/codecov/codecov-action/v4/node_modules/gpg/lib/gpg.js:28:1)

The text was updated successfully, but these errors were encountered:

Jolg42 · 2024-02-08T16:33:10Z

Same here, I actually created an issue a few seconds after you 😄
#1281

drazisil-codecov · 2024-02-09T14:02:46Z

@rohan-at-sentry can you help @thomasrockhu-codecov get this investigated and resolved? Sound potentially CLI-related.

pat-kasprzyk-kiefa · 2024-02-22T23:56:54Z

I am also experiencing this error on my mono-repo, let me know what I can do to help investigate

thomasrockhu-codecov · 2024-02-24T01:32:29Z

@houserx-jmcc can you share a link to CI where this is failing? or the config file specifying the os and hardware?

houserx-jmcc · 2024-02-26T16:31:13Z

@thomasrockhu-codecov We can't provide a link as it is an internal/private repository, but we are using the vanilla image from actions-runner-controller for self-hosting GitHub runners on AWS EKS.

crazy-max · 2024-02-29T08:29:05Z

Here is a repro: https://github.com/moby/buildkit/actions/runs/8092979752/job/22114788142?pr=4717#step:9:34

Intermittent issues from codecov/codecov-action#1280

houserx-jmcc · 2024-03-18T14:14:41Z

Is this no longer being actively worked on?

thomasrockhu-codecov · 2024-03-18T16:53:04Z

@houserx-jmcc no it is, sorry I was doing some cleanup on my side

there is a bug in the action since february which is resulting in intermittently failing builds. this issue introduced in 730679b, which upgraded the codecov action. references: GH codecov/codecov-action#1280

thomasrockhu-codecov · 2024-04-24T18:59:54Z

@houserx-jmcc sorry for the delay here. I implemented retries and wanted to see if this will work for you.

In your CI, would you be able to replace the action with

uses: codecov/codecov-action@d1f1eb8ced025a661e3a2070d7c9462978291164

houserx-jmcc · 2024-04-26T17:38:23Z

2 days without seeing the error using this version. I'll report back if we see it, but assume no news is good news otherwise.

houserx-jmcc · 2024-04-26T19:38:22Z

I spoke too soon:

there is a bug in the action since february which is resulting in intermittently failing builds. this issue introduced in 730679b, which upgraded the codecov action. references: GH codecov/codecov-action#1280

Jolg42 · 2024-04-30T11:35:46Z

My colleague Alberto spotted one error today, happening on our public repo:
https://github.com/prisma/prisma/actions/runs/8893795874/job/24420825519?pr=24029#step:6:30

Run codecov/codecov-action@v4
  with:
    token: ***
    files: ./packages/client/src/__tests__/coverage/clover.xml
    flags: client,ubuntu,driveradapters
    name: client-ubuntu-driveradapters
  env:
    HAS_BUILDPULSE_SECRETS: true
    PRISMA_TELEMETRY_INFORMATION: prisma test.yml
    PRISMA_HIDE_UPDATE_MESSAGE: true
    PNPM_HOME: /home/runner/setup-pnpm/node_modules/.bin
    NPM_CONFIG_USERCONFIG: /home/runner/work/_temp/.npmrc
    NODE_AUTH_TOKEN: XXXXX-XXXXX-XXXXX-XXXXX
==> linux OS detected
https://cli.codecov.io/latest/linux/codecov.SHA256SUM
==> Running version latest
==> Running version v0.5.2
==> Running git config --global --add safe.directory /home/runner/work/prisma/prisma
/usr/bin/git config --global --add safe.directory /home/runner/work/prisma/prisma
==> Running command '/home/runner/work/_actions/codecov/codecov-action/v4/dist/codecov create-commit'
/home/runner/work/_actions/codecov/codecov-action/v4/dist/codecov create-commit --git-service github -C 151b144bf019d806b1282aae486ec97005ab97e6
gpg: directory '/home/runner/.gnupg' created
gpg: keybox '/home/runner/.gnupg/pubring.kbx' created
gpg: /home/runner/.gnupg/trustdb.gpg: trustdb created
gpg: key 806BB28AED779869: public key "Codecov Uploader (Codecov Uploader Verification Key) <security@codecov.io>" imported
gpg: Total number processed: 1
gpg:               imported: 1

Error: write EPIPE
    at afterWriteDispatched (node:internal/stream_base_commons:160:15)
    at writeGeneric (node:internal/stream_base_commons:151:3)
    at Socket._writeGeneric (node:net:952:11)
    at Socket._write (node:net:964:8)
    at writeOrBuffer (node:internal/streams/writable:447:12)
    at _write (node:internal/streams/writable:389:10)
    at Socket.Writable.end (node:internal/streams/writable:665:17)
    at Socket.end (node:net:722:31)
    at module.exports (/home/runner/work/_actions/codecov/codecov-action/v4/node_modules/gpg/lib/spawnGPG.js:50:1)
    at Object.call (/home/runner/work/_actions/codecov/codecov-action/v4/node_modules/gpg/lib/gpg.js:28:1)

thomasrockhu-codecov · 2024-04-30T17:33:10Z

Got it @houserx-jmcc @Jolg42, to be clear this not an always thing (for reproducibility)?

houserx-jmcc · 2024-04-30T17:43:35Z

@thomasrockhu-codecov correct, only happening sometimes. 1-2 retries of the same job in a workflow will usually succeed if the first time failed.

thomasrockhu-codecov · 2024-04-30T17:45:17Z

@houserx-jmcc got it, yeah, let me work on implementing retries for this

Jolg42 · 2024-05-01T09:27:04Z

@thomasrockhu-codecov It's flaky, only happens once in a while and retrying usually works but since retrying means a human needs to retry and then wait, it's sub-otimal. An automatic retry would be much better for this.

Also adds `if: success() && github.repository == 'prisma/prisma'` everywhere (only added to one before) See codecov/codecov-action#1280

thomasrockhu-codecov · 2024-05-03T16:10:52Z

@houserx-jmcc would you be able to try 6a309e2c1e1a37a02b42e5b83e33e8b7b4e5efa8?

houserx-jmcc · 2024-05-06T18:34:36Z

It seems a bit less frequent, but the issue is still occurring. Example output from 6a309e2:

Run codecov/codecov-action@6a309e2c1e1a37a02b42e5b83e33e8b7b4e5efa8
==> linux OS detected
https://cli.codecov.io/latest/linux/codecov.SHA256SUM
Received SHA256SUM e70beb7c9e3d894678e7d4d0fcb94e59[13](https://github.com/houserx/micro-services/actions/runs/8973546064/job/24643992188#step:12:14)3212dbda5ca7406b625a0167ce4ca8  codecov
Received SHA256SUM signature -----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEJwNOf9uFDgu8LGL/gGuyiu13mGkFAmYhSq4ACgkQgGuyiu13
mGkULA/8Dq6mYMCj4DxoHtfQeiQ3FZ/8HrgQmwUICQa5QHatbojQLmsYkruvvWWl
+Q7PywoiEWkFQ6nI1Wb4sTLWAMwdjjCKSECqTs9jlqXklKDKyb1Fv5O0ytwFEe/a
Wc4V4CKvH3LFHWB/ZsFMmjBBLQ3evQqz5rfk+Bih5uV/RtcNoLnWstaIqyeISyb4
NdgLWy9uapyeHfoPoZ6HEdrNhy4LvMrlCbgjwjFLZ445fE0Neq4n3QOlDKZ+RviO
FU/zYlZkWyHxrDavBEotbSWRCNB/ptyTc9uuQXEtemrJKoJYNRAIBx7N60uEEpCO
oDzALNV404Tw7WiULHyUhuxeN4EDiu2mCoa1KiMjFHjOayY6lREtsvt94ubGmAJ1
y29LiEvYIxEzd7nJcC8PzxbZk6AUv3IXA8o9m47KCVqKFMCFCTgc8fEWlrIfRtLN
HupcoOOuV7SWHXfg5vOf0vclnTpw3MVcrj+Z7dMA5OSpqcTlL8ACb9QPsKpAesUR
tth7zorPoU/RHfgEgKNPmKX9vvqB+AZ2n2oCPhlYOBP6/9NFjoIvIfWZPD9FSce7
K4FOEyaBEyypUMXtjPVj8MtoOaLk/X9g03ZKAlDxbnBIqqp0YLbqMW+nZkG8TTKI
e4d6XX447TyQ2750658NX+9Z/0c/oK+jsNCG2uocOkIL3kOHtAw=
=QUC9
-----END PGP SIGNATURE-----

==> Running version latest
gpg: directory '/home/runner/.gnupg' created
gpg: keybox '/home/runner/.gnupg/pubring.kbx' created
gpg: /home/runner/.gnupg/trustdb.gpg: trustdb created
gpg: key 806BB28AED779869: public key "Codecov Uploader (Codecov Uploader Verification Key) <security@codecov.io>" imported
gpg: Total number processed: 1
gpg:               imported: 1

Error: write EPIPE
    at afterWriteDispatched (node:internal/stream_base_commons:160:[15](https://github.com/houserx/micro-services/actions/runs/8973546064/job/24643992188#step:12:16))
    at writeGeneric (node:internal/stream_base_commons:151:3)
    at Socket._writeGeneric (node:net:952:11)
    at Socket._write (node:net:964:8)
    at writeOrBuffer (node:internal/streams/writable:447:12)
    at _write (node:internal/streams/writable:389:10)
    at Socket.Writable.end (node:internal/streams/writable:665:[17](https://github.com/houserx/micro-services/actions/runs/8973546064/job/24643992188#step:12:18))
    at Socket.end (node:net:722:31)
    at module.exports (/runner/_work/_actions/codecov/codecov-action/6a309e2c1e1a37a02b42e5b83e33e8b7b4e5efa8/node_modules/gpg/lib/spawnGPG.js:50:1)
    at Object.call (/runner/_work/_actions/codecov/codecov-action/6a309e2c1e1a37a02b42e5b83e33e8b7b4e5efa8/node_modules/gpg/lib/gpg.js:28:1)

thomasrockhu-codecov · 2024-05-07T14:24:41Z

@houserx-jmcc blast. I'll keep on noodling

thomasrockhu-codecov · 2024-05-14T16:09:44Z

Hi all, I think this should be solved in 4.4.0 now. Please let me know if that's not the case

Jolg42 mentioned this issue Feb 8, 2024

v4 fails sometimes with EPIPE after importing gpg key #1281

Closed

Jolg42 mentioned this issue Feb 8, 2024

ci:Revert "chore(deps): update codecov/codecov-action action to v4" prisma/prisma#23028

Merged

thomasrockhu-codecov self-assigned this Feb 8, 2024

Jolg42 mentioned this issue Feb 9, 2024

chore(deps): update codecov/codecov-action action to v4 prisma/prisma#23039

Merged

1 task

drazisil-codecov added the bug Something isn't working label Feb 9, 2024

drazisil-codecov unassigned thomasrockhu-codecov Feb 23, 2024

thomasrockhu-codecov self-assigned this Feb 24, 2024

alexpovel added a commit to alexpovel/srgn that referenced this issue Mar 8, 2024

ci: Ignore Codecov failures

ae06ddf

Intermittent issues from codecov/codecov-action#1280

thomasrockhu-codecov removed their assignment Mar 14, 2024

thomasrockhu-codecov self-assigned this Mar 18, 2024

houserx-jmcc mentioned this issue Apr 1, 2024

Feedback about Test Analytics and Flaky Test Reporting codecov/feedback#304

Open

charles-cooper mentioned this issue Apr 12, 2024

chore[ci]: downgrade codecov action to v3 vyperlang/vyper#3940

Merged

thomasrockhu-codecov mentioned this issue Apr 24, 2024

fix: add retries to verification #1388

Open

bunseokbot mentioned this issue Apr 26, 2024

feat: Add custom header options for webhook notification aquasecurity/trivy-operator#2044

Merged

5 tasks

thomasrockhu-codecov mentioned this issue Apr 29, 2024

token: is required even for forks #1390

Closed

sir-sigurd mentioned this issue May 1, 2024

Bump codecov/codecov-action from 3 to 4 quiltdata/quilt#3858

Merged

Jolg42 added a commit to prisma/prisma that referenced this issue May 2, 2024

ci(codecov): avoid workflow failure when codecov fails randomly

73030f8

Also adds `if: success() && github.repository == 'prisma/prisma'` everywhere (only added to one before) See codecov/codecov-action#1280

Jolg42 mentioned this issue May 2, 2024

ci(codecov): avoid workflow failure when codecov fails randomly prisma/prisma#24059

Merged

DougBurke mentioned this issue May 7, 2024

note about occasional ocdecov failures sherpa/sherpa#2028

Open

thomasrockhu-codecov mentioned this issue May 14, 2024

fix: remove GPG and run on spawn #1426

Merged

thomasrockhu-codecov closed this as completed in #1426 May 14, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[v4] Error: Write EPIPE #1280

[v4] Error: Write EPIPE #1280

houserx-jmcc commented Feb 8, 2024

Jolg42 commented Feb 8, 2024

drazisil-codecov commented Feb 9, 2024

pat-kasprzyk-kiefa commented Feb 22, 2024 •

edited

Loading

thomasrockhu-codecov commented Feb 24, 2024

houserx-jmcc commented Feb 26, 2024

crazy-max commented Feb 29, 2024

houserx-jmcc commented Mar 18, 2024

thomasrockhu-codecov commented Mar 18, 2024

thomasrockhu-codecov commented Apr 24, 2024

houserx-jmcc commented Apr 26, 2024

houserx-jmcc commented Apr 26, 2024

Jolg42 commented Apr 30, 2024

thomasrockhu-codecov commented Apr 30, 2024

houserx-jmcc commented Apr 30, 2024

thomasrockhu-codecov commented Apr 30, 2024

Jolg42 commented May 1, 2024

thomasrockhu-codecov commented May 3, 2024

houserx-jmcc commented May 6, 2024 •

edited

Loading

thomasrockhu-codecov commented May 7, 2024

thomasrockhu-codecov commented May 14, 2024

[v4] Error: Write EPIPE #1280

[v4] Error: Write EPIPE #1280

Comments

houserx-jmcc commented Feb 8, 2024

Jolg42 commented Feb 8, 2024

drazisil-codecov commented Feb 9, 2024

pat-kasprzyk-kiefa commented Feb 22, 2024 • edited Loading

thomasrockhu-codecov commented Feb 24, 2024

houserx-jmcc commented Feb 26, 2024

crazy-max commented Feb 29, 2024

houserx-jmcc commented Mar 18, 2024

thomasrockhu-codecov commented Mar 18, 2024

thomasrockhu-codecov commented Apr 24, 2024

houserx-jmcc commented Apr 26, 2024

houserx-jmcc commented Apr 26, 2024

Jolg42 commented Apr 30, 2024

thomasrockhu-codecov commented Apr 30, 2024

houserx-jmcc commented Apr 30, 2024

thomasrockhu-codecov commented Apr 30, 2024

Jolg42 commented May 1, 2024

thomasrockhu-codecov commented May 3, 2024

houserx-jmcc commented May 6, 2024 • edited Loading

thomasrockhu-codecov commented May 7, 2024

thomasrockhu-codecov commented May 14, 2024

pat-kasprzyk-kiefa commented Feb 22, 2024 •

edited

Loading

houserx-jmcc commented May 6, 2024 •

edited

Loading