Cherry-pick to 7.10: Docker build resiliance with a retry (#21587)

[v1v]

Backports the following commits to 7.10:

• Docker build resiliance with a retry (Docker build resiliance with a retry #21587)

[elasticmachine]

💔 Tests Failed

Expand to view the summary

Build stats

• Build Cause: [Pull request #21679 opened]

• Start Time: 2020-10-08T09:59:45.424+0000

• Duration: 81 min 54 sec

Test stats 🧪

Test	Results
Failed	4
Passed	16283
Skipped	1368
Total	17655

Test errors

Expand to view the tests failures

• Name: Build&Test / x-pack/elastic-agent-build / TestFleetGateway – application

  • Age: 1
  • Duration: 0
  • Error Details: Failed

• Name: Build&Test / x-pack/elastic-agent-build / TestFleetGateway/send_no_event_and_receive_no_action – application

  • Age: 1
  • Duration: 0
  • Error Details: Failed

• Name: Build&Test / x-pack/elastic-agent-build / TestFleetGateway/Successfully_connects_and_receives_a_series_of_actions – application

  • Age: 1
  • Duration: 0
  • Error Details: Failed

• Name: Build&Test / x-pack/elastic-agent-build / TestFleetGateway/Periodically_communicates_with_Fleet – application

  • Age: 1
  • Duration: 0
  • Error Details: Failed

Steps errors

Expand to view the steps failures

• Name: mage build test

  • Description: mage build test

  • Duration: 12 min 58 sec

  • Start Time: 2020-10-08T10:25:37.054+0000

  • log

Log output

Expand to view the last 100 lines of log output

[2020-10-08T11:19:40.575Z]  runc:
[2020-10-08T11:19:40.575Z]   Version:          1.0.0-rc10
[2020-10-08T11:19:40.575Z]   GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
[2020-10-08T11:19:40.575Z]  docker-init:
[2020-10-08T11:19:40.575Z]   Version:          0.18.0
[2020-10-08T11:19:40.575Z]   GitCommit:        fec3683
[2020-10-08T11:19:48.778Z] [INFO] unstashV2: JOB_GCS_BUCKET is set. bucket param got precedency instead.
[2020-10-08T11:19:48.806Z] [INFO] unstashV2: JOB_GCS_CREDENTIALS is set. credentialsId param got precedency instead.
[2020-10-08T11:19:48.876Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-21679-1/source/source.tgz
[2020-10-08T11:19:48.894Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-21679-1/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-21679/source.tgz
[2020-10-08T11:19:58.593Z] + tar --version
[2020-10-08T11:19:58.907Z] + tar -xpf source.tgz
[2020-10-08T11:20:11.481Z] + rm source.tgz
[2020-10-08T11:20:11.576Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats
[2020-10-08T11:20:11.611Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/lint-1602152545112
[2020-10-08T11:20:11.715Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/libbeat-stress-tests-1602152830381
[2020-10-08T11:20:11.816Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/winlogbeat-crosscompile-1602152907564
[2020-10-08T11:20:11.917Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/auditbeat-crosscompile-1602152948191
[2020-10-08T11:20:12.017Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-dockerlogbeat-build-1602152998447
[2020-10-08T11:20:12.118Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/journalbeat-unitTest-1602153026800
[2020-10-08T11:20:12.218Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/libbeat-crosscompile-1602153088928
[2020-10-08T11:20:12.315Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-functionbeat-build-1602153105894
[2020-10-08T11:20:12.413Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/packetbeat-build-1602153214313
[2020-10-08T11:20:12.514Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/metricbeat-unitTest-1602153336831
[2020-10-08T11:20:12.616Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/heartbeat-build-1602153412494
[2020-10-08T11:20:12.722Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/auditbeat-build-1602153437970
[2020-10-08T11:20:12.835Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-elastic-agent-build-1602153460633
[2020-10-08T11:20:12.947Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/metricbeat-crosscompile-1602153470658
[2020-10-08T11:20:13.065Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/generator-metricbeat-test-1602153482520
[2020-10-08T11:20:13.181Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-elastic-agent-windows-windows-2019-1602153485983
[2020-10-08T11:20:13.291Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/auditbeat-windows-windows-2019-1602153540309
[2020-10-08T11:20:13.407Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/generator-beat-test-1602153544918
[2020-10-08T11:20:13.524Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-auditbeat-build-1602153586176
[2020-10-08T11:20:13.641Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/heartbeat-windows-windows-2019-1602153598111
[2020-10-08T11:20:13.761Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-libbeat-build-1602153613724
[2020-10-08T11:20:13.879Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-winlogbeat-build-windows-2019-1602153713260
[2020-10-08T11:20:13.995Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-functionbeat-windows-windows-2019-1602153756377
[2020-10-08T11:20:14.107Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-auditbeat-windows-windows-2019-1602153781264
[2020-10-08T11:20:14.221Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/filebeat-windows-windows-2019-1602153821979
[2020-10-08T11:20:14.339Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/packetbeat-windows-windows-2019-1602153878159
[2020-10-08T11:20:14.451Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/winlogbeat-windows-windows-2019-1602153880733
[2020-10-08T11:20:14.567Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-filebeat-windows-windows-2019-1602153956830
[2020-10-08T11:20:14.681Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/metricbeat-windows-windows-2019-1602154104010
[2020-10-08T11:20:14.797Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-metricbeat-windows-windows-2019-1602154159332
[2020-10-08T11:20:14.914Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/filebeat-build-1602154379094
[2020-10-08T11:20:15.031Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/libbeat-build-1602154744064
[2020-10-08T11:20:15.149Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/metricbeat-goIntegTest-1602154784536
[2020-10-08T11:20:15.262Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/metricbeat-pythonIntegTest-1602154833595
[2020-10-08T11:20:15.391Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-filebeat-build-1602155075150
[2020-10-08T11:20:15.524Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-metricbeat-build-1602155607682
[2020-10-08T11:20:15.982Z] + cat
[2020-10-08T11:20:15.983Z] + /usr/local/bin/runbld ./runbld-test-reports --job-name elastic+beats+pull-request
[2020-10-08T11:20:15.983Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-10-08T11:20:22.598Z] runbld>>> runbld started
[2020-10-08T11:20:22.598Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-10-08T11:20:24.002Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-10-08T11:20:24.002Z] runbld>>> Matches in the system config:
[2020-10-08T11:20:24.002Z] runbld>>> - Matched ^elastic\+beats
[2020-10-08T11:20:24.002Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-10-08T11:20:25.388Z] runbld>>> Debug logging enabled.
[2020-10-08T11:20:25.388Z] runbld>>> Storing result
[2020-10-08T11:20:25.388Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-10-08T11:20:25.388Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201008112024-FE4F7B00
[2020-10-08T11:20:25.388Z] runbld>>> Adding system facts.
[2020-10-08T11:20:26.331Z] runbld>>> Adding vcs info for the latest commit:  f673c60181997eedfb314e6cc1d23098a2b1b2e3
[2020-10-08T11:20:26.331Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-10-08T11:20:26.331Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-10-08T11:20:26.331Z] Processing JUnit reports with runbld...
[2020-10-08T11:20:26.331Z] + echo 'Processing JUnit reports with runbld...'
[2020-10-08T11:20:26.905Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-10-08T11:20:26.905Z] runbld>>> DURATION: 17ms
[2020-10-08T11:20:26.905Z] runbld>>> STDOUT: 40 bytes
[2020-10-08T11:20:26.905Z] runbld>>> STDERR: 49 bytes
[2020-10-08T11:20:26.905Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-10-08T11:20:26.905Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-21679
[2020-10-08T11:20:27.848Z] runbld>>> Storing build metadata: 
[2020-10-08T11:20:27.848Z] runbld>>> Adding test report.
[2020-10-08T11:20:27.848Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats
[2020-10-08T11:20:28.793Z] runbld>>> Found 123 test output files
[2020-10-08T11:20:29.054Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-metricbeat-build-1602155607682/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-10-08T11:20:29.316Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-metricbeat-build-1602155607682/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-10-08T11:20:29.316Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-metricbeat-build-1602155607682/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-10-08T11:20:29.316Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-metricbeat-build-1602155607682/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-10-08T11:20:29.316Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/x-pack-metricbeat-build-1602155607682/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-10-08T11:20:31.239Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/metricbeat-goIntegTest-1602154784536/metricbeat/build/TEST-go-integration-graphite.xml
[2020-10-08T11:20:31.239Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21679/src/github.com/elastic/beats/metricbeat-goIntegTest-1602154784536/metricbeat/build/TEST-go-integration-windows.xml
[2020-10-08T11:20:31.499Z] runbld>>> Test output logs contained: Errors: 0 Failures: 4 Tests: 17655 Skipped: 1088
[2020-10-08T11:20:31.761Z] runbld>>> Storing result
[2020-10-08T11:20:31.761Z] runbld>>> FAILURES: 4
[2020-10-08T11:20:32.703Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-10-08T11:20:32.703Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201008112024-FE4F7B00
[2020-10-08T11:20:32.964Z] runbld>>> Email notification disabled by environment variable.
[2020-10-08T11:20:32.964Z] runbld>>> Slack notification disabled by environment variable.
[2020-10-08T11:20:38.511Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-21679
[2020-10-08T11:20:38.623Z] [INFO] getVaultSecret: Getting secrets
[2020-10-08T11:20:38.681Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-10-08T11:20:39.788Z] + chmod 755 generate-build-data.sh
[2020-10-08T11:20:39.788Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21679/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21679/runs/1 FAILURE 4854075
[2020-10-08T11:20:39.789Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21679/runs/1/steps/?limit=10000 -o steps-info.json
[2020-10-08T11:20:42.272Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21679/runs/1/tests/?status=FAILED -o tests-errors.json

[v1v]

Test failures unrelated to this change which cares about retrying the docker-compose build