Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upload toolstates.json to rust-lang-ci2 #65274

Merged
merged 4 commits into from
Oct 31, 2019

Conversation

pietroalbini
Copy link
Member

@pietroalbini pietroalbini commented Oct 10, 2019

This PR does two things:

  • Following up with ci: move most of the prepare config into scripts #65202, it migrates deploying artifacts to CI in a script. Both uploading release artifacts and CPU stats were merged into the same script, designing it to be easily extended.
  • Uploads the toolstate JSON to rust-lang-ci2 along with the release artifacts, both for Linux and Windows. This is needed because @RalfJung wants to stop shipping MIRI when its tests are failing, and the toolstate repo doesn't have entries for each commit. Having the toolstate data (just for that specific commit) on rust-lang-ci2 will simplify the code a lot.

r? @alexcrichton
cc @RalfJung

@pietroalbini pietroalbini added the T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue. label Oct 10, 2019
@rust-highfive rust-highfive added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. label Oct 10, 2019
@pietroalbini pietroalbini force-pushed the ci-upload-toolstate branch 2 times, most recently from abb6d9f to cc77a24 Compare October 10, 2019 15:34
@alexcrichton
Copy link
Member

r=me on cc77a24, feel free to merge when ready

@pietroalbini
Copy link
Member Author

@alexcrichton did you also review 25e606978ab6417fa93cc19099e05f16b3081d83?

@alexcrichton
Copy link
Member

I did not, but I did now, and seems fine!

@bors
Copy link
Contributor

bors commented Oct 24, 2019

☔ The latest upstream changes (presumably #65762) made this pull request unmergeable. Please resolve the merge conflicts.

Uploading the toolstate data for each commit will help our release
tooling understand which components are failing, to possibly skip
shipping broken tools to users.
@pietroalbini pietroalbini changed the title [WIP] Upload toolstates.json to rust-lang-ci2 Upload toolstates.json to rust-lang-ci2 Oct 29, 2019
@pietroalbini
Copy link
Member Author

Rebased this on top of master.

@bors r=alexcrichton

@bors
Copy link
Contributor

bors commented Oct 29, 2019

📌 Commit 0200050 has been approved by alexcrichton

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Oct 29, 2019
src/ci/scripts/upload-artifacts.sh Outdated Show resolved Hide resolved
src/ci/scripts/upload-artifacts.sh Outdated Show resolved Hide resolved
src/ci/scripts/upload-artifacts.sh Outdated Show resolved Hide resolved
Co-Authored-By: lzutao <taolzu@gmail.com>
@pietroalbini
Copy link
Member Author

@bors r=alexcrichton

@bors
Copy link
Contributor

bors commented Oct 29, 2019

📌 Commit bdfcde4 has been approved by alexcrichton

tmandry added a commit to tmandry/rust that referenced this pull request Oct 30, 2019
…=alexcrichton

Upload toolstates.json to rust-lang-ci2

This PR does two things:

* Following up with rust-lang#65202, it migrates deploying artifacts to CI in a script. Both uploading release artifacts and CPU stats were merged into the same script, designing it to be easily extended.
* Uploads the toolstate JSON to `rust-lang-ci2` along with the release artifacts, both for Linux and Windows. This is needed because @RalfJung wants to stop shipping MIRI when its tests are failing, and the toolstate repo doesn't have entries for each commit. Having the toolstate data (just for that specific commit) on `rust-lang-ci2` will simplify the code a lot.

r? @alexcrichton
cc @RalfJung
@bors
Copy link
Contributor

bors commented Oct 30, 2019

⌛ Testing commit bdfcde4 with merge 1ce210ad823e29aed485f7a250ffc1b3f220aedd...

@rust-highfive
Copy link
Collaborator

The job x86_64-gnu-tools of your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.
2019-10-30T08:44:53.2203633Z Script contents:
2019-10-30T08:44:53.2204058Z src/ci/scripts/upload-artifacts.sh
2019-10-30T08:44:53.2204798Z ========================== Starting Command Output ===========================
2019-10-30T08:44:53.2208306Z [command]/bin/bash --noprofile --norc /home/vsts/work/_temp/6678d18b-18ae-493b-90a7-766ae699244b.sh
2019-10-30T08:44:53.2208830Z cp: cannot stat '/tmp/toolstates.json': No such file or directory
2019-10-30T08:44:53.2209015Z 
2019-10-30T08:44:53.2277338Z ##[error]Bash exited with code '1'.
2019-10-30T08:44:53.2302317Z ##[section]Starting: Checkout
2019-10-30T08:44:53.2303922Z ==============================================================================
2019-10-30T08:44:53.2304012Z Task         : Get sources
2019-10-30T08:44:53.2304112Z Description  : Get sources from a repository. Supports Git, TfsVC, and SVN repositories.

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

@pietroalbini
Copy link
Member Author

@bors try

@bors
Copy link
Contributor

bors commented Oct 30, 2019

⌛ Trying commit a2a2a788152cd30188cdf4d79c21fe4ed11399bb with merge 573370ea7720b8b8755299ad0464ae5ce9cd2166...

@bors
Copy link
Contributor

bors commented Oct 30, 2019

💔 Test failed - checks-azure

@rust-highfive
Copy link
Collaborator

Your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

@pietroalbini
Copy link
Member Author

@bors try

@bors
Copy link
Contributor

bors commented Oct 30, 2019

⌛ Trying commit a2a2a788152cd30188cdf4d79c21fe4ed11399bb with merge ff69cc2c1a81e79cdc48d0e7c4195a3ac06a2923...

@rust-highfive
Copy link
Collaborator

The job x86_64-msvc-tools of your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.
2019-10-30T17:45:26.1681441Z do so (now or later) by using -b with the checkout command again. Example:
2019-10-30T17:45:26.1681619Z 
2019-10-30T17:45:26.1681764Z   git checkout -b <new-branch-name>
2019-10-30T17:45:26.1681892Z 
2019-10-30T17:45:26.1682035Z HEAD is now at ff69cc2c1 Auto merge of #65274 - pietroalbini:ci-upload-toolstate, r=<try>
2019-10-30T17:45:26.2099623Z ##[section]Starting: Decide whether to run this job
2019-10-30T17:45:26.2241512Z ==============================================================================
2019-10-30T17:45:26.2241618Z Task         : Bash
2019-10-30T17:45:26.2241681Z Description  : Run a Bash script on macOS, Linux, or Windows
---
2019-10-30T17:45:27.6123118Z BUILD_SOURCEBRANCHNAME=try
2019-10-30T17:45:27.6123186Z BUILD_SOURCESDIRECTORY=D:\a\1\s
2019-10-30T17:45:27.6123259Z BUILD_SOURCEVERSION=ff69cc2c1a81e79cdc48d0e7c4195a3ac06a2923
2019-10-30T17:45:27.6123341Z BUILD_SOURCEVERSIONAUTHOR=bors
2019-10-30T17:45:27.6123424Z BUILD_SOURCEVERSIONMESSAGE=Auto merge of #65274 - pietroalbini:ci-upload-toolstate, r=<try>
2019-10-30T17:45:27.6123569Z COBERTURA_HOME=C:\cobertura-2.1.1
2019-10-30T17:45:27.6123801Z COMMONPROGRAMFILES=C:\Program Files\Common Files
2019-10-30T17:45:27.6123886Z COMMON_TESTRESULTSDIRECTORY=D:\a\1\TestResults
2019-10-30T17:45:27.6123947Z COMPUTERNAME=fv-az379
2019-10-30T17:45:27.6123947Z COMPUTERNAME=fv-az379
2019-10-30T17:45:27.6124182Z COMSPEC=C:\windows\system32\cmd.exe
2019-10-30T17:45:27.6124238Z CONDA=C:\Miniconda
2019-10-30T17:45:27.6124302Z ChocolateyInstall=C:\ProgramData\chocolatey
2019-10-30T17:45:27.6124366Z ChromeWebDriver=C:\SeleniumWebDrivers\ChromeDriver
2019-10-30T17:45:27.6124626Z CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files
2019-10-30T17:45:27.6124697Z CommonProgramW6432=C:\Program Files\Common Files
2019-10-30T17:45:27.6124764Z DEPLOY_BUCKET=rust-lang-ci2
2019-10-30T17:45:27.6124835Z DEPLOY_TOOLSTATES_JSON=toolstates-windows.json
2019-10-30T17:45:27.6124980Z EXEPATH=C:\Program Files\Git\bin
2019-10-30T17:45:27.6125039Z GCM_INTERACTIVE=Never
2019-10-30T17:45:27.6125102Z GIT_TERMINAL_PROMPT=0
2019-10-30T17:45:27.6125157Z GOROOT=C:\Go1.12.7
---
2019-10-30T17:47:08.3599255Z Extracting 64-bit C:\ProgramData\chocolatey\lib\msys2\tools\msys2-base-x86_64-20190524.tar.xz to D:\a/msys2...
2019-10-30T17:47:14.2559674Z D:\a/msys2
2019-10-30T17:47:14.3035945Z Extracting D:\a\msys2\msys2-base-x86_64-20190524.tar to D:\a/msys2...
2019-10-30T17:47:44.0043732Z D:\a/msys2
2019-10-30T17:47:45.6016840Z Invoking first run to setup things like bash profile, gpg etc...
2019-10-30T17:47:45.6088728Z Invoking msys2 shell command: -defterm -no-start -c "ps -ef | grep '[?]' | awk '{print $2}' | xargs -r kill"
2019-10-30T17:47:45.7687009Z mkdir: cannot change permissions of '/dev/shm': Permission denied
2019-10-30T17:47:45.7837897Z mkdir: cannot change permissions of '/dev/mqueue': Permission denied
2019-10-30T17:47:46.0057867Z 'C:\windows\system32\drivers\etc\hosts' -> '/etc/hosts'
2019-10-30T17:47:46.0357510Z 'C:\windows\system32\drivers\etc\protocol' -> '/etc/protocols'
2019-10-30T17:47:46.0656329Z 'C:\windows\system32\drivers\etc\services' -> '/etc/services'
2019-10-30T17:47:46.0980655Z 'C:\windows\system32\drivers\etc\networks' -> '/etc/networks'
2019-10-30T17:47:46.2606500Z gpg: no ultimately trusted keys found
2019-10-30T17:47:46.4702485Z gpg: starting migration from earlier GnuPG versions
2019-10-30T17:47:46.5131093Z gpg: porting secret keys from '/etc/pacman.d/gnupg/secring.gpg' to gpg-agent
2019-10-30T17:47:46.5135426Z gpg: migration succeeded
2019-10-30T17:47:46.5135426Z gpg: migration succeeded
2019-10-30T17:47:46.5364230Z gpg: Generating pacman keyring master key...
2019-10-30T17:47:46.8431992Z gpg: key BE80190C73EE4951 marked as ultimately trusted
2019-10-30T17:47:46.8432182Z gpg: directory '/etc/pacman.d/gnupg/openpgp-revocs.d' created
2019-10-30T17:47:46.8590564Z gpg: revocation certificate stored as '/etc/pacman.d/gnupg/openpgp-revocs.d/8DE3CBDECE7A16BA2C74647DBE80190C73EE4951.rev'
2019-10-30T17:47:46.8590932Z gpg: Done
2019-10-30T17:47:46.8879763Z ==> Updating trust database...
2019-10-30T17:47:46.9080693Z gpg: marginals needed: 3  completes needed: 1  trust model: pgp
2019-10-30T17:47:46.9081273Z gpg: depth: 0  valid:   1  signed:   0  trust: 0-, 0q, 0n, 0m, 0f, 1u
2019-10-30T17:47:47.0998045Z ==> Locally signing trusted keys in keyring...
2019-10-30T17:47:47.1217438Z   -> Locally signing key D55E7A6D7CE9BA1587C0ACACF40D263ECA25678A...
2019-10-30T17:47:47.2867202Z   -> Locally signing key 123D4D51A1793859C2BE916BBBE514E53E0D0813...
2019-10-30T17:47:47.4162671Z   -> Locally signing key B91BCF3303284BF90CC043CA9F418C233E652008...
2019-10-30T17:47:47.4162671Z   -> Locally signing key B91BCF3303284BF90CC043CA9F418C233E652008...
2019-10-30T17:47:47.5402028Z   -> Locally signing key 9DD0D4217D75A33B896159E6DA7EF2ABAEEA755C...
2019-10-30T17:47:47.6473654Z ==> Importing owner trust values...
2019-10-30T17:47:47.6632679Z gpg: setting ownertrust to 4
2019-10-30T17:47:47.6634184Z gpg: setting ownertrust to 4
2019-10-30T17:47:47.6635540Z gpg: setting ownertrust to 4
2019-10-30T17:47:47.6635649Z gpg: inserting ownertrust of 4
2019-10-30T17:47:47.6909700Z ==> Updating trust database...
2019-10-30T17:47:47.7110747Z gpg: marginals needed: 3  completes needed: 1  trust model: pgp
2019-10-30T17:47:47.7116991Z gpg: depth: 0  valid:   1  signed:   4  trust: 0-, 0q, 0n, 0m, 0f, 1u
2019-10-30T17:47:47.7123460Z gpg: depth: 1  valid:   4  signed:   3  trust: 0-, 0q, 0n, 4m, 0f, 0u
2019-10-30T17:47:47.7126632Z gpg: depth: 2  valid:   3  signed:   0  trust: 3-, 0q, 0n, 0m, 0f, 0u
2019-10-30T17:47:49.9255787Z gpg: refreshing 8 keys from hkps://hkps.pool.sks-keyservers.net
2019-10-30T17:47:56.5567802Z gpg: key 4DF3B7664CA56930: 1 signature not checked due to a missing key
2019-10-30T17:47:56.6115187Z gpg: key 4DF3B7664CA56930: "Ray Donnelly (MSYS2 Developer) <mingw.android@gmail.com>" 2 new signatures
2019-10-30T17:47:56.6155564Z gpg: key D595C9AB2C51581E: 4 signatures not checked due to missing keys
2019-10-30T17:47:56.6167546Z gpg: key D595C9AB2C51581E: "Martell Malone (MSYS2 Developer) <martellmalone@gmail.com>" not changed
2019-10-30T17:47:56.6249997Z gpg: key 5F92EFC1A47D45A1: 1 signature not checked due to a missing key
2019-10-30T17:47:56.6334867Z gpg: key 5F92EFC1A47D45A1: "Alexey Pavlov (Alexpux) <alexpux@gmail.com>" 1 new signature
2019-10-30T17:47:56.6379369Z gpg: key 9F418C233E652008: "Ignacio Casal Quinteiro <icquinteiro@gmail.com>" 2 new signatures
2019-10-30T17:47:56.6430016Z gpg: key BBE514E53E0D0813: "Ray Donnelly (MSYS2 Developer - master key) <mingw.android@gmail.com>" 2 new signatures
2019-10-30T17:47:56.6453827Z gpg: key DA7EF2ABAEEA755C: 1 signature not checked due to a missing key
2019-10-30T17:47:56.6481751Z gpg: key DA7EF2ABAEEA755C: "Martell Malone (martell) <martellmalone@gmail.com>" 3 new signatures
2019-10-30T17:47:56.6526305Z gpg: key F40D263ECA25678A: 1 signature not checked due to a missing key
2019-10-30T17:47:56.6563830Z gpg: key F40D263ECA25678A: "Alexey Pavlov (Alexpux) <alexey.pawlow@gmail.com>" 4 new signatures
2019-10-30T17:47:56.6564838Z gpg:              unchanged: 1
2019-10-30T17:47:56.6565205Z gpg:         new signatures: 14
2019-10-30T17:47:56.6565205Z gpg:         new signatures: 14
2019-10-30T17:47:56.6639970Z gpg: marginals needed: 3  completes needed: 1  trust model: pgp
2019-10-30T17:47:56.6640505Z gpg: depth: 0  valid:   1  signed:   4  trust: 0-, 0q, 0n, 0m, 0f, 1u
2019-10-30T17:47:56.6645119Z gpg: depth: 1  valid:   4  signed:   3  trust: 0-, 0q, 0n, 4m, 0f, 0u
2019-10-30T17:47:56.6647033Z gpg: depth: 2  valid:   3  signed:   0  trust: 3-, 0q, 0n, 0m, 0f, 0u
2019-10-30T17:47:56.8770761Z --> Installing /usr/share/info/autosprintf.info.gz ... done
2019-10-30T17:47:56.9192285Z --> Installing /usr/share/info/bash.info.gz ... done
2019-10-30T17:47:56.9696218Z --> Installing /usr/share/info/coreutils.info.gz ... done
2019-10-30T17:47:57.0062299Z --> Installing /usr/share/info/find.info.gz ... done
---
2019-10-30T17:47:57.5935600Z --> Installing /usr/share/info/gzip.info.gz ... done
2019-10-30T17:47:57.6313074Z --> Installing /usr/share/info/history.info.gz ... done
2019-10-30T17:47:57.6731240Z --> Installing /usr/share/info/inetutils.info.gz ... done
2019-10-30T17:47:57.7106124Z --> Installing /usr/share/info/info-stnd.info.gz ... done
2019-10-30T17:47:57.7500310Z --> Installing /usr/share/info/ksba.info.gz ... done
2019-10-30T17:47:57.8291964Z --> Installing /usr/share/info/libgomp.info.gz ... done
2019-10-30T17:47:57.8668012Z --> Installing /usr/share/info/libidn2.info.gz ... done
2019-10-30T17:47:57.9064131Z --> Installing /usr/share/info/libquadmath.info.gz ... done
2019-10-30T17:47:57.9466486Z --> Installing /usr/share/info/libtasn1.info.gz ... done
---
2019-10-30T17:47:59.0864948Z 
2019-10-30T17:47:59.0865792Z 
2019-10-30T17:47:59.1454990Z kill: 1233: No such process
2019-10-30T17:47:59.7102685Z Repeating system update until there are no more updates or max 5 iterations
2019-10-30T17:47:59.7110309Z Output is recorded in: D:\a\msys2\update.log
2019-10-30T17:47:59.7129979Z ================= SYSTEM UPDATE 1 =================
2019-10-30T17:47:59.7130246Z 
2019-10-30T17:47:59.7130246Z 
2019-10-30T17:47:59.7155335Z Invoking msys2 shell command: -defterm -no-start -c "pacman --noconfirm -Syuu | tee -a /update.log; ps -ef | grep '[?]' | awk '{print $2}' | xargs -r kill"
2019-10-30T17:48:00.7381481Z downloading mingw32.db...
2019-10-30T17:48:00.8335185Z downloading mingw32.db.sig...
2019-10-30T17:48:00.9985194Z downloading mingw64.db...
2019-10-30T17:48:01.0703926Z downloading mingw64.db.sig...
---
2019-10-30T17:48:03.1479872Z upgrading mintty...
2019-10-30T17:48:03.2799941Z upgrading pacman...
2019-10-30T17:48:05.2781685Z warning: terminate MSYS2 without returning to shell and check for updates again
2019-10-30T17:48:05.2919427Z warning: for example close your terminal window instead of calling exit
2019-10-30T17:48:05.2977453Z       0 [main] bash (4872) D:\a\msys2\usr\bin\bash.exe: *** fatal error - cygheap base mismatch detected - 0x180330408/0x180317408.
2019-10-30T17:48:05.2978053Z This problem is probably due to using incompatible versions of the cygwin DLL.
2019-10-30T17:48:05.2978468Z Search for cygwin1.dll using the Windows Start->Find/Search facility
2019-10-30T17:48:05.2978933Z and delete all but the most recent version.  The most recent version *should*
2019-10-30T17:48:05.2979313Z reside in x:\cygwin\bin, where 'x' is the drive on which you have
2019-10-30T17:48:05.2979692Z installed the cygwin distribution.  Rebooting is also suggested if you
2019-10-30T17:48:05.2980401Z are unable to find another cygwin DLL.
2019-10-30T17:48:05.3857508Z       0 [main] bash 980 dofork: child -1 - forked process 4872 died unexpectedly, retry 0, exit code 0xC0000142, errno 11
2019-10-30T17:48:05.3857996Z /usr/bin/bash: fork: retry: Resource temporarily unavailable
2019-10-30T17:48:06.3826172Z       0 [main] bash (1056) D:\a\msys2\usr\bin\bash.exe: *** fatal error - cygheap base mismatch detected - 0x180330408/0x180317408.
2019-10-30T17:48:06.3826906Z This problem is probably due to using incompatible versions of the cygwin DLL.
2019-10-30T17:48:06.3827326Z Search for cygwin1.dll using the Windows Start->Find/Search facility
2019-10-30T17:48:06.3827894Z and delete all but the most recent version.  The most recent version *should*
2019-10-30T17:48:06.3828358Z reside in x:\cygwin\bin, where 'x' is the drive on which you have
2019-10-30T17:48:06.3828726Z installed the cygwin distribution.  Rebooting is also suggested if you
2019-10-30T17:48:06.3829066Z are unable to find another cygwin DLL.
2019-10-30T17:48:06.4011727Z 1015563 [main] bash 980 dofork: child -1 - forked process 1056 died unexpectedly, retry 0, exit code 0xC0000142, errno 11
2019-10-30T17:48:06.4012317Z /usr/bin/bash: fork: retry: Resource temporarily unavailable
2019-10-30T17:48:08.4020139Z       0 [main] bash (3252) D:\a\msys2\usr\bin\bash.exe: *** fatal error - cygheap base mismatch detected - 0x180330408/0x180317408.
2019-10-30T17:48:08.4020849Z This problem is probably due to using incompatible versions of the cygwin DLL.
2019-10-30T17:48:08.4021298Z Search for cygwin1.dll using the Windows Start->Find/Search facility
2019-10-30T17:48:08.4021736Z and delete all but the most recent version.  The most recent version *should*
2019-10-30T17:48:08.4022110Z reside in x:\cygwin\bin, where 'x' is the drive on which you have
2019-10-30T17:48:08.4022522Z installed the cygwin distribution.  Rebooting is also suggested if you
2019-10-30T17:48:08.4022876Z are unable to find another cygwin DLL.
2019-10-30T17:48:08.4214715Z 3035863 [main] bash 980 dofork: child -1 - forked process 3252 died unexpectedly, retry 0, exit code 0xC0000142, errno 11
2019-10-30T17:48:08.4215139Z /usr/bin/bash: fork: retry: Resource temporarily unavailable
2019-10-30T17:48:12.4217704Z       1 [main] bash (1616) D:\a\msys2\usr\bin\bash.exe: *** fatal error - cygheap base mismatch detected - 0x180330408/0x180317408.
2019-10-30T17:48:12.4218266Z This problem is probably due to using incompatible versions of the cygwin DLL.
2019-10-30T17:48:12.4218514Z Search for cygwin1.dll using the Windows Start->Find/Search facility
2019-10-30T17:48:12.4218752Z and delete all but the most recent version.  The most recent version *should*
2019-10-30T17:48:12.4219003Z reside in x:\cygwin\bin, where 'x' is the drive on which you have
2019-10-30T17:48:12.4219209Z installed the cygwin distribution.  Rebooting is also suggested if you
2019-10-30T17:48:12.4219410Z are unable to find another cygwin DLL.
2019-10-30T17:48:12.4401597Z 7054419 [main] bash 980 dofork: child -1 - forked process 1616 died unexpectedly, retry 0, exit code 0xC0000142, errno 11
2019-10-30T17:48:12.4402149Z /usr/bin/bash: fork: retry: Resource temporarily unavailable
2019-10-30T17:48:20.4441446Z       0 [main] bash (700) D:\a\msys2\usr\bin\bash.exe: *** fatal error - cygheap base mismatch detected - 0x180330408/0x180317408.
2019-10-30T17:48:20.4442075Z This problem is probably due to using incompatible versions of the cygwin DLL.
2019-10-30T17:48:20.4442434Z Search for cygwin1.dll using the Windows Start->Find/Search facility
2019-10-30T17:48:20.4442734Z and delete all but the most recent version.  The most recent version *should*
2019-10-30T17:48:20.4443074Z reside in x:\cygwin\bin, where 'x' is the drive on which you have
2019-10-30T17:48:20.4443392Z installed the cygwin distribution.  Rebooting is also suggested if you
2019-10-30T17:48:20.4443671Z are unable to find another cygwin DLL.
2019-10-30T17:48:20.4631324Z 15077398 [main] bash 980 dofork: child -1 - forked process 700 died unexpectedly, retry 0, exit code 0xC0000142, errno 11
2019-10-30T17:48:20.4632337Z /usr/bin/bash: fork: Resource temporarily unavailable
2019-10-30T17:48:20.9123964Z ================= SYSTEM UPDATE 2 =================
2019-10-30T17:48:20.9124232Z 
2019-10-30T17:48:20.9124232Z 
2019-10-30T17:48:20.9132755Z Invoking msys2 shell command: -defterm -no-start -c "pacman --noconfirm -Syuu | tee -a /update.log; ps -ef | grep '[?]' | awk '{print $2}' | xargs -r kill"
2019-10-30T17:48:21.9151950Z  mingw32 is up to date
2019-10-30T17:48:21.9152074Z  mingw64 is up to date
2019-10-30T17:48:21.9152297Z  msys is up to date
2019-10-30T17:48:21.9153517Z :: Starting core system upgrade...
---
2019-10-30T17:48:57.8773248Z kill: 1618: No such process
2019-10-30T17:48:58.0446670Z 
2019-10-30T17:48:58.0447454Z ================= SYSTEM UPDATE 3 =================
2019-10-30T17:48:58.0447979Z 
2019-10-30T17:48:58.0458077Z Invoking msys2 shell command: -defterm -no-start -c "pacman --noconfirm -Syuu | tee -a /update.log; ps -ef | grep '[?]' | awk '{print $2}' | xargs -r kill"
2019-10-30T17:48:59.0332760Z  mingw32 is up to date
2019-10-30T17:48:59.0332915Z  mingw64 is up to date
2019-10-30T17:48:59.0333613Z  msys is up to date
2019-10-30T17:48:59.0334602Z :: Starting core system upgrade...

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

@bors
Copy link
Contributor

bors commented Oct 30, 2019

💔 Test failed - checks-azure

@pietroalbini
Copy link
Member Author

@bors try

@bors
Copy link
Contributor

bors commented Oct 30, 2019

⌛ Trying commit f10cf1d with merge 9f899dc...

bors added a commit that referenced this pull request Oct 30, 2019
Upload toolstates.json to rust-lang-ci2

This PR does two things:

* Following up with #65202, it migrates deploying artifacts to CI in a script. Both uploading release artifacts and CPU stats were merged into the same script, designing it to be easily extended.
* Uploads the toolstate JSON to `rust-lang-ci2` along with the release artifacts, both for Linux and Windows. This is needed because @RalfJung wants to stop shipping MIRI when its tests are failing, and the toolstate repo doesn't have entries for each commit. Having the toolstate data (just for that specific commit) on `rust-lang-ci2` will simplify the code a lot.

r? @alexcrichton
cc @RalfJung
Before this commit toolstates.json was stored in /tmp and it wasn't
mounted outside the build container. That caused uploading the file in
the upload-artifacts task to fail, as the file was missing on the host.

Mounting /tmp/toolstates.json alone is not the best approach: if the
file is missing when the container is started the Docker engine will
create a *directory* named /tmp/toolstates.json.

The Docker issue could be solved by pre-creating an empty file named
/tmp/toolstates.json, but doing that could cause problems if bootstrap
fails to generate the file and the toolstate scripts receive an empty
JSON.

The approach I took in this commit is to instead mount a /tmp/toolstate
directory inside Docker, and create the toolstates.json file in it. That
also required a small bootstrap change to ensure the directory is
created if it's missing.
@pietroalbini
Copy link
Member Author

Ok the last try build seems to be going through.

@alexcrichton I had to add ca34687 as well, could you review it and r+ rollup the PR once the try build finishes? The rollup is extra safe as I tested all the builders affected by this with try builds.

@alexcrichton
Copy link
Member

@bors: r+

sure!

I'll leave the rollup bit to those who come along and see success

@bors
Copy link
Contributor

bors commented Oct 30, 2019

📌 Commit ca34687 has been approved by alexcrichton

@bors bors added S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. and removed S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. labels Oct 30, 2019
@pietroalbini
Copy link
Member Author

@bors rollup

Centril added a commit to Centril/rust that referenced this pull request Oct 31, 2019
…=alexcrichton

Upload toolstates.json to rust-lang-ci2

This PR does two things:

* Following up with rust-lang#65202, it migrates deploying artifacts to CI in a script. Both uploading release artifacts and CPU stats were merged into the same script, designing it to be easily extended.
* Uploads the toolstate JSON to `rust-lang-ci2` along with the release artifacts, both for Linux and Windows. This is needed because @RalfJung wants to stop shipping MIRI when its tests are failing, and the toolstate repo doesn't have entries for each commit. Having the toolstate data (just for that specific commit) on `rust-lang-ci2` will simplify the code a lot.

r? @alexcrichton
cc @RalfJung
bors added a commit that referenced this pull request Oct 31, 2019
Rollup of 7 pull requests

Successful merges:

 - #65274 (Upload toolstates.json to rust-lang-ci2)
 - #65434 (Add long error explanation for E0577)
 - #65850 (Update comments re type parameter hack in object safety)
 - #65955 (ci: revert msys2 ca-certificates hack)
 - #65959 (Fix an incorrect docstring for Immediate in librustc_mir/interpret.)
 - #65979 (Switch CrateMetadata's source_map_import_info from RwLock to Once)
 - #65981 (work around aggressive syntax feature gating)

Failed merges:

r? @ghost
@bors bors merged commit ca34687 into rust-lang:master Oct 31, 2019
@RalfJung
Copy link
Member

Thanks a lot @pietroalbini! I will get back to #60301 based on top of this on the week-end.

@pietroalbini pietroalbini deleted the ci-upload-toolstate branch October 31, 2019 07:37
pietroalbini added a commit to pietroalbini/rust that referenced this pull request Nov 5, 2019
…bini

when Miri tests are not passing, do not add Miri component

Second attempt, this time based on the JSON files that exist since rust-lang#65274.

Fixes rust-lang#60301
r? @pietroalbini @alexcrichton
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
S-waiting-on-bors Status: Waiting on bors to run and complete tests. Bors will change the label on completion. T-infra Relevant to the infrastructure team, which will review and decide on the PR/issue.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants