Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-38766: [R] Add timeout option to try_download #38767

Merged
merged 3 commits into from
Nov 18, 2023

Conversation

paleolimbot
Copy link
Member

@paleolimbot paleolimbot commented Nov 17, 2023

Rationale for this change

The download of static libraries during installation might be causing an install failure: https://www.r-project.org/nosvn/R.check/r-devel-windows-x86_64/arrow-00install.html

What changes are included in this PR?

The timeout value is temporarily increased according to guidance in the help for download.file()

Are these changes tested?

Yes, this code runs during install for at least some CI jobs (also used to download cmake)

Are there any user-facing changes?

No

@paleolimbot paleolimbot changed the title Add timeout option to try_download GH-38766: [R] Add timeout option to try_download Nov 17, 2023
@github-actions github-actions bot added the awaiting committer review Awaiting committer review label Nov 17, 2023
Copy link

⚠️ GitHub issue #38766 has been automatically assigned in GitHub to PR creator.

Comment on lines 82 to 83
# We download some fairly large files, so ensure the timeout is set appropriately
opts <- options(timeout = max(300, getOption("timeout")))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How big are our binaries? We could back of the envelope math for downloading that in worst-case speed. You might have already done this calculation, if so, would be nice to add that to the comment so we know

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Currently one the windows one is 70 MB. I added a note!

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's wonderful. Thank you!

@github-actions github-actions bot added awaiting changes Awaiting changes and removed awaiting committer review Awaiting committer review labels Nov 17, 2023
@github-actions github-actions bot added Component: R awaiting change review Awaiting change review awaiting changes Awaiting changes and removed awaiting changes Awaiting changes awaiting change review Awaiting change review labels Nov 17, 2023
@github-actions github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Nov 17, 2023
Copy link
Member

@assignUser assignUser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good idea! I have experienced intermittent slower download speeds from the artifactory before. With the option users can set a longer timeout if they have a slower connection so 100 sec seems reasonable.

@assignUser
Copy link
Member

@github-actions crossbow submit r-binary-packages

(I don't think any of the PR CI jobs exercise this code path, I will merge after)

Copy link

Revision: 49e2a0b

Submitted crossbow builds: ursacomputing/crossbow @ actions-4430486f55

Task Status
r-binary-packages Github Actions

@assignUser assignUser merged commit c6682f1 into apache:main Nov 18, 2023
10 of 11 checks passed
@assignUser assignUser removed the awaiting change review Awaiting change review label Nov 18, 2023
@assignUser
Copy link
Member

The failure is unrelated (seems to be a fluke in r-lib setup-r-dependencies during pak install on 4.2, hasn't happened in the nightlies so 🤷 )

Copy link

After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit c6682f1.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 2 possible false positives for unstable benchmarks that are known to sometimes produce them.

@assignUser
Copy link
Member

hasn't happened in the nightlies
;/ it has now see #38779

@paleolimbot paleolimbot deleted the r-increase-timeout branch November 20, 2023 13:34
thisisnic pushed a commit to thisisnic/arrow that referenced this pull request Nov 23, 2023
### Rationale for this change

The download of static libraries during installation might be causing an install failure: https://www.r-project.org/nosvn/R.check/r-devel-windows-x86_64/arrow-00install.html

### What changes are included in this PR?

The timeout value is temporarily increased according to guidance in the help for `download.file()`

### Are these changes tested?

Yes, this code runs during install for at least some CI jobs (also used to download cmake)

### Are there any user-facing changes?

No
* Closes: apache#38766

Lead-authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Co-authored-by: Dewey Dunnington <dewey@voltrondata.com>
Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
assignUser pushed a commit to thisisnic/arrow that referenced this pull request Nov 28, 2023
### Rationale for this change

The download of static libraries during installation might be causing an install failure: https://www.r-project.org/nosvn/R.check/r-devel-windows-x86_64/arrow-00install.html

### What changes are included in this PR?

The timeout value is temporarily increased according to guidance in the help for `download.file()`

### Are these changes tested?

Yes, this code runs during install for at least some CI jobs (also used to download cmake)

### Are there any user-facing changes?

No
* Closes: apache#38766

Lead-authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Co-authored-by: Dewey Dunnington <dewey@voltrondata.com>
Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
raulcd pushed a commit that referenced this pull request Nov 28, 2023
### Rationale for this change

The download of static libraries during installation might be causing an install failure: https://www.r-project.org/nosvn/R.check/r-devel-windows-x86_64/arrow-00install.html

### What changes are included in this PR?

The timeout value is temporarily increased according to guidance in the help for `download.file()`

### Are these changes tested?

Yes, this code runs during install for at least some CI jobs (also used to download cmake)

### Are there any user-facing changes?

No
* Closes: #38766

Lead-authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Co-authored-by: Dewey Dunnington <dewey@voltrondata.com>
Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
assignUser pushed a commit to assignUser/arrow that referenced this pull request Dec 1, 2023
### Rationale for this change

The download of static libraries during installation might be causing an install failure: https://www.r-project.org/nosvn/R.check/r-devel-windows-x86_64/arrow-00install.html

### What changes are included in this PR?

The timeout value is temporarily increased according to guidance in the help for `download.file()`

### Are these changes tested?

Yes, this code runs during install for at least some CI jobs (also used to download cmake)

### Are there any user-facing changes?

No
* Closes: apache#38766

Lead-authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Co-authored-by: Dewey Dunnington <dewey@voltrondata.com>
Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
dgreiss pushed a commit to dgreiss/arrow that referenced this pull request Feb 19, 2024
### Rationale for this change

The download of static libraries during installation might be causing an install failure: https://www.r-project.org/nosvn/R.check/r-devel-windows-x86_64/arrow-00install.html

### What changes are included in this PR?

The timeout value is temporarily increased according to guidance in the help for `download.file()`

### Are these changes tested?

Yes, this code runs during install for at least some CI jobs (also used to download cmake)

### Are there any user-facing changes?

No
* Closes: apache#38766

Lead-authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
Co-authored-by: Dewey Dunnington <dewey@voltrondata.com>
Signed-off-by: Jacob Wujciak-Jens <jacob@wujciak.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[R] Ensure timeout for download.file is set appropriately
3 participants