-
Notifications
You must be signed in to change notification settings - Fork 4.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BEAM-8399] Add --hdfs_full_urls option #10223
Conversation
This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@beam.apache.org list. Thank you for your contributions. |
ping? is it possible to get this proper merged? |
Fully @parameterized unit tests to use/not use full URLs. Added integration test with --full_urls. parameterized min version increased for parameterized_class decorator.
Run Portable_Python PreCommit |
Run PythonLint PreCommit |
Run PythonFormatter PreCommit |
1 similar comment
Run PythonFormatter PreCommit |
Run Python PreCommit |
1 similar comment
Run Python PreCommit |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. Thanks Udi.
Run Python PreCommit |
Run Python PreCommit |
Introduces a new mode, enabled via
--hdfs_full_urls
.In this mode, all hdfs:// URLs are expected to have a server designation in the first path element:
The server part is ignored; the connection config still comes from these flags:
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
R: @username
).[BEAM-XXX] Fixes bug in ApproximateQuantiles
, where you replaceBEAM-XXX
with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.See the Contributor Guide for more tips on how to make review process smoother.
Post-Commit Tests Status (on master branch)
Pre-Commit Tests Status (on master branch)
See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.