Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix a bug in use of no_use_multiple_sdk_containers experiment flag. #7741

Merged
merged 1 commit into from
Feb 6, 2019

Conversation

aaltay
Copy link
Member

@aaltay aaltay commented Feb 6, 2019

Fix a bug in use of no_use_multiple_sdk_containers experiment flag.Setting this flag should prevent the addition of use_multiple_sdk_containers experiment.


Follow this checklist to help us incorporate your contribution quickly and easily:

  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

It will help us expedite review of your Pull Request if you tag someone (e.g. @username) to look at it.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- --- --- --- ---
Java Build Status Build Status Build Status Build Status
Build Status
Build Status
Build Status Build Status Build Status
Python Build Status --- Build Status
Build Status
Build Status --- --- ---

Setting this flag should prevent the addition of
use_multiple_sdk_containers experiment.
@aaltay
Copy link
Member Author

aaltay commented Feb 6, 2019

R: @ajamato @angoenka

@@ -356,6 +356,34 @@ def test_labels(self):
self.assertEqual('key5', job.proto.labels.additionalProperties[4].key)
self.assertEqual('', job.proto.labels.additionalProperties[4].value)

def test_experiment_use_multiple_sdk_containers(self):
pipeline_options = PipelineOptions(
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to actually fail the pipeline if the experiments are invalid? Are we doing that? seems like the user was having issues getting the format correct. Just want to make sure we error out on invalid input

--experiment A,B . should fail. That was the pattern we saw
Also, do we print a good error message with proper sample input?

Please fix in this PR or add a TODO with a JIRA number.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No we do not fail this out. But "A,B" might actually be a valid experiment. This case is unlikely, but one generally possible case for having commas in the experiment is --experiment A=B,C,D

@aaltay aaltay merged commit d85452e into apache:master Feb 6, 2019
@aaltay aaltay deleted the expb branch December 20, 2022 16:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants