-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[6571] Windmill service flag #7693
Conversation
WindmillServiceFlag to fix conflict
...cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/options/GcpOptions.java
Show resolved
Hide resolved
String STREAMING_ENGINE_EXPERIMENT = "enable_streaming_engine"; | ||
|
||
/** @deprecated Use STREAMING_ENGINE_EXPERIMENT instead. */ | ||
@Deprecated String WINDMILL_SERVICE_EXPERIMENT = "enable_windmill_service"; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
private static final
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
same
...dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowPipelineTranslator.java
Show resolved
Hide resolved
Run Java PreCommit |
1 similar comment
Run Java PreCommit |
Run Java_Examples_Dataflow PreCommit |
Run Spotless PreCommit |
...dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowPipelineTranslator.java
Outdated
Show resolved
Hide resolved
Run Spotless PreCommit |
Run Java PreCommit |
Run Python PreCommit |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Have you tried running a sample job with the new flag?
Running a sample job gives (abrieviated):
which is correct for now as "Windmill Service requires (Dataflow or Beam) Java SDK >= 2.8.0". It still seems good to keep the flags in sync though so leaving the python flag in for now. |
Adds the flag --enableStreamingEngine to Java and Python. Setting this flag turns on the correct experiments to enable streaming engine on the back end.
Follow this checklist to help us incorporate your contribution quickly and easily:
[BEAM-XXX] Fixes bug in ApproximateQuantiles
, where you replaceBEAM-XXX
with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.It will help us expedite review of your Pull Request if you tag someone (e.g.
@username
) to look at it.Post-Commit Tests Status (on master branch)