Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[6571] Windmill service flag #7693

Merged
merged 16 commits into from
Feb 6, 2019
Merged

Conversation

dustin12
Copy link
Contributor

@dustin12 dustin12 commented Jan 31, 2019

Adds the flag --enableStreamingEngine to Java and Python. Setting this flag turns on the correct experiments to enable streaming engine on the back end.

Follow this checklist to help us incorporate your contribution quickly and easily:

  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

It will help us expedite review of your Pull Request if you tag someone (e.g. @username) to look at it.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- --- --- --- ---
Java Build Status Build Status Build Status Build Status
Build Status
Build Status
Build Status Build Status Build Status
Python Build Status --- Build Status
Build Status
Build Status --- --- ---

@dustin12 dustin12 changed the title Windmill service flag [6571] Windmill service flag Jan 31, 2019
@dustin12 dustin12 mentioned this pull request Jan 31, 2019
2 tasks
String STREAMING_ENGINE_EXPERIMENT = "enable_streaming_engine";

/** @deprecated Use STREAMING_ENGINE_EXPERIMENT instead. */
@Deprecated String WINDMILL_SERVICE_EXPERIMENT = "enable_windmill_service";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

private static final

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same

@dustin12
Copy link
Contributor Author

dustin12 commented Feb 5, 2019

Run Java PreCommit

1 similar comment
@dustin12
Copy link
Contributor Author

dustin12 commented Feb 5, 2019

Run Java PreCommit

@dustin12
Copy link
Contributor Author

dustin12 commented Feb 5, 2019

Run Java_Examples_Dataflow PreCommit

@dustin12
Copy link
Contributor Author

dustin12 commented Feb 5, 2019

Run Spotless PreCommit

@dustin12
Copy link
Contributor Author

dustin12 commented Feb 6, 2019

Run Spotless PreCommit

@dustin12
Copy link
Contributor Author

dustin12 commented Feb 6, 2019

Run Java PreCommit

@dustin12
Copy link
Contributor Author

dustin12 commented Feb 6, 2019

Run Python PreCommit

Copy link
Member

@aaltay aaltay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you tried running a sample job with the new flag?

@dustin12
Copy link
Contributor Author

dustin12 commented Feb 6, 2019

Running a sample job gives (abrieviated):

windmill_service_environment_filter: experiment enable_windmill_service is unsupported on the specified SDK version

which is correct for now as "Windmill Service requires (Dataflow or Beam) Java SDK >= 2.8.0". It still seems good to keep the flags in sync though so leaving the python flag in for now.

@aaltay aaltay merged commit f4e5dc8 into apache:master Feb 6, 2019
@dustin12 dustin12 mentioned this pull request Feb 6, 2019
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants