Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Task]: [RRIO] [Throttle] transform that slows down element transmission using Redis #28932

Closed
2 of 5 tasks
damondouglas opened this issue Oct 10, 2023 · 0 comments · Fixed by #29401
Closed
2 of 5 tasks

Comments

@damondouglas
Copy link
Contributor

damondouglas commented Oct 10, 2023

What needs to happen?

What needs to happen?

The output of this task is a transform that throttles an incoming PCollection of elements using a Redis based external resource. It uses the Call transform and therefore requires part of its implementation as a dependency. Tests require the use of a Caller implementation of a mock-api.

Measures of Ready

Measures of Done

  • Tests validate that the maximum rate of outputted elements is approximately equal to a configured value
  • Changing to the number of Dataflow workers does not change the transmission rate
  • Increasing the rate of element input does not change the transmission rate

Issue Priority

Priority: 2 (default / most normal work should be filed as P2)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant