Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add publisher side flow control #1359

Merged
merged 24 commits into from
Sep 17, 2021
Merged

Conversation

feywind
Copy link
Collaborator

@feywind feywind commented Jul 27, 2021

This PR adds publisher side flow control support, which lets you throttle the amount of messages being sent by bytes or message count.

Work in progress, to get CI.

@product-auto-label product-auto-label bot added the api: pubsub Issues related to the googleapis/nodejs-pubsub API. label Jul 27, 2021
@snippet-bot
Copy link

snippet-bot bot commented Jul 27, 2021

Here is the summary of changes.

You are about to add 2 region tags.

This comment is generated by snippet-bot.
If you find problems with this result, please file an issue at:
https://github.com/googleapis/repo-automation-bots/issues.
To update this comment, add snippet-bot:force-run label or use the checkbox below:

  • Refresh this comment

@google-cla google-cla bot added the cla: yes This human has signed the Contributor License Agreement. label Jul 27, 2021
@feywind feywind added owlbot:run Add this label to trigger the Owlbot post processor. and removed owlbot:run Add this label to trigger the Owlbot post processor. labels Jul 27, 2021
@feywind feywind added the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 30, 2021
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Jul 30, 2021
@feywind feywind marked this pull request as ready for review August 10, 2021 21:00
@feywind feywind requested review from a team as code owners August 10, 2021 21:00
@feywind
Copy link
Collaborator Author

feywind commented Aug 11, 2021

Fixes: #1081

@feywind feywind linked an issue Aug 11, 2021 that may be closed by this pull request
@feywind feywind added the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Aug 11, 2021
@yoshi-kokoro yoshi-kokoro removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Aug 11, 2021
src/publisher/flow-control.ts Outdated Show resolved Hide resolved
src/publisher/flow-control.ts Outdated Show resolved Hide resolved
src/topic.ts Outdated Show resolved Hide resolved
@feywind feywind added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 31, 2021
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 31, 2021
@feywind feywind added the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 31, 2021
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Aug 31, 2021
@feywind feywind added the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 1, 2021
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 1, 2021
@feywind feywind added the owlbot:ignore instruct owl-bot to ignore a PR label Sep 1, 2021
@feywind
Copy link
Collaborator Author

feywind commented Sep 1, 2021

Adding owlbot:ignore because this adds samples.

@feywind feywind added the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 2, 2021
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 2, 2021
@feywind feywind added the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 15, 2021
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 15, 2021
@feywind feywind added the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 16, 2021
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 16, 2021
samples/system-test/topics.test.ts Outdated Show resolved Hide resolved
samples/system-test/topics.test.ts Outdated Show resolved Hide resolved
src/publisher/index.ts Outdated Show resolved Hide resolved
src/publisher/pubsub-message.ts Outdated Show resolved Hide resolved
src/publisher/pubsub-message.ts Outdated Show resolved Hide resolved
test/publisher/flow-control.ts Outdated Show resolved Hide resolved
test/publisher/flow-publisher.ts Outdated Show resolved Hide resolved
@feywind feywind added the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 16, 2021
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Sep 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: pubsub Issues related to the googleapis/nodejs-pubsub API. cla: yes This human has signed the Contributor License Agreement. owlbot:ignore instruct owl-bot to ignore a PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

RFC: limit simutanous publish requests
4 participants