Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a configurable DLQ capacity of avoid OOM #18387

Merged
merged 1 commit into from
Nov 7, 2023

Conversation

elega
Copy link
Contributor

@elega elega commented Nov 7, 2023

What changes are proposed in this pull request?

  1. Add a property to limit the DLQ capacity in distributed load
  2. Fix a position reader bug where the prefetch size will converge at 2 * read length - 1

Copy link
Contributor

@Jackson-Wang-7 Jackson-Wang-7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@elega elega added the type-feature This issue is a feature request label Nov 7, 2023
@elega
Copy link
Contributor Author

elega commented Nov 7, 2023

alluxio-bot, merge this please.

@alluxio-bot alluxio-bot merged commit 723c720 into Alluxio:main Nov 7, 2023
14 checks passed
elega added a commit that referenced this pull request Nov 8, 2023
### What changes are proposed in this pull request?

1. Add a property to limit the DLQ capacity in distributed load
2. Fix a position reader bug where the prefetch size will converge at 2 * read length - 1

			pr-link: #18387
			change-id: cid-2a20dd7c85de56926cd3a6bbc67c3ed6e8c14299
ssz1997 pushed a commit to ssz1997/alluxio that referenced this pull request Dec 15, 2023
### What changes are proposed in this pull request?

1. Add a property to limit the DLQ capacity in distributed load
2. Fix a position reader bug where the prefetch size will converge at 2 * read length - 1

			pr-link: Alluxio#18387
			change-id: cid-2a20dd7c85de56926cd3a6bbc67c3ed6e8c14299
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type-feature This issue is a feature request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants