Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for memory usage estimates from PixelDistribution / PixelData #491

Open
tskisner opened this issue Sep 30, 2021 · 0 comments
Open
Milestone

Comments

@tskisner
Copy link
Member

Once a PixelDistribution object is created, the number of elements stored on each process (or each node, once shared memory is used) is fully specified. This information can be used to estimate the aggregrate and per-node memory usage. Adding this feature would allow us to estimate the map-domain memory allocation needed before doing that allocation and at least inform the user or perhaps raise an exception if there is insufficient memory available. Unfortunately we can't compute this without going through the pointing once (so we cannot do it at the start of the job), but this information would still be useful later in the workflow.

@tskisner tskisner added this to the Release 3.0 milestone Sep 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant