Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use less device memory when checkpointing particles #3238

Merged

Conversation

atmyers
Copy link
Member

@atmyers atmyers commented Apr 4, 2023

This chunks the operation per box rather than per rank so as to use less device memory.

The proposed changes:

  • fix a bug or incorrect behavior in AMReX
  • add new capabilities to AMReX
  • changes answers in the test suite to more than roundoff level
  • are likely to significantly affect the results of downstream AMReX users
  • include documentation in the code and/or rst files, if appropriate

@ax3l
Copy link
Member

ax3l commented Apr 5, 2023

@atmyers for your Intel CI issue: I pushed a work-around to #3239 :)

Copy link
Member

@ax3l ax3l left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, thanks a lot! 🎉

@ax3l ax3l added the GPU label Apr 5, 2023
@WeiqunZhang
Copy link
Member

The stream sync at line 188 is not needed.

Same stream, per review.
typename PC::IntVector write_int_comp_d(write_int_comp.size());
typename PC::IntVector write_real_comp_d(write_real_comp.size());
Gpu::copyAsync(Gpu::hostToDevice, write_int_comp.begin(), write_int_comp.end(),
write_int_comp_d.begin());
Gpu::copyAsync(Gpu::hostToDevice, write_real_comp.begin(), write_real_comp.end(),
write_real_comp_d.begin());
Gpu::Device::streamSynchronize();
write_real_comp_d.begin());\
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is there a \?

@atmyers atmyers enabled auto-merge (squash) March 29, 2024 17:45
@atmyers atmyers merged commit fe6f3de into AMReX-Codes:development Mar 29, 2024
68 of 69 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants