Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Deadlocks with ubuntu-latest (OpenMPI>= 4.1.2) #1057

Closed
ClaudiaComito opened this issue Dec 12, 2022 · 1 comment
Closed

[Bug]: Deadlocks with ubuntu-latest (OpenMPI>= 4.1.2) #1057

ClaudiaComito opened this issue Dec 12, 2022 · 1 comment
Assignees
@ClaudiaComito
Labels
bug Something isn't working communication MPI Anything related to MPI communication
Milestone
1.2.2

Comments

@ClaudiaComito
Copy link
Contributor

What happened?

Unit tests hang for test_printing on 3 processes after the latest ubuntu/openmpi/mpi4py upgrade.

Code snippet triggering the error

def test_split_1_below_threshold(self):
   ...

Error message or erroneous outcome

Deadlock

Version

main (development branch)

Python version

3.9

PyTorch version

1.12

MPI version

openmpi 4.1.2
@ClaudiaComito ClaudiaComito added bug Something isn't working MPI Anything related to MPI communication communication labels Dec 12, 2022
@ClaudiaComito ClaudiaComito added this to the 1.2.2 milestone Dec 12, 2022
@ClaudiaComito ClaudiaComito self-assigned this Dec 12, 2022
@ClaudiaComito ClaudiaComito mentioned this issue Dec 12, 2022
Merged
4 tasks
ClaudiaComito added a commit that referenced this issue Dec 26, 2022
@ClaudiaComito
merge branch bugs/#1057-Allgatherv-contiguity-mismatch
6779010
@ClaudiaComito
Copy link
Contributor Author

Fixed by #1058

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ClaudiaComito ClaudiaComito

Labels
bug Something isn't working communication MPI Anything related to MPI communication
Projects
None yet
Milestone
1.2.2
Development

No branches or pull requests
1 participant
@ClaudiaComito