Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove dependency on MPI compilers #350

Merged
merged 13 commits into from
Jun 11, 2020
Merged

Remove dependency on MPI compilers #350

merged 13 commits into from
Jun 11, 2020

Commits on Jun 10, 2020

  1. Remove our dependency on MPI compilers. This includes:

     - Require only mpi4py (all MPI operations done in python).  This
       allows us to build our compiled extensions with any compiler
       rather than requiring consistency with the compilers used to
       build mpi4py.
    
     - Port the high-level C++ atmosphere simulation code to python
       and use compiled code only on a single process.  Change the
       on-disk format of cached atmosphere realizations to use hdf5.
    
     - Update build system to not look for MPI compilers.
    
     - Add a new log level, "VERBOSE" which is even lower than "DEBUG".
       The intention for this is to contain messages that might come
       from every single process.
    
     - The MPIShared and MPILock classes are found in the upstream
       pshmem package.  Bundle a tagged release of that package for
       now until it is widely available on PyPI / conda-forge.
    
     - Clean up the generation of version.cpp so that it only happens
       if the version actually changes.
    tskisner committed Jun 10, 2020
    Configuration menu
    Copy the full SHA
    4fb7fa5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ec44f94 View commit details
    Browse the repository at this point in the history
  3. When caching atmosphere sims, write to a temporary file and move it i…

    …nto place at the end.
    tskisner committed Jun 10, 2020
    Configuration menu
    Copy the full SHA
    3422751 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    74cc04b View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    2a4fc9e View commit details
    Browse the repository at this point in the history
  6. Only attempt to set the numba backend if the utils.set_numba_threading()

    function is actually called.  TOAST does not use numba since it conflicts
    with our existing explicit parallelism.  The set_numba_threading() function
    is designed to be used before calling external packages that use numba,
    in order to ensure consistency between toast and numba.
    tskisner committed Jun 10, 2020
    Configuration menu
    Copy the full SHA
    6d43ba9 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    640ba29 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    23e672f View commit details
    Browse the repository at this point in the history
  9. Fix typo in debug printing of the kolmogorov spectrum. Also fix a bug…

    … that the kolmo_x spectrum was not being reduced across processes.
    tskisner committed Jun 10, 2020
    Configuration menu
    Copy the full SHA
    b095f27 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    ca03b33 View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2020

  1. Configuration menu
    Copy the full SHA
    e5c075b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e09c8fe View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    65200ae View commit details
    Browse the repository at this point in the history