➜ athenapk git:(BenWibking/restart-reproducer) ✗ ./reproducer.sh + rm -rf build + mkdir build + cd build + cmake .. -DPARTHENON_ENABLE_PYTHON_MODULE_CHECK=OFF CMake Warning at external/parthenon/cmake/MachineCfg.cmake:61 (message): Not using any machine configuration. Consider creating a configuration file following the examples in /cmake/machine_cfgs/ and then point the MACHINE_CFG cmake or environment variable to your custom file.Note, that the machine file can be placed in any directory (also outside the repo). Call Stack (most recent call first): CMakeLists.txt:9 (include) -- The CXX compiler identification is AppleClang 15.0.0.15000100 -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Setting build type to 'Release' as none was specified. -- clang-format --version: 19.1.2 -- Found MPI_CXX: /opt/homebrew/Cellar/open-mpi/5.0.5/lib/libmpi.dylib (found version "3.1") -- Found MPI: TRUE (found version "3.1") found components: CXX CMake Warning at external/parthenon/cmake/MachineCfg.cmake:61 (message): Not using any machine configuration. Consider creating a configuration file following the examples in /Users/benwibking/athenapk/cmake/machine_cfgs/ and then point the MACHINE_CFG cmake or environment variable to your custom file.Note, that the machine file can be placed in any directory (also outside the repo). Call Stack (most recent call first): external/parthenon/CMakeLists.txt:21 (include) -- The C compiler identification is AppleClang 15.0.0.15000100 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Looking for C++ include filesystem -- Looking for C++ include filesystem - found -- Performing Test CXX_FILESYSTEM_NO_LINK_NEEDED -- Performing Test CXX_FILESYSTEM_NO_LINK_NEEDED - Success -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success -- Found Threads: TRUE -- Found HDF5: hdf5-shared (found version "1.14.4") found components: C -- Setting default Kokkos CXX standard to 17 -- Kokkos version: 4.4.0 -- The project name is: Kokkos -- Using internal gtest for testing -- Configured git information in /Users/benwibking/athenapk/build/generated/Kokkos_Version_Info.cpp -- SERIAL backend is being turned on to ensure there is at least one Host space. To change this, you must enable another host execution space and configure with -DKokkos_ENABLE_SERIAL=OFF or change CMakeCache.txt -- Using -std=c++17 for C++17 standard as feature -- Built-in Execution Spaces: -- Device Parallel: NoTypeDefined -- Host Parallel: NoTypeDefined -- Host Serial: SERIAL -- -- Architectures: -- Found TPLLIBDL: /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX14.2.sdk/usr/include -- Using internal desul_atomics copy -- Experimental mdspan support is enabled -- Looking for C++ include experimental/mdspan -- Looking for C++ include experimental/mdspan - not found -- Looking for C++ include mdspan -- Looking for C++ include mdspan - not found -- Using internal mdspan directory /Users/benwibking/athenapk/external/Kokkos/core/src/../../tpls/mdspan/include -- Kokkos Backends: SERIAL -- Using Kokkos source from Kokkos_ROOT=/Users/benwibking/athenapk/external/Kokkos -- PAR_LOOP_LAYOUT='SIMDFOR_LOOP' (default par_for wrapper layout) -- PAR_LOOP_INNER_LAYOUT='SIMDFOR_INNER_LOOP' (default par_for_inner wrapper layout) -- Found Python3: /opt/homebrew/Frameworks/Python.framework/Versions/3.13/bin/python3.13 (found version "3.13.0") found components: Interpreter -- Found Git: /opt/homebrew/bin/git (found version "2.47.0") -- Checking for Python modules (numpy;unyt;matplotlib;h5py;scipy) required for regression tests. Check can be disabled by setting PARTHENON_ENABLE_PYTHON_MODULE_CHECK=OFF but then tests are not guaranteed to work anymore. -- Configuring done (2.3s) -- Generating done (0.1s) -- Build files have been written to: /Users/benwibking/athenapk/build + cmake --build . [0/2] Re-checking globbed directories... [13/132] cd /Users/benwibking/athenapk/build/parthenon/Kokkos && /opt/home...s -P /Users/benwibking/athenapk/external/Kokkos/cmake/build_env_info.cmake -- Configured git information in /Users/benwibking/athenapk/build/parthenon/Kokkos/generated/Kokkos_Version_Info.cpp [131/132] Linking CXX executable bin/athenaPK + cd .. + mpirun -np 8 ./build/bin/athenaPK -i inputs/restart_reproducer.in Applying norm factor of 1 to B field. Orig mean E_mag = 5e-05 Starting up hydro driver # Variables in use: # Package: parthenon::resolved_state # --------------------------------------------------- # Variables: # Name Metadata flags # --------------------------------------------------- turbulence_phases_k None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state turbulence_phases_j None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state acc Cell,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state turbulence_phases_i None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state prim Cell,Provides,Real,Derived,Hydro,parthenon::resolved_state cons Cell,Provides,Real,Independent,FillGhost,WithFluxes,Hydro,parthenon::resolved_state bnd_flux::cons Face,Provides,Real,Derived,OneCopy,Flux,parthenon::resolved_state # --------------------------------------------------- # Sparse Variables: # Name sparse id Metadata flags # --------------------------------------------------- # --------------------------------------------------- # Swarms: # Swarm Value metadata # --------------------------------------------------- Setup complete, executing driver... cycle=0 time=0.0000000000000000e+00 dt=4.6870313203007836e-03 zone-cycles/wsec_step=0.00e+00 wsec_total=5.65e-02 wsec_step=1.49e-01 -------------- New Mesh structure after (de)refinement ------------- Number of Trees = 1 Total number of MeshBlocks = 8 Number of physical refinement levels = 0 Number of logical refinement levels = 1 Physical level = 0 (logical level = 1): 8 MeshBlocks, cost = 8 -------------------------------------------------------------------- cycle=1 time=4.6870313203007836e-03 dt=4.6624369596770087e-03 zone-cycles/wsec_step=8.19e+06 wsec_total=8.85e-02 wsec_step=3.20e-02 cycle=2 time=9.3494682799777924e-03 dt=4.6475826353307237e-03 zone-cycles/wsec_step=8.87e+06 wsec_total=1.18e-01 wsec_step=2.96e-02 cycle=3 time=1.3997050915308517e-02 dt=4.6304703306495427e-03 zone-cycles/wsec_step=8.28e+06 wsec_total=1.50e-01 wsec_step=3.16e-02 cycle=4 time=1.8627521245958061e-02 dt=4.6132081779462920e-03 zone-cycles/wsec_step=8.31e+06 wsec_total=1.81e-01 wsec_step=3.15e-02 cycle=5 time=2.3240729423904351e-02 dt=4.5971622706348228e-03 zone-cycles/wsec_step=8.16e+06 wsec_total=2.14e-01 wsec_step=3.21e-02 cycle=6 time=2.7837891694539173e-02 dt=4.5752638005413550e-03 zone-cycles/wsec_step=8.52e+06 wsec_total=2.44e-01 wsec_step=3.08e-02 cycle=7 time=3.2413155495080531e-02 dt=4.5559103547534209e-03 zone-cycles/wsec_step=7.91e+06 wsec_total=2.77e-01 wsec_step=3.31e-02 cycle=8 time=3.6969065849833949e-02 dt=4.5388251679880651e-03 zone-cycles/wsec_step=9.60e+06 wsec_total=3.05e-01 wsec_step=2.73e-02 cycle=9 time=4.1507891017822013e-02 dt=4.5237400510637939e-03 zone-cycles/wsec_step=8.51e+06 wsec_total=3.36e-01 wsec_step=3.08e-02 cycle=10 time=4.6031631068885803e-02 dt=4.5073506817405124e-03 zone-cycles/wsec_step=8.22e+06 wsec_total=3.68e-01 wsec_step=3.19e-02 cycle=11 time=5.0538981750626315e-02 dt=4.4939801471017265e-03 zone-cycles/wsec_step=1.26e+06 wsec_total=5.76e-01 wsec_step=2.08e-01 cycle=12 time=5.5032961897728043e-02 dt=4.4776615612851581e-03 zone-cycles/wsec_step=8.33e+06 wsec_total=6.07e-01 wsec_step=3.15e-02 cycle=13 time=5.9510623459013201e-02 dt=4.4588413770902139e-03 zone-cycles/wsec_step=8.72e+06 wsec_total=6.37e-01 wsec_step=3.01e-02 cycle=14 time=6.3969464836103412e-02 dt=4.4412086471860256e-03 zone-cycles/wsec_step=7.84e+06 wsec_total=6.71e-01 wsec_step=3.34e-02 cycle=15 time=6.8410673483289441e-02 dt=4.4240265524509255e-03 zone-cycles/wsec_step=8.96e+06 wsec_total=7.00e-01 wsec_step=2.93e-02 cycle=16 time=7.2834700035740371e-02 dt=4.4067011249979858e-03 zone-cycles/wsec_step=7.40e+06 wsec_total=7.35e-01 wsec_step=3.54e-02 cycle=17 time=7.7241401160738354e-02 dt=4.3857137773867022e-03 zone-cycles/wsec_step=7.48e+06 wsec_total=7.71e-01 wsec_step=3.50e-02 cycle=18 time=8.1627114938125050e-02 dt=4.3655668326488348e-03 zone-cycles/wsec_step=8.66e+06 wsec_total=8.01e-01 wsec_step=3.03e-02 cycle=19 time=8.5992681770773891e-02 dt=4.3450763048707031e-03 zone-cycles/wsec_step=8.39e+06 wsec_total=8.32e-01 wsec_step=3.13e-02 cycle=20 time=9.0337758075644592e-02 dt=4.3236974411924823e-03 zone-cycles/wsec_step=8.64e+06 wsec_total=8.62e-01 wsec_step=3.03e-02 cycle=21 time=9.4661455516837079e-02 dt=4.3029533533498147e-03 zone-cycles/wsec_step=8.33e+06 wsec_total=8.94e-01 wsec_step=3.15e-02 cycle=22 time=9.8964408870186898e-02 dt=4.2849535907396839e-03 zone-cycles/wsec_step=8.50e+06 wsec_total=9.25e-01 wsec_step=3.08e-02 cycle=23 time=1.0324936246092659e-01 dt=4.2685147059390244e-03 zone-cycles/wsec_step=1.28e+06 wsec_total=1.13e+00 wsec_step=2.05e-01 cycle=24 time=1.0751787716686562e-01 dt=4.2517412563356618e-03 zone-cycles/wsec_step=8.36e+06 wsec_total=1.16e+00 wsec_step=3.14e-02 cycle=25 time=1.1176961842320128e-01 dt=4.2343424771396536e-03 zone-cycles/wsec_step=8.86e+06 wsec_total=1.19e+00 wsec_step=2.96e-02 cycle=26 time=1.1600396090034093e-01 dt=4.2156621156818168e-03 zone-cycles/wsec_step=8.19e+06 wsec_total=1.22e+00 wsec_step=3.20e-02 cycle=27 time=1.2021962301602275e-01 dt=4.1978085715226165e-03 zone-cycles/wsec_step=8.35e+06 wsec_total=1.25e+00 wsec_step=3.14e-02 cycle=28 time=1.2441743158754537e-01 dt=4.1792295510571205e-03 zone-cycles/wsec_step=8.24e+06 wsec_total=1.29e+00 wsec_step=3.18e-02 cycle=29 time=1.2859666113860249e-01 dt=4.1620256904312848e-03 zone-cycles/wsec_step=8.43e+06 wsec_total=1.32e+00 wsec_step=3.11e-02 cycle=30 time=1.3275868682903377e-01 dt=4.1465725248014344e-03 zone-cycles/wsec_step=7.50e+06 wsec_total=1.35e+00 wsec_step=3.50e-02 cycle=31 time=1.3690525935383521e-01 dt=4.1328340718331420e-03 zone-cycles/wsec_step=8.86e+06 wsec_total=1.38e+00 wsec_step=2.96e-02 cycle=32 time=1.4103809342566836e-01 dt=4.1199352618365940e-03 zone-cycles/wsec_step=3.64e+06 wsec_total=1.45e+00 wsec_step=7.20e-02 cycle=33 time=1.4515802868750496e-01 dt=4.1062392363615434e-03 zone-cycles/wsec_step=9.12e+06 wsec_total=1.48e+00 wsec_step=2.87e-02 cycle=34 time=1.4926426792386652e-01 dt=7.3573207613347735e-04 zone-cycles/wsec_step=8.18e+06 wsec_total=1.51e+00 wsec_step=3.20e-02 cycle=35 time=1.4999999999999999e-01 dt=1.4714641522669547e-03 zone-cycles/wsec_step=1.28e+06 wsec_total=1.72e+00 wsec_step=2.04e-01 Driver completed. time=1.50e-01 cycle=35 tlim=1.50e-01 nlim=100000 walltime used = 1.72e+00 zone-cycles/wallsecond = 5.34e+06 ^C+ mkdir first_run + mv parthenon.out1.hst parthenon.prim.00000.phdf parthenon.prim.00000.phdf.xdmf parthenon.prim.00001.phdf parthenon.prim.00001.phdf.xdmf parthenon.prim.00002.phdf parthenon.prim.00002.phdf.xdmf parthenon.prim.final.phdf parthenon.prim.final.phdf.xdmf parthenon.restart.00000.rhdf parthenon.restart.00000.rhdf.xdmf parthenon.restart.00001.rhdf parthenon.restart.00001.rhdf.xdmf parthenon.restart.00002.rhdf parthenon.restart.00002.rhdf.xdmf parthenon.restart.final.rhdf parthenon.restart.final.rhdf.xdmf first_run + rm '*.csv' rm: cannot remove '*.csv': No such file or directory + mpirun -np 8 ./build/bin/athenaPK -r first_run/parthenon.restart.00000.rhdf Blocks assigned to rank 3: 3:3 Blocks assigned to rank 6: 6:6 Blocks assigned to rank 0: 0:0 Blocks assigned to rank 5: 5:5 Blocks assigned to rank 2: 2:2 Blocks assigned to rank 1: 1:1 Blocks assigned to rank 4: 4:4 Blocks assigned to rank 7: 7:7 Var: cons:9 Starting up hydro driver # Variables in use: # Package: parthenon::resolved_state # --------------------------------------------------- # Variables: # Name Metadata flags # --------------------------------------------------- turbulence_phases_k None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state turbulence_phases_j None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state acc Cell,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state turbulence_phases_i None,Provides,Real,Derived,OneCopy,Hydro,parthenon::resolved_state prim Cell,Provides,Real,Derived,Hydro,parthenon::resolved_state cons Cell,Provides,Real,Independent,FillGhost,WithFluxes,Hydro,parthenon::resolved_state bnd_flux::cons Face,Provides,Real,Derived,OneCopy,Flux,parthenon::resolved_state # --------------------------------------------------- # Sparse Variables: # Name sparse id Metadata flags # --------------------------------------------------- # --------------------------------------------------- # Swarms: # Swarm Value metadata # --------------------------------------------------- Setup complete, executing driver... cycle=0 time=0.0000000000000000e+00 dt=4.6870313203007836e-03 zone-cycles/wsec_step=0.00e+00 wsec_total=4.04e-02 wsec_step=1.20e-01 -------------- New Mesh structure after (de)refinement ------------- Number of Trees = 1 Total number of MeshBlocks = 8 Number of physical refinement levels = 0 Number of logical refinement levels = 1 Physical level = 0 (logical level = 1): 8 MeshBlocks, cost = 8 -------------------------------------------------------------------- cycle=1 time=4.6870313203007836e-03 dt=4.6624369596770087e-03 zone-cycles/wsec_step=9.25e+06 wsec_total=6.88e-02 wsec_step=2.83e-02 cycle=2 time=9.3494682799777924e-03 dt=4.6475826353307237e-03 zone-cycles/wsec_step=7.33e+06 wsec_total=1.05e-01 wsec_step=3.58e-02 cycle=3 time=1.3997050915308517e-02 dt=4.6304703306495427e-03 zone-cycles/wsec_step=9.70e+06 wsec_total=1.32e-01 wsec_step=2.70e-02 cycle=4 time=1.8627521245958061e-02 dt=4.6132081779462920e-03 zone-cycles/wsec_step=8.64e+06 wsec_total=1.62e-01 wsec_step=3.04e-02 cycle=5 time=2.3240729423904351e-02 dt=4.5971622706348228e-03 zone-cycles/wsec_step=7.54e+06 wsec_total=1.97e-01 wsec_step=3.48e-02 cycle=6 time=2.7837891694539173e-02 dt=4.5752638005413550e-03 zone-cycles/wsec_step=8.75e+06 wsec_total=2.27e-01 wsec_step=2.99e-02 cycle=7 time=3.2413155495080531e-02 dt=4.5559103547534209e-03 zone-cycles/wsec_step=9.27e+06 wsec_total=2.55e-01 wsec_step=2.83e-02 cycle=8 time=3.6969065849833949e-02 dt=4.5388251679880651e-03 zone-cycles/wsec_step=8.27e+06 wsec_total=2.87e-01 wsec_step=3.17e-02 cycle=9 time=4.1507891017822013e-02 dt=4.5237400510637939e-03 zone-cycles/wsec_step=7.71e+06 wsec_total=3.21e-01 wsec_step=3.40e-02 cycle=10 time=4.6031631068885803e-02 dt=4.5073506817405124e-03 zone-cycles/wsec_step=8.39e+06 wsec_total=3.52e-01 wsec_step=3.12e-02 cycle=11 time=5.0538981750626315e-02 dt=4.4939801471017265e-03 zone-cycles/wsec_step=8.62e+06 wsec_total=3.83e-01 wsec_step=3.04e-02 cycle=12 time=5.5032961897728043e-02 dt=4.4776615612851581e-03 zone-cycles/wsec_step=7.82e+06 wsec_total=4.16e-01 wsec_step=3.35e-02 cycle=13 time=5.9510623459013201e-02 dt=4.4588413770902139e-03 zone-cycles/wsec_step=8.65e+06 wsec_total=4.46e-01 wsec_step=3.03e-02 cycle=14 time=6.3969464836103412e-02 dt=4.4412086471860256e-03 zone-cycles/wsec_step=8.98e+06 wsec_total=4.76e-01 wsec_step=2.92e-02 cycle=15 time=6.8410673483289441e-02 dt=4.4240265524509255e-03 zone-cycles/wsec_step=9.18e+06 wsec_total=5.04e-01 wsec_step=2.86e-02 cycle=16 time=7.2834700035740371e-02 dt=4.4067011249979858e-03 zone-cycles/wsec_step=8.43e+06 wsec_total=5.35e-01 wsec_step=3.11e-02 cycle=17 time=7.7241401160738354e-02 dt=4.3857137773867022e-03 zone-cycles/wsec_step=8.60e+06 wsec_total=5.66e-01 wsec_step=3.05e-02 cycle=18 time=8.1627114938125050e-02 dt=4.3655668326488348e-03 zone-cycles/wsec_step=8.17e+06 wsec_total=5.98e-01 wsec_step=3.21e-02 cycle=19 time=8.5992681770773891e-02 dt=4.3450763048707031e-03 zone-cycles/wsec_step=9.75e+06 wsec_total=6.25e-01 wsec_step=2.69e-02 cycle=20 time=9.0337758075644592e-02 dt=4.3236974411924823e-03 zone-cycles/wsec_step=6.32e+06 wsec_total=6.66e-01 wsec_step=4.15e-02 cycle=21 time=9.4661455516837079e-02 dt=4.3029533533498147e-03 zone-cycles/wsec_step=6.10e+06 wsec_total=7.09e-01 wsec_step=4.30e-02 cycle=22 time=9.8964408870186898e-02 dt=4.2849535907396839e-03 zone-cycles/wsec_step=8.72e+06 wsec_total=7.40e-01 wsec_step=3.01e-02 cycle=23 time=1.0324936246092659e-01 dt=4.2685147059390244e-03 zone-cycles/wsec_step=1.27e+06 wsec_total=9.46e-01 wsec_step=2.06e-01 cycle=24 time=1.0751787716686562e-01 dt=4.2517412563356618e-03 zone-cycles/wsec_step=8.35e+06 wsec_total=9.77e-01 wsec_step=3.14e-02 cycle=25 time=1.1176961842320128e-01 dt=4.2343424771396536e-03 zone-cycles/wsec_step=8.27e+06 wsec_total=1.01e+00 wsec_step=3.17e-02 cycle=26 time=1.1600396090034093e-01 dt=4.2156621156818168e-03 zone-cycles/wsec_step=8.35e+06 wsec_total=1.04e+00 wsec_step=3.14e-02 cycle=27 time=1.2021962301602275e-01 dt=4.1978085715226165e-03 zone-cycles/wsec_step=7.62e+06 wsec_total=1.07e+00 wsec_step=3.44e-02 cycle=28 time=1.2441743158754537e-01 dt=4.1792295510571205e-03 zone-cycles/wsec_step=8.67e+06 wsec_total=1.11e+00 wsec_step=3.02e-02 cycle=29 time=1.2859666113860249e-01 dt=4.1620256904312848e-03 zone-cycles/wsec_step=8.27e+06 wsec_total=1.14e+00 wsec_step=3.17e-02 cycle=30 time=1.3275868682903377e-01 dt=4.1465725248014344e-03 zone-cycles/wsec_step=7.66e+06 wsec_total=1.17e+00 wsec_step=3.42e-02 cycle=31 time=1.3690525935383521e-01 dt=4.1328340718331420e-03 zone-cycles/wsec_step=8.39e+06 wsec_total=1.20e+00 wsec_step=3.12e-02 cycle=32 time=1.4103809342566836e-01 dt=4.1199352618365940e-03 zone-cycles/wsec_step=8.85e+06 wsec_total=1.23e+00 wsec_step=2.96e-02 cycle=33 time=1.4515802868750496e-01 dt=4.1062392363615434e-03 zone-cycles/wsec_step=8.35e+06 wsec_total=1.26e+00 wsec_step=3.14e-02 cycle=34 time=1.4926426792386652e-01 dt=7.3573207613347735e-04 zone-cycles/wsec_step=9.72e+06 wsec_total=1.29e+00 wsec_step=2.70e-02 cycle=35 time=1.4999999999999999e-01 dt=1.4714641522669547e-03 zone-cycles/wsec_step=1.32e+06 wsec_total=1.49e+00 wsec_step=1.99e-01 Driver completed. time=1.50e-01 cycle=35 tlim=1.50e-01 nlim=100000 walltime used = 1.49e+00 zone-cycles/wallsecond = 6.16e+06 ^C+ rm '*.csv' rm: cannot remove '*.csv': No such file or directory + h5diff first_run/parthenon.restart.00000.rhdf parthenon.restart.00001.rhdf attribute: > and > 1 differences found attribute: > and > 23468 differences found + h5diff first_run/parthenon.restart.00001.rhdf parthenon.restart.00002.rhdf attribute: > and > 1 differences found attribute: