Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unstable CI: Python_particle_attr_access[_unique] #2764

Closed
ax3l opened this issue Jan 20, 2022 · 0 comments · Fixed by #2766
Closed

Unstable CI: Python_particle_attr_access[_unique] #2764

ax3l opened this issue Jan 20, 2022 · 0 comments · Fixed by #2766
Assignees
@peterscherpelz @roelof-groenewald
Labels
component: Python Python layer component: tests Tests and CI

Comments

@ax3l
Copy link
Member

ax3l commented Jan 20, 2022

Finally, I tracked a fail of Python_particle_attr_access :)

2022-01-20T01:57:50.8288742Z �[1mworking on test: Python_particle_attr_access�[0m
2022-01-20T01:57:50.8289121Z    re-making clean...
2022-01-20T01:57:50.8289344Z    building...
2022-01-20T01:57:50.8289441Z 
2022-01-20T01:57:50.8289814Z �[1mconfiguring Python_particle_attr_access build...�[0m
2022-01-20T01:57:50.8290110Z    mkdir /tmp/ci/warpx/builddir
2022-01-20T01:57:50.8290710Z    cmake  -DAMReX_ASSERTIONS=ON -DAMReX_TESTING=ON -DWarpX_DIMS=2 -DWarpX_LIB=ON -DWarpX_APP=OFF -S /tmp/ci/warpx/ -B /tmp/ci/warpx/builddir 
2022-01-20T01:57:50.8290987Z 
2022-01-20T01:57:50.8291341Z �[1mbuilding Python_particle_attr_access...�[0m
2022-01-20T01:57:50.8291787Z    cmake --build /tmp/ci/warpx/builddir -j 2 --  install_pip
2022-01-20T01:57:50.8292091Z    Compilation time: 38.775 s
2022-01-20T01:57:50.8292604Z    run & test directory: /tmp/ci/rt-WarpX/WarpX-tests/2022-01-20/Python_particle_attr_access/
2022-01-20T01:57:50.8292961Z    copying files to run directory...
2022-01-20T01:57:50.8293282Z    path to input file: Examples/Tests/ParticleDataPython/PICMI_inputs_2d.py
2022-01-20T01:57:50.8293591Z    running the test...
2022-01-20T01:57:50.8293964Z    mpiexec -n 2 python3 PICMI_inputs_2d.py
2022-01-20T01:57:50.8294382Z �[33m   WARNING: Test stdout:�[0m
2022-01-20T01:57:50.8294654Z MPI initialized with 2 MPI processes
2022-01-20T01:57:50.8294931Z MPI initialized with thread support level 3
2022-01-20T01:57:50.8295191Z OMP initialized with 1 OMP threads
2022-01-20T01:57:50.8295588Z AMReX (22.01-29-g812836f08a75) initialized
2022-01-20T01:57:50.8295957Z WarpX (22.01-nogit)
2022-01-20T01:57:50.8296173Z PICSAR (7b5449f92a4b)
2022-01-20T01:57:50.8296606Z Level 0: dt = 7.5e-10 ; dx = 0.00046875 ; dz = 0.00046875
2022-01-20T01:57:50.8296766Z 
2022-01-20T01:57:50.8296953Z Grids Summary:
2022-01-20T01:57:50.8297217Z   Level 0   4 grids  4096 cells  100 % of domain
2022-01-20T01:57:50.8297538Z             smallest grid: 32 x 32  biggest grid: 32 x 32
2022-01-20T01:57:50.8297716Z 
2022-01-20T01:57:50.8297962Z   Writing plotfile ./Python_particle_attr_access_plt00000
2022-01-20T01:57:50.8298113Z 
2022-01-20T01:57:50.8298308Z STEP 1 starts ...
2022-01-20T01:57:50.8298408Z 
2022-01-20T01:57:50.8298486Z 
2022-01-20T01:57:50.8298747Z **** WARNINGS ******************************************************************
2022-01-20T01:57:50.8299082Z * GLOBAL warning list  after  [ FIRST STEP ]
2022-01-20T01:57:50.8299296Z *
2022-01-20T01:57:50.8299672Z * --> [!  ] [ElectrostaticSolver] [raised twice]
2022-01-20T01:57:50.8299929Z *     Max norm of rho is 0
2022-01-20T01:57:50.8300174Z *     @ Raised by: ALL
2022-01-20T01:57:50.8300370Z *
2022-01-20T01:57:50.8300709Z * --> [!  ] [Geometry] [raised twice]
2022-01-20T01:57:50.8301037Z *     geometry.coord_sys is ignored. Please use the new geometry.dims parameter.
2022-01-20T01:57:50.8301334Z *     @ Raised by: ALL
2022-01-20T01:57:50.8301544Z *
2022-01-20T01:57:50.8301806Z ********************************************************************************
2022-01-20T01:57:50.8301989Z 
2022-01-20T01:57:50.8302349Z STEP 1 ends. TIME = 7.5e-10 DT = 7.5e-10
2022-01-20T01:57:50.8302872Z Evolve time = 0.006112379 s; This step = 0.006112379 s; Avg. per step = 0.006112379 s
2022-01-20T01:57:50.8303100Z 
2022-01-20T01:57:50.8303306Z STEP 2 starts ...
2022-01-20T01:57:50.8303807Z STEP 2 ends. TIME = 1.5e-09 DT = 7.5e-10
2022-01-20T01:57:50.8304198Z Evolve time = 0.011394047 s; This step = 0.005281668 s; Avg. per step = 0.0056970235 s
2022-01-20T01:57:50.8304414Z 
2022-01-20T01:57:50.8304633Z STEP 3 starts ...
2022-01-20T01:57:50.8305095Z STEP 3 ends. TIME = 2.25e-09 DT = 7.5e-10
2022-01-20T01:57:50.8305474Z Evolve time = 0.01708462 s; This step = 0.005690573 s; Avg. per step = 0.005694873333 s
2022-01-20T01:57:50.8305704Z 
2022-01-20T01:57:50.8305910Z STEP 4 starts ...
2022-01-20T01:57:50.8306338Z STEP 4 ends. TIME = 3e-09 DT = 7.5e-10
2022-01-20T01:57:50.8306713Z Evolve time = 0.022683593 s; This step = 0.005598973 s; Avg. per step = 0.00567089825 s
2022-01-20T01:57:50.8307006Z 
2022-01-20T01:57:50.8307232Z STEP 5 starts ...
2022-01-20T01:57:50.8307667Z STEP 5 ends. TIME = 3.75e-09 DT = 7.5e-10
2022-01-20T01:57:50.8308061Z Evolve time = 0.028374566 s; This step = 0.005690973 s; Avg. per step = 0.0056749132 s
2022-01-20T01:57:50.8308277Z 
2022-01-20T01:57:50.8308484Z STEP 6 starts ...
2022-01-20T01:57:50.8308923Z STEP 6 ends. TIME = 4.5e-09 DT = 7.5e-10
2022-01-20T01:57:50.8309303Z Evolve time = 0.034569646 s; This step = 0.00619508 s; Avg. per step = 0.005761607667 s
2022-01-20T01:57:50.8309521Z 
2022-01-20T01:57:50.8309743Z STEP 7 starts ...
2022-01-20T01:57:50.8310166Z STEP 7 ends. TIME = 5.25e-09 DT = 7.5e-10
2022-01-20T01:57:50.8310561Z Evolve time = 0.040057917 s; This step = 0.005488271 s; Avg. per step = 0.005722559571 s
2022-01-20T01:57:50.8310781Z 
2022-01-20T01:57:50.8310986Z STEP 8 starts ...
2022-01-20T01:57:50.8311414Z STEP 8 ends. TIME = 6e-09 DT = 7.5e-10
2022-01-20T01:57:50.8311789Z Evolve time = 0.046073294 s; This step = 0.006015377 s; Avg. per step = 0.00575916175 s
2022-01-20T01:57:50.8312011Z 
2022-01-20T01:57:50.8312232Z STEP 9 starts ...
2022-01-20T01:57:50.8312651Z STEP 9 ends. TIME = 6.75e-09 DT = 7.5e-10
2022-01-20T01:57:50.8313048Z Evolve time = 0.051576365 s; This step = 0.005503071 s; Avg. per step = 0.005730707222 s
2022-01-20T01:57:50.8313443Z   Writing plotfile ./Python_particle_attr_access_plt00009
2022-01-20T01:57:50.8313718Z 
2022-01-20T01:57:50.8313811Z 
2022-01-20T01:57:50.8314114Z TinyProfiler total time across processes [min...avg...max]: 0.06583 ... 0.06596 ... 0.06608
2022-01-20T01:57:50.8314333Z 
2022-01-20T01:57:50.8314830Z -----------------------------------------------------------------------------------------------------
2022-01-20T01:57:50.8315254Z Name                                                  NCalls  Excl. Min  Excl. Avg  Excl. Max   Max %
2022-01-20T01:57:50.8315866Z -----------------------------------------------------------------------------------------------------
2022-01-20T01:57:50.8316504Z MLNodeTensorLaplacian::Fsmooth()                        2160    0.01103    0.01184    0.01266  19.15%
2022-01-20T01:57:50.8317017Z FabArray::ParallelCopy_finish()                          803   0.001269   0.004649   0.008029  12.15%
2022-01-20T01:57:50.8317683Z FillBoundary_nowait()                                   2378   0.005533   0.006353   0.007173  10.86%
2022-01-20T01:57:50.8318189Z VisMF::Write(FabArray)                                     2   0.001313   0.003831   0.006349   9.61%
2022-01-20T01:57:50.8318670Z FillBoundary_finish()                                   2378   0.002627   0.003176   0.003725   5.64%
2022-01-20T01:57:50.8319166Z numParticlesOutOfRange()                                  44  0.0001382   0.001692   0.003246   4.91%
2022-01-20T01:57:50.8319650Z MLNodeLinOp::applyBC()                                  2360   0.002817   0.002903   0.002989   4.52%
2022-01-20T01:57:50.8320153Z FabArray::ParallelCopy_nowait()                          803   0.002003   0.002422   0.002841   4.30%
2022-01-20T01:57:50.8320640Z warpx_py_beforestep                                        9   0.002009   0.002339   0.002668   4.04%
2022-01-20T01:57:50.8321131Z WriteMultiLevelPlotfile()                                  2   0.000209   0.001225   0.002241   3.39%
2022-01-20T01:57:50.8321607Z OverrideSync_nowait()                                    577   0.001881   0.002056   0.002232   3.38%
2022-01-20T01:57:50.8322198Z FabArray::setVal()                                      1147   0.001655   0.001857   0.002058   3.12%
2022-01-20T01:57:50.8322687Z ParticleContainer::RedistributeMPI()                      20  0.0001758   0.001113    0.00205   3.10%
2022-01-20T01:57:50.8323440Z FlushFormatPlotfile::WriteToFile()                         2   5.76e-05  0.0009778   0.001898   2.87%
2022-01-20T01:57:50.8323943Z MLNodeTensorLaplacian::Fapply()                          200   0.001317   0.001404   0.001491   2.26%
2022-01-20T01:57:50.8324448Z OverrideSync_finish()                                    577   0.001175   0.001297   0.001419   2.15%
2022-01-20T01:57:50.8325009Z WarpX::Evolve::step                                        9  0.0002181   0.000803   0.001388   2.10%
2022-01-20T01:57:50.8325510Z WriteBinaryParticleData()                                  2  0.0003158  0.0008338   0.001352   2.05%
2022-01-20T01:57:50.8325992Z FabArray::FillBoundary()                                2378  0.0009307   0.001002   0.001073   1.62%
2022-01-20T01:57:50.8326496Z WarpX::AddSpaceChargeFieldLabFrame                        10  0.0007831  0.0008417  0.0009003   1.36%
2022-01-20T01:57:50.8326986Z MLNodeTensorLaplacian::smooth()                          540  0.0006973  0.0007031  0.0007088   1.07%
2022-01-20T01:57:50.8327498Z MLNodeTensorLaplacian::interpolation()                   135  0.0006068   0.000645  0.0006832   1.03%
2022-01-20T01:57:50.8327987Z WarpX::InitData()                                          1  0.0004247  0.0005508  0.0006768   1.02%
2022-01-20T01:57:50.8328485Z FabArrayBase::getFB()                                   2438  0.0006087  0.0006186  0.0006284   0.95%
2022-01-20T01:57:50.8328979Z ParticleContainer::RedistributeCPU()                      20  0.0005531   0.000566  0.0005788   0.88%
2022-01-20T01:57:50.8329481Z MLCGSolver::bicgstab                                      13          0   0.000281   0.000562   0.85%
2022-01-20T01:57:50.8329972Z MLNodeTensorLaplacian::restriction()                     135  0.0004579  0.0005053  0.0005526   0.84%
2022-01-20T01:57:50.8330479Z MLMG::prepareForSolve()                                   10  0.0004627  0.0005001  0.0005374   0.81%
2022-01-20T01:57:50.8330977Z ablastr::particles::deposit_charge::Accumulate            68  0.0004275  0.0004277  0.0004278   0.65%
2022-01-20T01:57:50.8331485Z OwnerMask()                                               70  0.0003178  0.0003662  0.0004146   0.63%
2022-01-20T01:57:50.8331964Z MLLinOp::makeSubCommunicator()                            10  0.0003509  0.0003784  0.0004058   0.61%
2022-01-20T01:57:50.8332462Z Filter::ApplyStencil(MultiFab)                            10  0.0003854  0.0003888  0.0003922   0.59%
2022-01-20T01:57:50.8332951Z FabArrayBase::getCPC()                                   803  0.0003255  0.0003351  0.0003447   0.52%
2022-01-20T01:57:50.8333455Z FabArrayBase::FB::FB()                                    81  0.0001305  0.0002344  0.0003382   0.51%
2022-01-20T01:57:50.8333952Z MLNodeLinOp::buildMasks()                                 10  0.0002749   0.000298  0.0003211   0.49%
2022-01-20T01:57:50.8334691Z DistributionMapping::LeastUsedCPUs()                       1   1.25e-05  0.0001566  0.0003007   0.46%
2022-01-20T01:57:50.8335189Z WarpX::SyncRho()                                          10  0.0001762  0.0002262  0.0002762   0.42%
2022-01-20T01:57:50.8335686Z MLMG::ResNormInf()                                        37  0.0002409  0.0002503  0.0002596   0.39%
2022-01-20T01:57:50.8336166Z OverrideSync()                                           577  0.0002347  0.0002412  0.0002477   0.37%
2022-01-20T01:57:50.8336665Z FabArrayBase::CPC::define()                              102  0.0001188  0.0001831  0.0002474   0.37%
2022-01-20T01:57:50.8337162Z MultiFab::Xpay()                                         148  0.0001978  0.0002223  0.0002467   0.37%
2022-01-20T01:57:50.8337667Z MLNodeTensorLaplacian::define()                           10  0.0002029  0.0002236  0.0002442   0.37%
2022-01-20T01:57:50.8338224Z MLMG::addInterpCorrection()                              135  0.0001989  0.0002156  0.0002323   0.35%
2022-01-20T01:57:50.8338719Z MLMG::mgVcycle()                                          27  0.0001801  0.0001967  0.0002133   0.32%
2022-01-20T01:57:50.8339202Z FabArray::BuildMask()                                     60  0.0001653  0.0001827  0.0002001   0.30%
2022-01-20T01:57:50.8339701Z MLCGSolver::ParallelAllReduce                             57          0  0.0001001  0.0002001   0.30%
2022-01-20T01:57:50.8340187Z MLLinOp::defineGrids()                                    10    0.00017  0.0001727  0.0001753   0.27%
2022-01-20T01:57:50.8340771Z PhysicalParticleContainer::Evolve::GatherAndPush          68  0.0001247  0.0001299  0.0001351   0.20%
2022-01-20T01:57:50.8341271Z MLMG::computeResidual()                                   27  0.0001209   0.000123  0.0001251   0.19%
2022-01-20T01:57:50.8341764Z WarpX::PrintGlobalWarnings                                 1  0.0001078  0.0001163  0.0001247   0.19%
2022-01-20T01:57:50.8342522Z Diagnostics::FilterComputePackFlush()                     11   4.04e-05   8.12e-05   0.000122   0.18%
2022-01-20T01:57:50.8343156Z FabArray::ParallelCopy()                                 226    9.8e-05  0.0001046  0.0001111   0.17%
2022-01-20T01:57:50.8343580Z MLMG::oneIter()                                           27  0.0001021  0.0001064  0.0001107   0.17%
2022-01-20T01:57:50.8344202Z MLMG:computeResOfCorrection()                            135   8.49e-05  9.175e-05   9.86e-05   0.15%
2022-01-20T01:57:50.8344812Z MLMG::solve()                                             10   7.09e-05  8.445e-05    9.8e-05   0.15%
2022-01-20T01:57:50.8345445Z FabArray::setVal(val, thecmd, scomp, ncomp)               60   9.01e-05  9.355e-05    9.7e-05   0.15%
2022-01-20T01:57:50.8346295Z WarpXParticleContainer::DepositCharge                     10    8.9e-05  9.075e-05   9.25e-05   0.14%
2022-01-20T01:57:50.8347094Z PhysicalParticleContainer::Evolve()                        9   7.26e-05   8.01e-05   8.76e-05   0.13%
2022-01-20T01:57:50.8349487Z MultiFab::LinComb()                                       30          0   4.25e-05    8.5e-05   0.13%
2022-01-20T01:57:50.8350257Z CoarsenIO::Coarsen()                                       2   7.37e-05  7.445e-05   7.52e-05   0.11%
2022-01-20T01:57:50.8350969Z MultiFab::Dot()                                           30          0   3.69e-05   7.38e-05   0.11%
2022-01-20T01:57:50.8351691Z MultiFab::Multiply()                                      30          0   3.45e-05    6.9e-05   0.10%
2022-01-20T01:57:50.8352406Z MLMG::actualBottomSolve()                                 27      7e-06   3.12e-05   5.54e-05   0.08%
2022-01-20T01:57:50.8353132Z PhysicalParticleContainer::PushP()                         2   4.71e-05  4.805e-05    4.9e-05   0.07%
2022-01-20T01:57:50.8353866Z MLMG::computeMLResidual()                                 10   4.79e-05    4.8e-05   4.81e-05   0.07%
2022-01-20T01:57:50.8354581Z MLMG::mgVcycle_up::2                                      27   1.68e-05    3.2e-05   4.72e-05   0.07%
2022-01-20T01:57:50.8355321Z ParticleContainer::WriteParticles()                        1   3.79e-05   4.25e-05   4.71e-05   0.07%
2022-01-20T01:57:50.8356035Z MLMG::MLRhsNormInf()                                      10   4.54e-05  4.555e-05   4.57e-05   0.07%
2022-01-20T01:57:50.8356765Z WarpXParticleContainer::ApplyBoundaryConditions()          9    3.9e-05   4.02e-05   4.14e-05   0.06%
2022-01-20T01:57:50.8357690Z ParticleContainer::addParticles                            2   3.54e-05  3.625e-05   3.71e-05   0.06%
2022-01-20T01:57:50.8358446Z MLMG::mgVcycle_down::0                                    27   3.43e-05   3.47e-05   3.51e-05   0.05%
2022-01-20T01:57:50.8359167Z FabArray::mult()                                          10   3.01e-05   3.06e-05   3.11e-05   0.05%
2022-01-20T01:57:50.8362720Z MLMG::mgVcycle_down::1                                    27   2.72e-05    2.8e-05   2.88e-05   0.04%
2022-01-20T01:57:50.8363673Z MLMG::mgVcycle_down::2                                    27   2.54e-05   2.65e-05   2.76e-05   0.04%
2022-01-20T01:57:50.8364469Z MultiFab::Copy()                                          10   2.68e-05   2.72e-05   2.76e-05   0.04%
2022-01-20T01:57:50.8365241Z CGSolver::sxay()                                          30          0    1.3e-05    2.6e-05   0.04%
2022-01-20T01:57:50.8366029Z MLMG::mgVcycle_down::4                                    27   2.35e-05   2.42e-05   2.49e-05   0.04%
2022-01-20T01:57:50.8366794Z makeSFC                                                   40   2.36e-05   2.42e-05   2.48e-05   0.04%
2022-01-20T01:57:50.8367579Z MLMG::mgVcycle_down::3                                    27   2.23e-05  2.335e-05   2.44e-05   0.04%
2022-01-20T01:57:50.8368454Z MLLinOp::define()                                         10   2.24e-05  2.315e-05   2.39e-05   0.04%
2022-01-20T01:57:50.8369246Z MLMG::mgVcycle_up::4                                      27   2.02e-05  2.145e-05   2.27e-05   0.03%
2022-01-20T01:57:50.8370016Z RedistributeMPI_locate                                     8   1.39e-05  1.755e-05   2.12e-05   0.03%
2022-01-20T01:57:50.8370804Z PhysicalParticleContainer::ConvertUnits()                  4   1.89e-05  1.985e-05   2.08e-05   0.03%
2022-01-20T01:57:50.8371582Z MLMG::mgVcycle_up::0                                      27   1.95e-05   2.01e-05   2.07e-05   0.03%
2022-01-20T01:57:50.8372372Z MLMG::mgVcycle_up::1                                      27   1.89e-05  1.945e-05      2e-05   0.03%
2022-01-20T01:57:50.8373159Z ablastr::particles::deposit_charge::ChargeDeposition      68   1.84e-05  1.915e-05   1.99e-05   0.03%
2022-01-20T01:57:50.8373970Z MLMG::mgVcycle_up::3                                      27   1.71e-05   1.76e-05   1.81e-05   0.03%
2022-01-20T01:57:50.8374738Z MLLinOp::makeAgglomeratedDMap                             10    1.6e-05   1.61e-05   1.62e-05   0.02%
2022-01-20T01:57:50.8375519Z WarpX::ComputeSpaceChargeField                            10   1.36e-05   1.42e-05   1.48e-05   0.02%
2022-01-20T01:57:50.8376295Z DistributionMapping::Distribute()                         41   1.36e-05  1.405e-05   1.45e-05   0.02%
2022-01-20T01:57:50.8377082Z MLMG::mgVcycle_bottom                                     27   1.25e-05  1.325e-05    1.4e-05   0.02%
2022-01-20T01:57:50.8377836Z RedistributeMPI_copy                                       8   1.22e-05   1.22e-05   1.22e-05   0.02%
2022-01-20T01:57:50.8378626Z WarpX::ComputeSpaceChargeField::reset_fields               9   1.07e-05  1.125e-05   1.18e-05   0.02%
2022-01-20T01:57:50.8379410Z ParticleContainer::OK()                                   22      1e-05  1.055e-05   1.11e-05   0.02%
2022-01-20T01:57:50.8380203Z WarpX::Evolve()                                            1    4.6e-06   6.65e-06    8.7e-06   0.01%
2022-01-20T01:57:50.8381083Z WarpX::UpdateAuxilaryData()                               13    7.6e-06    7.8e-06      8e-06   0.01%
2022-01-20T01:57:50.8381721Z MLNodeTensorLaplacian::prepareForSolve()                  10    7.2e-06   7.35e-06    7.5e-06   0.01%
2022-01-20T01:57:50.8382347Z WarpX::RecordWarning                                       2    5.1e-06   5.85e-06  6.601e-06   0.01%
2022-01-20T01:57:50.8382982Z DistributionMapping::SFCProcessorMapDoIt()                 1    4.3e-06    5.1e-06    5.9e-06   0.01%
2022-01-20T01:57:50.8383606Z WarpXCommUtil::FillBoundary                               18    5.7e-06   5.75e-06    5.8e-06   0.01%
2022-01-20T01:57:50.8384241Z MLMG::buildFineMask()                                     10    5.3e-06   5.45e-06    5.6e-06   0.01%
2022-01-20T01:57:50.8384862Z MultiParticleContainer::doQedEvents()                      9    5.4e-06   5.45e-06    5.5e-06   0.01%
2022-01-20T01:57:50.8385509Z MultiParticleContainer::doFieldIonization()                9    3.9e-06    4.6e-06    5.3e-06   0.01%
2022-01-20T01:57:50.8386128Z MLMG::MLResNormInf()                                      10    4.6e-06   4.85e-06    5.1e-06   0.01%
2022-01-20T01:57:50.8386766Z MultiParticleContainer::doCollisions()                     9    3.4e-06   3.85e-06    4.3e-06   0.01%
2022-01-20T01:57:50.8387465Z MultiParticleContainer::doQedBreitWheeler()                9    3.5e-06    3.9e-06    4.3e-06   0.01%
2022-01-20T01:57:50.8388109Z MultiParticleContainer::doQedQuantumSync()                 9    2.7e-06   2.85e-06      3e-06   0.00%
2022-01-20T01:57:50.8388736Z ParticleContainer::copyParticles                           2    1.9e-06   2.25e-06    2.6e-06   0.00%
2022-01-20T01:57:50.8389377Z MultiParticleContainer::doQEDSchwinger()                   9    2.1e-06   2.25e-06    2.4e-06   0.00%
2022-01-20T01:57:50.8390001Z ParticleContainer::WritePlotFile()                         2    2.2e-06    2.2e-06    2.2e-06   0.00%
2022-01-20T01:57:50.8390708Z PhysicalParticleContainer::AddParticles()                  2      1e-06    1.1e-06    1.2e-06   0.00%
2022-01-20T01:57:50.8391331Z BilinearFilter::ComputeStencils()                          1      1e-06    1.1e-06    1.2e-06   0.00%
2022-01-20T01:57:50.8392079Z ParticleContainer::clearParticles()                        2      9e-07      1e-06    1.1e-06   0.00%
2022-01-20T01:57:50.8392606Z -----------------------------------------------------------------------------------------------------
2022-01-20T01:57:50.8392799Z 
2022-01-20T01:57:50.8393202Z -----------------------------------------------------------------------------------------------------
2022-01-20T01:57:50.8393563Z Name                                                  NCalls  Incl. Min  Incl. Avg  Incl. Max   Max %
2022-01-20T01:57:50.8394083Z -----------------------------------------------------------------------------------------------------
2022-01-20T01:57:50.8394448Z WarpX::Evolve()                                            1    0.05692    0.05698    0.05705  86.33%
2022-01-20T01:57:50.8397680Z WarpX::Evolve::step                                        9    0.05254    0.05315    0.05376  81.36%
2022-01-20T01:57:50.8398066Z WarpX::ComputeSpaceChargeField                            10    0.04867     0.0487    0.04872  73.73%
2022-01-20T01:57:50.8398467Z WarpX::AddSpaceChargeFieldLabFrame                        10    0.04851    0.04853    0.04855  73.47%
2022-01-20T01:57:50.8398836Z MLMG::solve()                                             10    0.04409     0.0442    0.04431  67.05%
2022-01-20T01:57:50.8399216Z MLMG::oneIter()                                           27    0.04072    0.04073    0.04073  61.65%
2022-01-20T01:57:50.8399579Z MLMG::mgVcycle()                                          27    0.04004    0.04005    0.04005  60.62%
2022-01-20T01:57:50.8400676Z MLNodeTensorLaplacian::smooth()                          540    0.02866    0.03064    0.03261  49.35%
2022-01-20T01:57:50.8401068Z MLNodeLinOp::applyBC()                                  2360    0.01321    0.01381    0.01441  21.81%
2022-01-20T01:57:50.8401460Z MLNodeTensorLaplacian::Fsmooth()                        2160    0.01103    0.01184    0.01266  19.15%
2022-01-20T01:57:50.8401832Z FabArray::FillBoundary()                                2378    0.01085    0.01127    0.01169  17.69%
2022-01-20T01:57:50.8402221Z MLMG::mgVcycle_up::1                                      27   0.005134   0.008303    0.01147  17.36%
2022-01-20T01:57:50.8402594Z Diagnostics::FilterComputePackFlush()                     11   0.007661   0.008985    0.01031  15.60%
2022-01-20T01:57:50.8402983Z FlushFormatPlotfile::WriteToFile()                         2   0.007161   0.008544   0.009926  15.02%
2022-01-20T01:57:50.8403360Z MLMG::mgVcycle_down::0                                    27   0.008283   0.008285   0.008288  12.54%
2022-01-20T01:57:50.8403744Z OverrideSync()                                           577   0.007003   0.007554   0.008105  12.27%
2022-01-20T01:57:50.8404113Z FabArray::ParallelCopy_finish()                          803   0.001269   0.004649   0.008029  12.15%
2022-01-20T01:57:50.8404491Z FillBoundary_nowait()                                   2378   0.006199   0.007093   0.007987  12.09%
2022-01-20T01:57:50.8404856Z MLMG::mgVcycle_up::0                                      27   0.007636   0.007642   0.007648  11.57%
2022-01-20T01:57:50.8405375Z FabArray::ParallelCopy()                                 226   0.001472   0.004554   0.007636  11.56%
2022-01-20T01:57:50.8405741Z MLMG::addInterpCorrection()                              135   0.001499   0.004543   0.007586  11.48%
2022-01-20T01:57:50.8406124Z WarpX::InitData()                                          1   0.006402   0.006972   0.007542  11.41%
2022-01-20T01:57:50.8406484Z WriteMultiLevelPlotfile()                                  2   0.003554   0.005056   0.006558   9.92%
2022-01-20T01:57:50.8406860Z VisMF::Write(FabArray)                                     2   0.001313   0.003831   0.006349   9.61%
2022-01-20T01:57:50.8407282Z OverrideSync_nowait()                                    577   0.004536   0.005028    0.00552   8.35%
2022-01-20T01:57:50.8407656Z warpx_py_beforestep                                        9   0.002577   0.003856   0.005135   7.77%
2022-01-20T01:57:50.8408021Z MLMG::mgVcycle_down::1                                    27   0.005085   0.005106   0.005128   7.76%
2022-01-20T01:57:50.8408405Z FillBoundary_finish()                                   2378   0.002627   0.003176   0.003725   5.64%
2022-01-20T01:57:50.8408770Z ParticleContainer::WritePlotFile()                         2   0.001412   0.002451    0.00349   5.28%
2022-01-20T01:57:50.8409147Z WriteBinaryParticleData()                                  2   0.001409   0.002449   0.003488   5.28%
2022-01-20T01:57:50.8409506Z FabArray::ParallelCopy_nowait()                          803   0.002447    0.00294   0.003433   5.19%
2022-01-20T01:57:50.8409889Z ParticleContainer::OK()                                   22  0.0001493   0.001703   0.003256   4.93%
2022-01-20T01:57:50.8410261Z numParticlesOutOfRange()                                  44  0.0001382   0.001692   0.003246   4.91%
2022-01-20T01:57:50.8410640Z MLMG::mgVcycle_down::2                                    27   0.001344   0.002071   0.002797   4.23%
2022-01-20T01:57:50.8411017Z ParticleContainer::RedistributeCPU()                      20  0.0008918   0.001839   0.002785   4.22%
2022-01-20T01:57:50.8411397Z OverrideSync_finish()                                    577   0.002233   0.002285   0.002337   3.54%
2022-01-20T01:57:50.8411764Z MLMG::mgVcycle_up::2                                      27   0.001114   0.001618   0.002122   3.21%
2022-01-20T01:57:50.8412151Z ParticleContainer::RedistributeMPI()                      20  0.0002092   0.001142   0.002076   3.14%
2022-01-20T01:57:50.8412518Z FabArray::setVal()                                      1147   0.001655   0.001857   0.002058   3.12%
2022-01-20T01:57:50.8412900Z MLMG::mgVcycle_down::3                                    27   0.001312   0.001629   0.001947   2.95%
2022-01-20T01:57:50.8413272Z MLMG:computeResOfCorrection()                            135   0.001656    0.00177   0.001884   2.85%
2022-01-20T01:57:50.8413653Z MLMG::mgVcycle_down::4                                    27   0.001285   0.001562    0.00184   2.78%
2022-01-20T01:57:50.8414029Z MLNodeTensorLaplacian::restriction()                     135   0.001456   0.001644   0.001832   2.77%
2022-01-20T01:57:50.8414415Z MLMG::mgVcycle_up::3                                      27   0.001121   0.001456   0.001791   2.71%
2022-01-20T01:57:50.8414782Z MLMG::prepareForSolve()                                   10    0.00142   0.001559   0.001698   2.57%
2022-01-20T01:57:50.8415158Z WarpX::SyncRho()                                          10   0.001513   0.001603   0.001694   2.56%
2022-01-20T01:57:50.8415526Z MLMG::mgVcycle_up::4                                      27   0.001142   0.001396    0.00165   2.50%
2022-01-20T01:57:50.8416191Z MLMG::mgVcycle_bottom                                     27   1.95e-05  0.0007837   0.001548   2.34%
2022-01-20T01:57:50.8416723Z MLMG::actualBottomSolve()                                 27      7e-06  0.0007704   0.001534   2.32%
2022-01-20T01:57:50.8417110Z MLNodeTensorLaplacian::Fapply()                          200   0.001317   0.001404   0.001491   2.26%
2022-01-20T01:57:50.8417540Z MLCGSolver::bicgstab                                      13          0  0.0007143   0.001429   2.16%
2022-01-20T01:57:50.8417924Z MLNodeTensorLaplacian::define()                           10   0.001124   0.001236   0.001349   2.04%
2022-01-20T01:57:50.8418295Z FabArrayBase::getFB()                                   2438  0.0007392  0.0008529  0.0009666   1.46%
2022-01-20T01:57:50.8418677Z MLMG::computeMLResidual()                                 10  0.0004118  0.0006474  0.0008829   1.34%
2022-01-20T01:57:50.8419040Z MLMG::computeResidual()                                   27  0.0008741  0.0008781   0.000882   1.33%
2022-01-20T01:57:50.8419474Z MLNodeTensorLaplacian::prepareForSolve()                  10  0.0006107  0.0006943  0.0007778   1.18%
2022-01-20T01:57:50.8419847Z MLNodeLinOp::buildMasks()                                 10  0.0006032  0.0006869  0.0007706   1.17%
2022-01-20T01:57:50.8420231Z MLNodeTensorLaplacian::interpolation()                   135  0.0006068   0.000645  0.0006832   1.03%
2022-01-20T01:57:50.8420606Z MLLinOp::define()                                         10   0.000598  0.0006274  0.0006568   0.99%
2022-01-20T01:57:50.8420986Z MLLinOp::defineGrids()                                    10  0.0005741  0.0006043  0.0006344   0.96%
2022-01-20T01:57:50.8421353Z FabArrayBase::getCPC()                                   803  0.0004443  0.0005182  0.0005921   0.90%
2022-01-20T01:57:50.8421739Z WarpXParticleContainer::DepositCharge                     10  0.0005352  0.0005376  0.0005399   0.82%
2022-01-20T01:57:50.8422112Z WarpXCommUtil::FillBoundary                               18  0.0002681  0.0003677  0.0004673   0.71%
2022-01-20T01:57:50.8422495Z FabArray::BuildMask()                                     60  0.0003283  0.0003889  0.0004495   0.68%
2022-01-20T01:57:50.8422872Z ablastr::particles::deposit_charge::Accumulate            68  0.0004275  0.0004277  0.0004278   0.65%
2022-01-20T01:57:50.8423259Z OwnerMask()                                               70  0.0003178  0.0003662  0.0004146   0.63%
2022-01-20T01:57:50.8423626Z MLLinOp::makeSubCommunicator()                            10  0.0003509  0.0003784  0.0004058   0.61%
2022-01-20T01:57:50.8424005Z Filter::ApplyStencil(MultiFab)                            10  0.0003854  0.0003888  0.0003922   0.59%
2022-01-20T01:57:50.8424372Z FabArrayBase::FB::FB()                                    81  0.0001305  0.0002344  0.0003382   0.51%
2022-01-20T01:57:50.8424754Z MLCGSolver::ParallelAllReduce                             57          0  0.0001652  0.0003303   0.50%
2022-01-20T01:57:50.8425301Z DistributionMapping::SFCProcessorMapDoIt()                 1   1.79e-05  0.0001628  0.0003077   0.47%
2022-01-20T01:57:50.8425861Z DistributionMapping::LeastUsedCPUs()                       1   1.25e-05  0.0001566  0.0003007   0.46%
2022-01-20T01:57:50.8426233Z MLMG::ResNormInf()                                        37  0.0002409  0.0002503  0.0002596   0.39%
2022-01-20T01:57:50.8426619Z FabArrayBase::CPC::define()                              102  0.0001188  0.0001831  0.0002474   0.37%
2022-01-20T01:57:50.8426988Z MultiFab::Xpay()                                         148  0.0001978  0.0002223  0.0002467   0.37%
2022-01-20T01:57:50.8427372Z PhysicalParticleContainer::Evolve()                        9  0.0002077    0.00021  0.0002123   0.32%
2022-01-20T01:57:50.8427753Z WarpX::ComputeSpaceChargeField::reset_fields               9  0.0001477  0.0001488  0.0001498   0.23%
2022-01-20T01:57:50.8428153Z PhysicalParticleContainer::Evolve::GatherAndPush          68  0.0001247  0.0001299  0.0001351   0.20%
2022-01-20T01:57:50.8428527Z WarpX::PrintGlobalWarnings                                 1  0.0001078  0.0001163  0.0001247   0.19%
2022-01-20T01:57:50.8429072Z CGSolver::sxay()                                          30          0   5.55e-05   0.000111   0.17%
2022-01-20T01:57:50.8429608Z FabArray::setVal(val, thecmd, scomp, ncomp)               60   9.01e-05  9.355e-05    9.7e-05   0.15%
2022-01-20T01:57:50.8430474Z MultiFab::LinComb()                                       30          0   4.25e-05    8.5e-05   0.13%
2022-01-20T01:57:50.8431089Z CoarsenIO::Coarsen()                                       2   7.37e-05  7.445e-05   7.52e-05   0.11%
2022-01-20T01:57:50.8431716Z MultiFab::Dot()                                           30          0   3.69e-05   7.38e-05   0.11%
2022-01-20T01:57:50.8432329Z MultiFab::Multiply()                                      30          0   3.45e-05    6.9e-05   0.10%
2022-01-20T01:57:50.8432956Z MLMG::MLResNormInf()                                      10   5.36e-05   5.38e-05    5.4e-05   0.08%
2022-01-20T01:57:50.8433572Z MLLinOp::makeAgglomeratedDMap                             10   5.32e-05  5.325e-05   5.33e-05   0.08%
2022-01-20T01:57:50.8434284Z PhysicalParticleContainer::PushP()                         2   4.71e-05  4.805e-05    4.9e-05   0.07%
2022-01-20T01:57:50.8434912Z ParticleContainer::WriteParticles()                        1   3.79e-05   4.25e-05   4.71e-05   0.07%
2022-01-20T01:57:50.8435549Z MLMG::MLRhsNormInf()                                      10   4.54e-05  4.555e-05   4.57e-05   0.07%
2022-01-20T01:57:50.8436169Z WarpXParticleContainer::ApplyBoundaryConditions()          9    3.9e-05   4.02e-05   4.14e-05   0.06%
2022-01-20T01:57:50.8436810Z ParticleContainer::copyParticles                           2   3.82e-05   3.95e-05   4.08e-05   0.06%
2022-01-20T01:57:50.8437538Z makeSFC                                                   40    3.7e-05  3.715e-05   3.73e-05   0.06%
2022-01-20T01:57:50.8438862Z ParticleContainer::addParticles                            2   3.54e-05  3.625e-05   3.71e-05   0.06%
2022-01-20T01:57:50.8439491Z FabArray::mult()                                          10   3.01e-05   3.06e-05   3.11e-05   0.05%
2022-01-20T01:57:50.8440122Z MultiFab::Copy()                                          10   2.68e-05   2.72e-05   2.76e-05   0.04%
2022-01-20T01:57:50.8440731Z RedistributeMPI_locate                                     8   1.39e-05  1.755e-05   2.12e-05   0.03%
2022-01-20T01:57:50.8441369Z PhysicalParticleContainer::ConvertUnits()                  4   1.89e-05  1.985e-05   2.08e-05   0.03%
2022-01-20T01:57:50.8442006Z ablastr::particles::deposit_charge::ChargeDeposition      68   1.84e-05  1.915e-05   1.99e-05   0.03%
2022-01-20T01:57:50.8442659Z DistributionMapping::Distribute()                         41   1.36e-05  1.405e-05   1.45e-05   0.02%
2022-01-20T01:57:50.8443284Z MultiParticleContainer::doQedEvents()                      9   1.17e-05   1.22e-05   1.27e-05   0.02%
2022-01-20T01:57:50.8443916Z RedistributeMPI_copy                                       8   1.22e-05   1.22e-05   1.22e-05   0.02%
2022-01-20T01:57:50.8444568Z WarpX::UpdateAuxilaryData()                               13    7.6e-06    7.8e-06      8e-06   0.01%
2022-01-20T01:57:50.8445115Z WarpX::RecordWarning                                       2    5.1e-06   5.85e-06  6.601e-06   0.01%
2022-01-20T01:57:50.8445642Z MLMG::buildFineMask()                                     10    5.3e-06   5.45e-06    5.6e-06   0.01%
2022-01-20T01:57:50.8446192Z MultiParticleContainer::doFieldIonization()                9    3.9e-06    4.6e-06    5.3e-06   0.01%
2022-01-20T01:57:50.8446730Z MultiParticleContainer::doCollisions()                     9    3.4e-06   3.85e-06    4.3e-06   0.01%
2022-01-20T01:57:50.8447281Z MultiParticleContainer::doQedBreitWheeler()                9    3.5e-06    3.9e-06    4.3e-06   0.01%
2022-01-20T01:57:50.8447820Z MultiParticleContainer::doQedQuantumSync()                 9    2.7e-06   2.85e-06      3e-06   0.00%
2022-01-20T01:57:50.8448372Z MultiParticleContainer::doQEDSchwinger()                   9    2.1e-06   2.25e-06    2.4e-06   0.00%
2022-01-20T01:57:50.8448917Z PhysicalParticleContainer::AddParticles()                  2      1e-06    1.1e-06    1.2e-06   0.00%
2022-01-20T01:57:50.8449466Z BilinearFilter::ComputeStencils()                          1      1e-06    1.1e-06    1.2e-06   0.00%
2022-01-20T01:57:50.8450001Z ParticleContainer::clearParticles()                        2      9e-07      1e-06    1.1e-06   0.00%
2022-01-20T01:57:50.8450621Z -----------------------------------------------------------------------------------------------------
2022-01-20T01:57:50.8450800Z 
2022-01-20T01:57:50.8451103Z AMReX (22.01-29-g812836f08a75) finalized
2022-01-20T02:02:15.5103717Z 
2022-01-20T02:02:15.5106231Z �[33m   WARNING: Test stderr:�[0m
2022-01-20T02:02:15.5107390Z Traceback (most recent call last):
2022-01-20T02:02:15.5108471Z   File "PICMI_inputs_2d.py", line 143, in <module>
2022-01-20T02:02:15.5110087Z     assert (sim.extension.get_particle_count('electrons') == 270 / (2 - args.unique))
2022-01-20T02:02:15.5112980Z AssertionError
2022-01-20T02:02:15.5113893Z Traceback (most recent call last):
2022-01-20T02:02:15.5114799Z   File "PICMI_inputs_2d.py", line 143, in <module>
2022-01-20T02:02:15.5116389Z     assert (sim.extension.get_particle_count('electrons') == 270 / (2 - args.unique))
2022-01-20T02:02:15.5117638Z AssertionError
2022-01-20T02:02:15.5119075Z --------------------------------------------------------------------------
2022-01-20T02:02:15.5120079Z Primary job  terminated normally, but 1 process returned
2022-01-20T02:02:15.5121417Z a non-zero exit code. Per user-direction, the job has been aborted.
2022-01-20T02:02:15.5122822Z --------------------------------------------------------------------------
2022-01-20T02:02:15.5124255Z --------------------------------------------------------------------------
2022-01-20T02:02:15.5125734Z mpiexec detected that one or more processes exited with non-zero status, thus causing
2022-01-20T02:02:15.5126848Z the job to be terminated. The first process to do so was:
2022-01-20T02:02:15.5127478Z 
2022-01-20T02:02:15.5128173Z   Process name: [[18184,1],1]
2022-01-20T02:02:15.5128941Z   Exit code:    1
2022-01-20T02:02:15.5130179Z --------------------------------------------------------------------------
2022-01-20T02:02:15.5130830Z 
2022-01-20T02:02:15.5131512Z    Execution time: 1.610 s
2022-01-20T02:02:15.5132294Z    archiving the output...
2022-01-20T02:02:15.5133053Z    creating problem test report ...
2022-01-20T02:02:15.5134237Z    �[31mPython_particle_attr_access FAILED�[0m

It looks like sim.extension.get_particle_count('electrons') is not stable?
I think that's from using RNGs, e.g., I see np.random.rand being used.

Same applies likely to Python_particle_attr_access_unique.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@peterscherpelz peterscherpelz

@roelof-groenewald roelof-groenewald

Labels
component: Python Python layer component: tests Tests and CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix unstable Python_particle_attr_access CI tests ModernElectron/WarpX
3 participants
@ax3l @peterscherpelz @roelof-groenewald