Skip to content
Scott Pakin edited this page Feb 2, 2017 · 2 revisions

Instrumentation example: SNAP

SNAP is a proxy application that models the performance of a modern, discrete ordinates, neutral particle transport application. In this example, we ran code with a single MPI rank and a single OpenMP thread. SNAP was compiled with most of Byfl's options enabled, which introduced a slowdown of 975x (from 19 seconds to 18509 seconds of execution time).

The complete results of instrumenting SNAP with Byfl are available online (and can be downloaded easily). The following is a transcript of program execution, showing the SNAP output followed by the subset of Byfl output that gets produced in textual format:

$ cat ../runs/snap/static-nofix/in
! Input from namelist
&invar
  nthreads=1
  npey=1
  npez=1
  ndimen=3
  nx=32
  lx=3.2
  ny=16
  ly=1.6
  nz=16
  lz=1.6
  ichunk=8
  nmom=1
  nang=32
  ng=30
  mat_opt=1
  src_opt=1
  timedep=0
  it_det=0
  tf=1.0
  nsteps=10
  iitm=5
  oitm=5
  epsi=1.E-14
  fluxp=0
  scatp=0
  fixup=0
/
$ ./snap ../runs/snap/static-nofix/in /tmp/out
BYFL_INFO: Byfl command line: -bf-unique-bytes -bf-vectors -bf-every-bb -bf-merge-bb=10000000 -bf-mem-footprint -bf-types -bf-inst-mix -bf-by-func -bf-data-structs -bf-inst-deps -bf-strides
  Static calc: v(g) not set. Use dummy value of 1.
  Particle spectrum, cycle (time)   1 (  1.0000E+00 )
           1 8.038476E-01
           2 7.330980E-01
           3 7.190578E-01
           4 7.111453E-01
           5 7.063941E-01
           6 7.036439E-01
           7 7.023338E-01
           8 7.021598E-01
           9 7.029484E-01
          10 7.046009E-01
          11 7.070663E-01
          12 7.103275E-01
          13 7.143946E-01
          14 7.193013E-01
          15 7.251050E-01
          16 7.318887E-01
          17 7.397650E-01
          18 7.488836E-01
          19 7.594420E-01
          20 7.717026E-01
          21 7.860189E-01
          22 8.028772E-01
          23 8.229666E-01
          24 8.473006E-01
          25 8.774466E-01
          26 9.159956E-01
          27 9.676470E-01
          28 1.042191E+00
          29 1.165303E+00
          30 1.915647E+00

 Oh SNAP. That did not converge. But take a look at the Timing Summary anyway!
BYFL_FUNC_HEADER:             LD_bytes             ST_bytes               LD_ops               ST_ops                Flops              FP_bits              Int_ops          Int_op_bits           Uniq_bytes             Cond_brs          Invocations Function
BYFL_FUNC:                     3933020              1967496               368781               123139               983040            188743680              2433043            583272522              3932656               409176                    1 __analyze_module_MOD_pop_calc
BYFL_FUNC:                          20                  356                    3                   29                    0                    0                  106                13983                  356                   24                    1 __control_module_MOD_control_alloc
BYFL_FUNC:                          16                   16                    2                    2                    0                    0                    4                    4                   16                    2                    1 __control_module_MOD_control_dealloc
BYFL_FUNC:                         244                33612                   36                 2144                    0                    0                91425             14166785                33624                21512                    1 __data_module_MOD_data_allocate
BYFL_FUNC:                          72                   72                    9                    9                    0                    0                   18                   18                   72                    9                    1 __data_module_MOD_data_deallocate
BYFL_FUNC:                           4                    0                    1                    0                    0                    0                    5                   68                    4                    2                    1 __dealloc_module_MOD_dealloc_input
BYFL_FUNC:                           4                    0                    1                    0                    0                    0                    5                   68                    4                    2                    1 __dealloc_module_MOD_dealloc_solve
BYFL_FUNC:                     1056000             23520000               264000              2952000                    0                    0             60624000           9446040000                 1024             11232000                24000 __dim3_sweep_module_MOD_dim3_sweep
BYFL_FUNC:                292762752000          78016512000          25601832000           5180928000          32027136000        5822816256000         125812296000       24989013360000             75107940          12076872000                24000 __dim3_sweep_module_MOD_dim3_sweep._omp_fn.0
BYFL_FUNC:                   457169400            304742400             76199550             38092800                    0                    0            535210350          91987788000              6273580             26495700                 4650 __expxs_module_MOD_expxs_reg
BYFL_FUNC:                    14748600              9830400              2458350              1228800                    0                    0             43500600           6806169000              1999348              6273900                  150 __expxs_module_MOD_expxs_slgg
BYFL_FUNC:                         444                24708                   66                 6162                    0                    0                27825              3969796                24700                 2351                    1 __geom_module_MOD_diag_setup
BYFL_FUNC:                          92                  256                   14                   30                    0                    0              2981975            477346067                  272               507915                    1 __geom_module_MOD_geom_alloc
BYFL_FUNC:                         108                   48                   14                    6                    0                    0                   38                 3542                   68                   11                    1 __geom_module_MOD_geom_dealloc
BYFL_FUNC:                   953957400            314651400             60258150             19665900            197846850          35469984000            391102050          94667552250             64882284             23473950                  150 __geom_module_MOD_param_calc
BYFL_FUNC:                       10000                 2700                 1350                  375                  850               115950                 5750               916300                  464                 1575                   25 __inner_module_MOD_inner
BYFL_FUNC:                    49293100             49152000              3090025              3072000                    0                    0             32858475           5170655000              3932468              4251025                   25 __inner_module_MOD_inner._omp_fn.0
BYFL_FUNC:                   198295500             49161000             24787700              6145500             24330240           3126558720            125761600          24903948420             41288544             31168525                   25 __inner_module_MOD_inr_conv._omp_fn.2
BYFL_FUNC:                   147600100             49152000             18452275              6144000             12288000           2359296000            113082975          22240238000              7864632              6747025                   25 __inner_module_MOD_inr_src._omp_fn.1
BYFL_FUNC:                        1328                  532                  320                  103                    7                  582                 1644                91232                  676                  528                    1 __input_module_MOD_read_input
BYFL_FUNC:                          40                    0                    5                    0                    0                    0                    5                   10                   40                    5                    1 __mms_module_MOD_mms_deallocate
BYFL_FUNC:                    17856000              6432000              2328000               888000                    0                    0              5724000            835152000                 1076               120000                24000 __octsweep_module_MOD_octsweep
BYFL_FUNC:                    29513100              9830400              3689140              1228800              3440640            441630720             17614640           3507454615             13762772              2539655                    5 __outer_module_MOD_otr_conv._omp_fn.2
BYFL_FUNC:                   865728620            294912000            107614805             36249600             71270400          13683916800            441696795          93588729700              8192312             37760255                    5 __outer_module_MOD_otr_src._omp_fn.1
BYFL_FUNC:                     9832820                  680              1229120                  110              1228820            158519040              7537930           1448190960              9830720              3768475                    5 __outer_module_MOD_outer
BYFL_FUNC:                     9855660              9831000               617560               614550                    0                    0              6571705           1034146540              3932580               850055                    5 __outer_module_MOD_outer._omp_fn.0
BYFL_FUNC:                      346700               365456                63243                58481                    1                  192               312541             35699410               127420                57490                    1 __output_module_MOD_output
BYFL_FUNC:                           0                    0                    0                    0                    0                    0                    2                    0                    0                    0                    1 __plib_module_MOD_barrier
BYFL_FUNC:                           4                    0                    1                    0                    0                    0                    2                   34                    4                    1                    1 __plib_module_MOD_bcast_d_1d
BYFL_FUNC:                           4                    0                    1                    0                    0                    0                    2                   34                    4                    1                    1 __plib_module_MOD_bcast_i_1d
BYFL_FUNC:                          32                    0                    8                    0                    0                    0                   16                  272                    4                    8                    8 __plib_module_MOD_bcast_i_scalar
BYFL_FUNC:                         120                    0                   30                    0                    0                    0                   90                 1020                    4                   30                   30 __plib_module_MOD_cartrank
BYFL_FUNC:                          60                   40                   10                    5                    0                    0                   20                  170                   20                    5                    5 __plib_module_MOD_glmax_d
BYFL_FUNC:                         200                    0                   50                    0                    0                    0                  350                19450                    8                   75                   25 __plib_module_MOD_glmax_d_1d
BYFL_FUNC:                          56                   28                   14                    7                    0                    0                   28                  238                   20                    7                    7 __plib_module_MOD_glmax_i
BYFL_FUNC:                          24                   68                    6                   17                    0                    0                   29                 2632                   76                    4                    1 __plib_module_MOD_pcomm_set
BYFL_FUNC:                           0                    0                    0                    0                    0                    0                    2                    0                    0                    0                    1 __plib_module_MOD_pend
BYFL_FUNC:                           0                   16                    0                    4                    0                    0                    8                    0                   16                    0                    1 __plib_module_MOD_pinit
BYFL_FUNC:                          16                   12                    4                    3                    0                    0                   14                  616                   24                    3                    1 __plib_module_MOD_pinit_omp
BYFL_FUNC:                         480                    0                  120                    0                    0                    0                  120                 1980                   16                   30                   30 __plib_module_MOD_precv_d_2d
BYFL_FUNC:                         480                    0                  120                    0                    0                    0                   90                 1980                   16                   30                   30 __plib_module_MOD_psend_d_2d
BYFL_FUNC:                           8                    0                    2                    0                    0                    0                   14                  778                    8                    3                    1 __plib_module_MOD_rtsum_d_1d
BYFL_FUNC:                       15480               301980                 2448                35534                  904               129664               224794             37674391               297176                41212                    1 __setup_module_MOD_setup
BYFL_FUNC:                        1956                 2820                  150                  177                   96                18432                 1629               269311                 4124                  256                    1 __sn_module_MOD_expcoeff
BYFL_FUNC:                         228                  520                   30                   61                    0                    0                  264                31316                  504                   69                    1 __sn_module_MOD_sn_allocate
BYFL_FUNC:                          72                   72                    9                    9                    0                    0                   18                   18                   72                    9                    1 __sn_module_MOD_sn_deallocate
BYFL_FUNC:                         720                 2796                  105                  328                    0                    0              8628648           1322625716                 2800              2216572                    1 __solvar_module_MOD_solvar_alloc
BYFL_FUNC:                         176                  176                   22                   22                    0                    0                   44                   44                  176                   22                    1 __solvar_module_MOD_solvar_dealloc
BYFL_FUNC:                         900                 2300                  175                  300                    0                    0                 1425               121300                  108                  100                   25 __sweep_module_MOD_sweep
BYFL_FUNC:                     2765100               175700               509075                41825                    0                    0              9082725           1382914475                 1132              1010075                   25 __sweep_module_MOD_sweep._omp_fn.0
BYFL_FUNC:                         368                  464                   86                   86                    5                  960                  678                46208                  512                  160                    1 __time_module_MOD_time_summ
BYFL_FUNC:                           0                 1168                    0                  146                    0                    0                  146                 9344                  208                    0                  146 __time_module_MOD_wtime
BYFL_FUNC:                          24                   72                    6                   14                    0                    0                   46                 4744                   44                    4                    2 __utils_module_MOD_close_file
BYFL_FUNC:                          14                   16                    5                    4                    0                    0                   46                 4692                   13                    6                    1 __utils_module_MOD_cmdarg
BYFL_FUNC:                          24                  168                    6                   30                    0                    0                  102                12684                   92                    6                    2 __utils_module_MOD_open_file
BYFL_FUNC:                           8                   32                    2                    6                    0                    0                   25                 2596                   40                    2                    1 __utils_module_MOD_print_error
BYFL_FUNC:                          16                   32                    4                    6                    0                    0                   25                 2246                   48                    4                    1 __utils_module_MOD_stop_run
BYFL_FUNC:                           0                  220                    0                   37                    0                    0                  144                16800                  220                    0                    1 __version_module_MOD_version_print
BYFL_FUNC:                         424                   92                   98                   16                    5                  960                  487                21620                  132                  170                    1 main
BYFL_FUNC:                        1128                  468                  255                   89                   28                 4736                 1155                63112                  364                  360                    1 translv_
BYFL_FUNC:                        6484                    0                  811                    0                    0                    0               136929             21652250                  220                32311                    1 translv_._omp_fn.0
BYFL_FUNC:                       43220                    0                 5405                    0                    0                    0                 7545              1196050                  252                  305                    5 translv_._omp_fn.1
BYFL_CALLEE_HEADER:   Invocations Byfl Function
BYFL_CALLEE:             18034862 No   llvm.memset.p0i8.i64
BYFL_CALLEE:             14745600 No   fabs
BYFL_CALLEE:                48000 No   _gfortran_internal_pack
BYFL_CALLEE:                48000 No   omp_get_num_threads
BYFL_CALLEE:                48000 No   omp_get_thread_num
BYFL_CALLEE:                30200 No   GOMP_barrier
BYFL_CALLEE:                28511 No   free
BYFL_CALLEE:                28511 No   malloc
BYFL_CALLEE:                24121 No   GOMP_parallel_end
BYFL_CALLEE:                24121 No   GOMP_parallel_start
BYFL_CALLEE:                24035 No   llvm.memcpy.p0i8.p0i8.i64
BYFL_CALLEE:                24000 Yes  dim3_sweep_module::dim3_sweep [__dim3_sweep_module_MOD_dim3_sweep]
BYFL_CALLEE:                24000 Yes  dim3_sweep_module::dim3_sweep._omp_fn.0 [__dim3_sweep_module_MOD_dim3_sweep._omp_fn.0]
BYFL_CALLEE:                24000 Yes  octsweep_module::octsweep [__octsweep_module_MOD_octsweep]
BYFL_CALLEE:                15699 No   _gfortran_transfer_real_write
BYFL_CALLEE:                 5304 No   _gfortran_transfer_character_write
BYFL_CALLEE:                 4650 Yes  expxs_module::expxs_reg [__expxs_module_MOD_expxs_reg]
BYFL_CALLEE:                 4367 No   _gfortran_st_write
BYFL_CALLEE:                 4367 No   _gfortran_st_write_done
BYFL_CALLEE:                 4073 No   _gfortran_transfer_integer_write
BYFL_CALLEE:                 3630 No   GOMP_loop_dynamic_next
BYFL_CALLEE:                 3100 No   GOMP_single_start
BYFL_CALLEE:                  263 No   *UNNAMED*
BYFL_CALLEE:                  150 Yes  expxs_module::expxs_slgg [__expxs_module_MOD_expxs_slgg]
BYFL_CALLEE:                  150 Yes  geom_module::param_calc [__geom_module_MOD_param_calc]
BYFL_CALLEE:                  146 Yes  time_module::wtime [__time_module_MOD_wtime]
BYFL_CALLEE:                  121 No   GOMP_loop_dynamic_start
BYFL_CALLEE:                   96 No   GOMP_loop_end_nowait
BYFL_CALLEE:                   32 No   sqrt
BYFL_CALLEE:                   30 Yes  plib_module::cartrank [__plib_module_MOD_cartrank]
BYFL_CALLEE:                   30 Yes  plib_module::precv_d_2d [__plib_module_MOD_precv_d_2d]
BYFL_CALLEE:                   30 Yes  plib_module::psend_d_2d [__plib_module_MOD_psend_d_2d]
BYFL_CALLEE:                   25 No   GOMP_loop_end
BYFL_CALLEE:                   25 Yes  inner_module::inner [__inner_module_MOD_inner]
BYFL_CALLEE:                   25 Yes  inner_module::inner._omp_fn.0 [__inner_module_MOD_inner._omp_fn.0]
BYFL_CALLEE:                   25 Yes  inner_module::inr_conv._omp_fn.2 [__inner_module_MOD_inr_conv._omp_fn.2]
BYFL_CALLEE:                   25 Yes  inner_module::inr_src._omp_fn.1 [__inner_module_MOD_inr_src._omp_fn.1]
BYFL_CALLEE:                   25 Yes  plib_module::glmax_d_1d [__plib_module_MOD_glmax_d_1d]
BYFL_CALLEE:                   25 Yes  sweep_module::sweep [__sweep_module_MOD_sweep]
BYFL_CALLEE:                   25 Yes  sweep_module::sweep._omp_fn.0 [__sweep_module_MOD_sweep._omp_fn.0]
BYFL_CALLEE:                    8 Yes  plib_module::bcast_i_scalar [__plib_module_MOD_bcast_i_scalar]
BYFL_CALLEE:                    7 Yes  plib_module::glmax_i [__plib_module_MOD_glmax_i]
BYFL_CALLEE:                    5 Yes  outer_module::otr_conv._omp_fn.2 [__outer_module_MOD_otr_conv._omp_fn.2]
BYFL_CALLEE:                    5 Yes  outer_module::otr_src._omp_fn.1 [__outer_module_MOD_otr_src._omp_fn.1]
BYFL_CALLEE:                    5 Yes  outer_module::outer [__outer_module_MOD_outer]
BYFL_CALLEE:                    5 Yes  outer_module::outer._omp_fn.0 [__outer_module_MOD_outer._omp_fn.0]
BYFL_CALLEE:                    5 Yes  plib_module::glmax_d [__plib_module_MOD_glmax_d]
BYFL_CALLEE:                    5 Yes  translv_._omp_fn.1
BYFL_CALLEE:                    2 Yes  utils_module::close_file [__utils_module_MOD_close_file]
BYFL_CALLEE:                    2 Yes  utils_module::open_file [__utils_module_MOD_open_file]
BYFL_CALLEE:                    2 No   _gfortran_adjustl
BYFL_CALLEE:                    2 No   _gfortran_st_close
BYFL_CALLEE:                    2 No   _gfortran_st_open
BYFL_CALLEE:                    1 Yes  analyze_module::pop_calc [__analyze_module_MOD_pop_calc]
BYFL_CALLEE:                    1 Yes  control_module::control_alloc [__control_module_MOD_control_alloc]
BYFL_CALLEE:                    1 Yes  control_module::control_dealloc [__control_module_MOD_control_dealloc]
BYFL_CALLEE:                    1 Yes  data_module::data_allocate [__data_module_MOD_data_allocate]
BYFL_CALLEE:                    1 Yes  data_module::data_deallocate [__data_module_MOD_data_deallocate]
BYFL_CALLEE:                    1 Yes  dealloc_module::dealloc_input [__dealloc_module_MOD_dealloc_input]
BYFL_CALLEE:                    1 Yes  dealloc_module::dealloc_solve [__dealloc_module_MOD_dealloc_solve]
BYFL_CALLEE:                    1 Yes  geom_module::diag_setup [__geom_module_MOD_diag_setup]
BYFL_CALLEE:                    1 Yes  geom_module::geom_alloc [__geom_module_MOD_geom_alloc]
BYFL_CALLEE:                    1 Yes  geom_module::geom_dealloc [__geom_module_MOD_geom_dealloc]
BYFL_CALLEE:                    1 Yes  input_module::read_input [__input_module_MOD_read_input]
BYFL_CALLEE:                    1 Yes  mms_module::mms_deallocate [__mms_module_MOD_mms_deallocate]
BYFL_CALLEE:                    1 Yes  output_module::output [__output_module_MOD_output]
BYFL_CALLEE:                    1 Yes  plib_module::barrier [__plib_module_MOD_barrier]
BYFL_CALLEE:                    1 Yes  plib_module::bcast_d_1d [__plib_module_MOD_bcast_d_1d]
BYFL_CALLEE:                    1 Yes  plib_module::bcast_i_1d [__plib_module_MOD_bcast_i_1d]
BYFL_CALLEE:                    1 Yes  plib_module::pcomm_set [__plib_module_MOD_pcomm_set]
BYFL_CALLEE:                    1 Yes  plib_module::pinit [__plib_module_MOD_pinit]
BYFL_CALLEE:                    1 Yes  plib_module::pinit_omp [__plib_module_MOD_pinit_omp]
BYFL_CALLEE:                    1 Yes  plib_module::rtsum_d_1d [__plib_module_MOD_rtsum_d_1d]
BYFL_CALLEE:                    1 Yes  setup_module::setup [__setup_module_MOD_setup]
BYFL_CALLEE:                    1 Yes  sn_module::expcoeff [__sn_module_MOD_expcoeff]
BYFL_CALLEE:                    1 Yes  sn_module::sn_allocate [__sn_module_MOD_sn_allocate]
BYFL_CALLEE:                    1 Yes  sn_module::sn_deallocate [__sn_module_MOD_sn_deallocate]
BYFL_CALLEE:                    1 Yes  solvar_module::solvar_alloc [__solvar_module_MOD_solvar_alloc]
BYFL_CALLEE:                    1 Yes  solvar_module::solvar_dealloc [__solvar_module_MOD_solvar_dealloc]
BYFL_CALLEE:                    1 Yes  time_module::time_summ [__time_module_MOD_time_summ]
BYFL_CALLEE:                    1 Yes  utils_module::cmdarg [__utils_module_MOD_cmdarg]
BYFL_CALLEE:                    1 Yes  utils_module::print_error [__utils_module_MOD_print_error]
BYFL_CALLEE:                    1 Yes  version_module::version_print [__version_module_MOD_version_print]
BYFL_CALLEE:                    1 No   _gfortran_iargc
BYFL_CALLEE:                    1 No   _gfortran_set_args
BYFL_CALLEE:                    1 No   _gfortran_set_options
BYFL_CALLEE:                    1 No   _gfortran_st_read
BYFL_CALLEE:                    1 No   _gfortran_st_read_done
BYFL_CALLEE:                    1 Yes  translv_._omp_fn.0
BYFL_VECTOR_HEADER:             Elements             Elt_bits Type                Tally Function
BYFL_VECTOR:                           2                   64 FP                 368643 __analyze_module_MOD_pop_calc
BYFL_VECTOR:                           4                   32 FP                    100 __outer_module_MOD_outer
BYFL_VECTOR:                           2                   64 FP            11108352000 __dim3_sweep_module_MOD_dim3_sweep._omp_fn.0
BYFL_VECTOR:                           2                   64 FP                     54 __sn_module_MOD_expcoeff
BYFL_VECTOR:                           2                   64 FP               99538050 __geom_module_MOD_param_calc
BYFL_VECTOR:                           2                   64 FP                    136 __setup_module_MOD_setup
BYFL_DATA_STRUCT_HEADER:                 Size             LD_bytes             ST_bytes               LD_ops               ST_ops Origin                        Description
BYFL_DATA_STRUCT:                         256          62914560000          25165824000           4718592000           1572864000 stack                         Unnamed data structure allocated in dim3_sweep_module::dim3_sweep._omp_fn.0 at /users/pakin/work/part-snap/snap_src/dim3_sweep.f90:136
BYFL_DATA_STRUCT:                      983040          37748736000          13370327040           3145728000            789507840 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:152
BYFL_DATA_STRUCT:                      983040          37748736000          13370327040           3145728000            789507840 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:152
BYFL_DATA_STRUCT:                     1966080          25559040000          12978094080           1622016000            787975680 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:152
BYFL_DATA_STRUCT:                         256          12582912000          12582912000            786432000            786432000 stack                         Unnamed data structure allocated in dim3_sweep_module::dim3_sweep._omp_fn.0 at /users/pakin/work/part-snap/snap_src/dim3_sweep.f90:136
BYFL_DATA_STRUCT:                        1008          12260928000           1203168000           1557960000            297864000 stack                         Variable .omp_data_o.289 allocated in dim3_sweep_module::dim3_sweep at /users/pakin/work/part-snap/snap_src/dim3_sweep.f90:44
BYFL_DATA_STRUCT:                    62914560          12582912000            377487360            786432000             19906560 malloc                        Unnamed data structure allocated in geom_module::geom_alloc at /users/pakin/work/part-snap/snap_src/geom.f90:114
BYFL_DATA_STRUCT:                         256          12897484800                38656            806092800                 2401 malloc                        Unnamed data structure allocated in geom_module::geom_alloc at /users/pakin/work/part-snap/snap_src/geom.f90:114
BYFL_DATA_STRUCT:                         256          12897484800                38656            806092800                 2401 malloc                        Unnamed data structure allocated in geom_module::geom_alloc at /users/pakin/work/part-snap/snap_src/geom.f90:114
BYFL_DATA_STRUCT:                         256          12897485560                  256            806092863                   32 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:79
BYFL_DATA_STRUCT:                         256          12582912768                  256           1572864048                   16 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:79
BYFL_DATA_STRUCT:                         256          12582912000                  512           1572864000                   17 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:85
BYFL_DATA_STRUCT:                         256          12582912000                  512           1572864000                   17 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:94
BYFL_DATA_STRUCT:                     1966080            945807360            446300160            114408960             55311360 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:116
BYFL_DATA_STRUCT:                          48           1179655216                   56            147456902                    6 .bss                          Variable hj declared at /users/pakin/work/part-snap/snap_src/geom.f90:68
BYFL_DATA_STRUCT:                          48           1179655216                   56            147456902                    6 .bss                          Variable hk declared at /users/pakin/work/part-snap/snap_src/geom.f90:68
BYFL_DATA_STRUCT:                          48           1179649808                   56            147456226                    6 .bss                          Variable mu declared at /users/pakin/work/part-snap/snap_src/sn.f90:51
BYFL_DATA_STRUCT:                          48           1179648160                   56            147456020                    6 .bss                          Variable w declared at /users/pakin/work/part-snap/snap_src/sn.f90:51
BYFL_DATA_STRUCT:                       65536            285081600            570163200             35635200             36748800 malloc                        Unnamed data structure allocated in outer_module::otr_src._omp_fn.1 at /users/pakin/work/part-snap/snap_src/outer.f90:188
BYFL_DATA_STRUCT:                     2088960            393216000            447528960             49152000             49364160 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:177
BYFL_DATA_STRUCT:                     2088960            393216000            447528960             49152000             49364160 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:177
BYFL_DATA_STRUCT:                      983040                    0            787415040                    0              3075840 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:164
BYFL_DATA_STRUCT:                      983040                    0            787415040                    0              3075840 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:164
BYFL_DATA_STRUCT:                          48            786816152                   56             98352019                    6 .bss                          Variable diag declared at /users/pakin/work/part-snap/snap_src/geom.f90:93
BYFL_DATA_STRUCT:                         240            786739200                  480             98342400                    2 malloc                        Unnamed data structure allocated in data_module::data_allocate at /users/pakin/work/part-snap/snap_src/data.f90:147
BYFL_DATA_STRUCT:                          56            786528288                  124             98328036                   12 malloc                        Unnamed data structure allocated in geom_module::diag_setup at /users/pakin/work/part-snap/snap_src/geom.f90:315
BYFL_DATA_STRUCT:                     1966080            334233600            296878080             41779200             36495360 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:129
BYFL_DATA_STRUCT:                       24576            589824000                24576            147456000                 6144 malloc                        Unnamed data structure allocated in geom_module::diag_setup at /users/pakin/work/part-snap/snap_src/geom.f90:317
BYFL_DATA_STRUCT:                     1966080            393216000             51118080             49152000              6389760 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:129
BYFL_DATA_STRUCT:                           4            405601448                    0            101400362                    0 .data                         Variable ndimen declared at /users/pakin/work/part-snap/snap_src/geom.f90:35
BYFL_DATA_STRUCT:                           4            393332408                   12             98333102                    3 .bss                          Variable cmom declared at /users/pakin/work/part-snap/snap_src/sn.f90:47
BYFL_DATA_STRUCT:                           4            393216000                96000             98304000                24000 stack                         Variable oct allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:54
BYFL_DATA_STRUCT:                           8            393217200                 1208             49152150                  151 .bss                          Variable hi declared at /users/pakin/work/part-snap/snap_src/geom.f90:66
BYFL_DATA_STRUCT:                         256            393216000                  512             49152000                   17 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:79
BYFL_DATA_STRUCT:                           4            393216000                  400             98304000                  100 stack                         Variable jst allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                           4            393216000                  400             98304000                  100 stack                         Variable kst allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                           4            390281940                    0             97570485                    0 .data                         Variable nx declared at /users/pakin/work/part-snap/snap_src/geom.f90:35
BYFL_DATA_STRUCT:                       14400            294912000                28832             36864000                 2704 malloc                        Unnamed data structure allocated in data_module::data_allocate at /users/pakin/work/part-snap/snap_src/data.f90:135
BYFL_DATA_STRUCT:                           4            221281200                  600             55320300                  150 stack                         Variable jd allocated in sweep_module::sweep._omp_fn.0 at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                           4            221281000                  300             55320250                   75 stack                         Variable kd allocated in sweep_module::sweep._omp_fn.0 at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                           4            208896600                    4             52224150                    1 .bss                          Variable firsty declared at /users/pakin/work/part-snap/snap_src/plib.f90:114
BYFL_DATA_STRUCT:                           4            208896600                    4             52224150                    1 .bss                          Variable firstz declared at /users/pakin/work/part-snap/snap_src/plib.f90:114
BYFL_DATA_STRUCT:                           4            196704000                96000             49176000                24000 stack                         Variable id allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:54
BYFL_DATA_STRUCT:                           4            196704624                    0             49176156                    0 .data                         Variable ichunk declared at /users/pakin/work/part-snap/snap_src/plib.f90:63
BYFL_DATA_STRUCT:                           4            196608000                96000             49152000                24000 stack                         Variable ich allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:54
BYFL_DATA_STRUCT:                           4            196608000                  400             49152000                  100 stack                         Variable jhi allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                           4            196608000                  400             49152000                  100 stack                         Variable jlo allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                           4            196608000                  400             49152000                  100 stack                         Variable khi allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                           4            196608000                  400             49152000                  100 stack                         Variable klo allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                           4            196608028                    0             49152007                    0 .bss                          Variable src_opt declared at /users/pakin/work/part-snap/snap_src/data.f90:32
BYFL_DATA_STRUCT:                           4            196608004                   12             49152001                    3 .bss                          Variable noct declared at /users/pakin/work/part-snap/snap_src/sn.f90:47
BYFL_DATA_STRUCT:                           4            196608008                    0             49152002                    0 .bss                          Variable fixup declared at /users/pakin/work/part-snap/snap_src/control.f90:38
BYFL_DATA_STRUCT:                       32768            157286400                69632             39321600                 4352 malloc                        Unnamed data structure allocated in data_module::data_allocate at /users/pakin/work/part-snap/snap_src/data.f90:106
BYFL_DATA_STRUCT:                           4            122880400                    4             30720100                    1 .bss                          Variable lasty declared at /users/pakin/work/part-snap/snap_src/plib.f90:114
BYFL_DATA_STRUCT:                           4            116736400                    4             29184100                    1 .bss                          Variable lastz declared at /users/pakin/work/part-snap/snap_src/plib.f90:114
BYFL_DATA_STRUCT:                     1966080             49152000             51118080              6144000              3079680 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:116
BYFL_DATA_STRUCT:                           4             98442180                    4             24610545                    1 .data                         Variable ny declared at /users/pakin/work/part-snap/snap_src/geom.f90:35
BYFL_DATA_STRUCT:                           4             98440940                    4             24610235                    1 .data                         Variable nz declared at /users/pakin/work/part-snap/snap_src/geom.f90:35
BYFL_DATA_STRUCT:                     1966080             49152000             49152000              6144000              6144000 malloc                        Unnamed data structure allocated in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:211
BYFL_DATA_STRUCT:                           8             49152000             49152000              6144000              6144000 .bss                          Variable fmax declared at /users/pakin/work/part-snap/snap_src/dim3_sweep.f90:38
BYFL_DATA_STRUCT:                           8             49152000             49152000              6144000              6144000 .bss                          Variable fmin declared at /users/pakin/work/part-snap/snap_src/dim3_sweep.f90:38
BYFL_DATA_STRUCT:                     2027520             12288000             65003520              1536000              1735680 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:177
BYFL_DATA_STRUCT:                     1966080             49152000             21626880              6144000              2703360 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:140
BYFL_DATA_STRUCT:                           8             50688200                  200              6336025                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                        1024             24576000             24576000                24000                96000 malloc                        Unnamed data structure allocated in dim3_sweep_module::dim3_sweep at /users/pakin/work/part-snap/snap_src/dim3_sweep.f90:109
BYFL_DATA_STRUCT:                     1966080              9830400             21626880              1228800              1274880 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:140
BYFL_DATA_STRUCT:                        1024                    0             24576000                    0                24000 stack                         Unnamed data structure allocated in dim3_sweep_module::dim3_sweep._omp_fn.0 at /users/pakin/work/part-snap/snap_src/dim3_sweep.f90:134
BYFL_DATA_STRUCT:                     1966080                    0             21626880                    0              1274880 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:140
BYFL_DATA_STRUCT:                     1966080              9830400             11796480              1228800               622080 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:116
BYFL_DATA_STRUCT:                     1966080              9830400              9830400              1228800              1228800 malloc                        Unnamed data structure allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:234
BYFL_DATA_STRUCT:                     1966080              9830400              2211840               614400                38400 malloc                        Unnamed data structure allocated in data_module::data_allocate at /users/pakin/work/part-snap/snap_src/data.f90:119
BYFL_DATA_STRUCT:                         480              9830864                  960              1228829                   61 malloc                        Unnamed data structure allocated in data_module::data_allocate at /users/pakin/work/part-snap/snap_src/data.f90:135
BYFL_DATA_STRUCT:                         480              9830864                  960              1228829                   61 malloc                        Unnamed data structure allocated in data_module::data_allocate at /users/pakin/work/part-snap/snap_src/data.f90:135
BYFL_DATA_STRUCT:                           4              9830460                   60              1228810                   10 stack                         Variable .omp_data_o.104.i allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:72
BYFL_DATA_STRUCT:                     1966080              1966080              1966080               245760               122880 malloc                        Unnamed data structure allocated in analyze_module::pop_calc at /users/pakin/work/part-snap/snap_src/analyze.f90:52
BYFL_DATA_STRUCT:                         168              3264008                  176               408001                   17 .bss                          Variable ptr_in declared at /users/pakin/work/part-snap/snap_src/solvar.f90:75
BYFL_DATA_STRUCT:                         168              3264008                  176               408001                   21 .bss                          Variable ptr_out declared at /users/pakin/work/part-snap/snap_src/solvar.f90:75
BYFL_DATA_STRUCT:                         120               192000              2880000                24000               360000 stack                         Variable parm.14 allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:38
BYFL_DATA_STRUCT:                         120               192000              2880000                24000               360000 stack                         Variable parm.15 allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:38
BYFL_DATA_STRUCT:                          96              1233700                14700               154225                 3400 stack                         Variable .omp_data_o.87 allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:57
BYFL_DATA_STRUCT:                      983040                    0               983040                    0                 3840 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:164
BYFL_DATA_STRUCT:                      983040                    0               983040                    0                 3840 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:164
BYFL_DATA_STRUCT:                         120               841048                  128               105131                   15 .bss                          Variable flux declared at /users/pakin/work/part-snap/snap_src/solvar.f90:68
BYFL_DATA_STRUCT:                         144               701904                  152                87738                   18 .bss                          Variable fluxm declared at /users/pakin/work/part-snap/snap_src/solvar.f90:72
BYFL_DATA_STRUCT:                         120               642056                  128                80257                   15 .bss                          Variable flkz declared at /users/pakin/work/part-snap/snap_src/solvar.f90:70
BYFL_DATA_STRUCT:                         120               642016                  128                80252                   15 .bss                          Variable flkx declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                         120               642016                  128                80252                   15 .bss                          Variable flky declared at /users/pakin/work/part-snap/snap_src/solvar.f90:70
BYFL_DATA_STRUCT:                         144               594016                  152                74252                   18 .bss                          Variable qtot declared at /users/pakin/work/part-snap/snap_src/solvar.f90:72
BYFL_DATA_STRUCT:                         120               583216                  128                72902                   15 .bss                          Variable t_xs declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                         144               579664                  152                72458                   18 .bss                          Variable dinv declared at /users/pakin/work/part-snap/snap_src/geom.f90:70
BYFL_DATA_STRUCT:                         120               576120                  128                72015                   15 .bss                          Variable kb_out declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                          96               576144                  104                72018                   12 .bss                          Variable ec declared at /users/pakin/work/part-snap/snap_src/sn.f90:54
BYFL_DATA_STRUCT:                         120               576056                  128                72007                   15 .bss                          Variable kb_in declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                         120               576056                  128                72007                   15 .bss                          Variable psik declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                         120               576016                  128                72002                   15 .bss                          Variable jb_in declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                         120               576016                  128                72002                   15 .bss                          Variable jb_out declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                         120               576016                  128                72002                   15 .bss                          Variable psii declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                         120               576016                  128                72002                   15 .bss                          Variable psij declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                         120               384400                24000                96100                 3900 malloc                        Unnamed data structure allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:75
BYFL_DATA_STRUCT:                          48               386448                   56                48306                    6 .bss                          Variable vdelt declared at /users/pakin/work/part-snap/snap_src/data.f90:55
BYFL_DATA_STRUCT:                           4               300400                24400                75100                 6100 malloc                        Unnamed data structure allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:73
BYFL_DATA_STRUCT:                           4               192000               108000                48000                27000 stack                         Variable iop allocated in sweep_module::sweep._omp_fn.0 at /users/pakin/work/part-snap/snap_src/sweep.f90:69
BYFL_DATA_STRUCT:                          48               192080                   56                24010                    6 .bss                          Variable wxi declared at /users/pakin/work/part-snap/snap_src/sn.f90:52
BYFL_DATA_STRUCT:                          48               192048                   56                24006                    6 .bss                          Variable weta declared at /users/pakin/work/part-snap/snap_src/sn.f90:51
BYFL_DATA_STRUCT:                          48               192048                   56                24006                    6 .bss                          Variable wmu declared at /users/pakin/work/part-snap/snap_src/sn.f90:51
BYFL_DATA_STRUCT:                           4                96000                96000                24000                24000 stack                         Variable d1 allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:54
BYFL_DATA_STRUCT:                           4                96000                96000                24000                24000 stack                         Variable d2 allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:54
BYFL_DATA_STRUCT:                           4                96000                96000                24000                24000 stack                         Variable d3 allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:54
BYFL_DATA_STRUCT:                         120               180160                  128                22520                   15 .bss                          Variable slgg declared at /users/pakin/work/part-snap/snap_src/data.f90:59
BYFL_DATA_STRUCT:                         480                61440                92160                15360                17280 stack                         Variable dt_parm.40 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:42
BYFL_DATA_STRUCT:                           4                65280                77520                16320                19380 stack                         Variable ii allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:58
BYFL_DATA_STRUCT:                         144               133216                  152                16652                   18 .bss                          Variable q2grp declared at /users/pakin/work/part-snap/snap_src/solvar.f90:72
BYFL_DATA_STRUCT:                        4096                    0               126976                    0                 7696 malloc                        Unnamed data structure allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:100
BYFL_DATA_STRUCT:                           4               108400                  600                27100                  150 .bss                          Variable nc declared at /users/pakin/work/part-snap/snap_src/geom.f90:64
BYFL_DATA_STRUCT:                           4               108500                    4                27125                    1 .bss                          Variable num_grth declared at /users/pakin/work/part-snap/snap_src/plib.f90:112
BYFL_DATA_STRUCT:                           4                96636                    0                24159                    0 .data                         Variable nang declared at /users/pakin/work/part-snap/snap_src/sn.f90:27
BYFL_DATA_STRUCT:                           4                96000                  400                24000                  100 .bss                          Variable incomingy declared at /users/pakin/work/part-snap/snap_src/sweep.f90:51
BYFL_DATA_STRUCT:                           4                96000                  400                24000                  100 .bss                          Variable incomingz declared at /users/pakin/work/part-snap/snap_src/sweep.f90:51
BYFL_DATA_STRUCT:                           4                96000                  400                24000                  100 .bss                          Variable outgoingy declared at /users/pakin/work/part-snap/snap_src/sweep.f90:51
BYFL_DATA_STRUCT:                           4                96000                  400                24000                  100 .bss                          Variable outgoingz declared at /users/pakin/work/part-snap/snap_src/sweep.f90:51
BYFL_DATA_STRUCT:                         120                96056                  128                12007                   15 .bss                          Variable fluxpi declared at /users/pakin/work/part-snap/snap_src/solvar.f90:68
BYFL_DATA_STRUCT:                           4                96040                    0                24010                    0 .bss                          Variable timedep declared at /users/pakin/work/part-snap/snap_src/control.f90:37
BYFL_DATA_STRUCT:                           4                96012                    0                24003                    0 .bss                          Variable nnested declared at /users/pakin/work/part-snap/snap_src/plib.f90:63
BYFL_DATA_STRUCT:                           4                96004                    4                24001                    1 .bss                          Variable ndiag declared at /users/pakin/work/part-snap/snap_src/geom.f90:64
BYFL_DATA_STRUCT:                           4                96000                    4                24000                    1 .bss                          Variable thread_multiple declared at /users/pakin/work/part-snap/snap_src/plib.f90:111
BYFL_DATA_STRUCT:                           4                    0                96000                    0                24000 stack                         Variable d4 allocated in octsweep_module::octsweep at /users/pakin/work/part-snap/snap_src/octsweep.f90:54
BYFL_DATA_STRUCT:                           4                96000                    0                24000                    0 .bss                          Variable thread_level declared at /users/pakin/work/part-snap/snap_src/plib.f90:110
BYFL_DATA_STRUCT:                           4                72960                12240                18240                 3060 stack                         Variable j allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:58
BYFL_DATA_STRUCT:                          48                52336                   56                 6542                    6 .bss                          Variable inrdone declared at /users/pakin/work/part-snap/snap_src/control.f90:58
BYFL_DATA_STRUCT:                         480                    0                42240                    0                 7680 stack                         Variable dt_parm.38 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:42
BYFL_DATA_STRUCT:                         256                39160                  256                 2463                   32 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:85
BYFL_DATA_STRUCT:                         256                38656                  256                 2416                   32 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:94
BYFL_DATA_STRUCT:                          96                38520                  104                 4815                   12 .bss                          Variable mat declared at /users/pakin/work/part-snap/snap_src/data.f90:53
BYFL_DATA_STRUCT:                         120                24120                  720                 6030                    6 malloc                        Unnamed data structure allocated in control_module::control_alloc at /users/pakin/work/part-snap/snap_src/control.f90:84
BYFL_DATA_STRUCT:                         144                21664                  152                 2708                   18 .bss                          Variable s_xs declared at /users/pakin/work/part-snap/snap_src/solvar.f90:73
BYFL_DATA_STRUCT:                           4                21032                    0                 5258                    0 .data                         Variable nmom declared at /users/pakin/work/part-snap/snap_src/sn.f90:27
BYFL_DATA_STRUCT:                         120                19216                  128                 2402                   15 .bss                          Variable fluxpo declared at /users/pakin/work/part-snap/snap_src/solvar.f90:68
BYFL_DATA_STRUCT:                         240                 6000                12240                  750                  790 malloc                        Unnamed data structure allocated in control_module::control_alloc at /users/pakin/work/part-snap/snap_src/control.f90:84
BYFL_DATA_STRUCT:                           4                18012                    4                 4503                    1 .data                         Variable nmat declared at /users/pakin/work/part-snap/snap_src/data.f90:51
BYFL_DATA_STRUCT:                         120                13272                  128                 1659                   15 .bss                          Variable qi declared at /users/pakin/work/part-snap/snap_src/data.f90:59
BYFL_DATA_STRUCT:                          48                12816                   56                 1602                    6 .bss                          Variable dfmxi declared at /users/pakin/work/part-snap/snap_src/control.f90:64
BYFL_DATA_STRUCT:                           4                    0                12400                    0                 3100 stack                         Variable gnext allocated in sweep_module::sweep at /users/pakin/work/part-snap/snap_src/sweep.f90:71
BYFL_DATA_STRUCT:                          48                12064                   56                 1508                    6 .bss                          Variable lma declared at /users/pakin/work/part-snap/snap_src/sn.f90:49
BYFL_DATA_STRUCT:                         480                 9600                  960                 2400                  180 stack                         Variable dt_parm.42 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:42
BYFL_DATA_STRUCT:                         480                 8400                  960                 2100                  180 stack                         Variable dt_parm.34 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:42
BYFL_DATA_STRUCT:                         480                    0                 7920                    0                 1440 stack                         Variable dt_parm.37 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:42
BYFL_DATA_STRUCT:                         480                    0                 7920                    0                 1440 stack                         Variable dt_parm.39 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:42
BYFL_DATA_STRUCT:                           4                 6100                  300                  775                   50 stack                         Variable .omp_data_o.86.i allocated in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:69
BYFL_DATA_STRUCT:                           8                 6000                  200                  750                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                         240                 6000                    0                   25                    0 malloc                        Unnamed data structure allocated in plib_module::glmax_d_1d at /users/pakin/work/part-snap/snap_src/plib.f90:402
BYFL_DATA_STRUCT:                           8                 6000                    0                  750                    0 stack                         Variable .iend0.103 allocated in sweep_module::sweep._omp_fn.0 at /users/pakin/work/part-snap/snap_src/sweep.f90:93
BYFL_DATA_STRUCT:                           8                 6000                    0                  750                    0 stack                         Variable .iend0.114 allocated in inner_module::inr_src._omp_fn.1 at /users/pakin/work/part-snap/snap_src/inner.f90:126
BYFL_DATA_STRUCT:                           8                 6000                    0                  750                    0 stack                         Variable .iend0.118 allocated in inner_module::inr_conv._omp_fn.2 at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                 6000                    0                  750                    0 stack                         Variable .iend0.122 allocated in inner_module::inner._omp_fn.0 at /users/pakin/work/part-snap/snap_src/inner.f90:82
BYFL_DATA_STRUCT:                           8                 6000                    0                  750                    0 stack                         Variable .istart0.102 allocated in sweep_module::sweep._omp_fn.0 at /users/pakin/work/part-snap/snap_src/sweep.f90:93
BYFL_DATA_STRUCT:                           8                 6000                    0                  750                    0 stack                         Variable .istart0.113 allocated in inner_module::inr_src._omp_fn.1 at /users/pakin/work/part-snap/snap_src/inner.f90:126
BYFL_DATA_STRUCT:                           8                 6000                    0                  750                    0 stack                         Variable .istart0.117 allocated in inner_module::inr_conv._omp_fn.2 at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                 6000                    0                  750                    0 stack                         Variable .istart0.121 allocated in inner_module::inner._omp_fn.0 at /users/pakin/work/part-snap/snap_src/inner.f90:82
BYFL_DATA_STRUCT:                          72                 5096                   80                  637                    9 .bss                          Variable siga declared at /users/pakin/work/part-snap/snap_src/data.f90:57
BYFL_DATA_STRUCT:                          72                 5096                   80                  637                    9 .bss                          Variable sigt declared at /users/pakin/work/part-snap/snap_src/data.f90:57
BYFL_DATA_STRUCT:                         120                  600                 3600                   45                  900 malloc                        Unnamed data structure allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:62
BYFL_DATA_STRUCT:                        2048                    0                 4096                    0                  136 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:100
BYFL_DATA_STRUCT:                         120                 3616                  128                  452                   15 .bss                          Variable a_xs declared at /users/pakin/work/part-snap/snap_src/solvar.f90:69
BYFL_DATA_STRUCT:                           4                 3100                  120                  775                   30 stack                         Variable inno allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:60
BYFL_DATA_STRUCT:                           4                 1984                 1028                  496                  257 stack                         Variable i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:629
BYFL_DATA_STRUCT:                         480                 1904                  960                  209                   61 malloc                        Unnamed data structure allocated in data_module::data_allocate at /users/pakin/work/part-snap/snap_src/data.f90:135
BYFL_DATA_STRUCT:                          48                 1800                   56                  225                    6 .bss                          Variable eta declared at /users/pakin/work/part-snap/snap_src/sn.f90:51
BYFL_DATA_STRUCT:                          48                 1792                   56                  224                    6 .bss                          Variable xi declared at /users/pakin/work/part-snap/snap_src/sn.f90:51
BYFL_DATA_STRUCT:                          72                 1520                   80                  190                    9 .bss                          Variable sigs declared at /users/pakin/work/part-snap/snap_src/data.f90:57
BYFL_DATA_STRUCT:                           4                 1392                    0                  348                    0 .data                         Variable ng declared at /users/pakin/work/part-snap/snap_src/data.f90:32
BYFL_DATA_STRUCT:                           8                 1208                    8                  151                    1 .bss                          Variable dx declared at /users/pakin/work/part-snap/snap_src/geom.f90:66
BYFL_DATA_STRUCT:                           8                 1208                    8                  151                    1 .bss                          Variable dy declared at /users/pakin/work/part-snap/snap_src/geom.f90:66
BYFL_DATA_STRUCT:                           8                 1208                    8                  151                    1 .bss                          Variable dz declared at /users/pakin/work/part-snap/snap_src/geom.f90:66
BYFL_DATA_STRUCT:                           8                 1200                    0                  150                    0 stack                         Variable .iend0.130 allocated in outer_module::otr_src._omp_fn.1 at /users/pakin/work/part-snap/snap_src/outer.f90:150
BYFL_DATA_STRUCT:                           8                 1200                    0                  150                    0 stack                         Variable .iend0.134 allocated in outer_module::otr_conv._omp_fn.2 at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                 1200                    0                  150                    0 stack                         Variable .iend0.138 allocated in outer_module::outer._omp_fn.0 at /users/pakin/work/part-snap/snap_src/outer.f90:85
BYFL_DATA_STRUCT:                           8                 1200                    0                  150                    0 stack                         Variable .iend0.94 allocated in translv_._omp_fn.1 at /users/pakin/work/part-snap/snap_src/translv.f90:195
BYFL_DATA_STRUCT:                           8                 1200                    0                  150                    0 stack                         Variable .istart0.129 allocated in outer_module::otr_src._omp_fn.1 at /users/pakin/work/part-snap/snap_src/outer.f90:150
BYFL_DATA_STRUCT:                           8                 1200                    0                  150                    0 stack                         Variable .istart0.133 allocated in outer_module::otr_conv._omp_fn.2 at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                 1200                    0                  150                    0 stack                         Variable .istart0.137 allocated in outer_module::outer._omp_fn.0 at /users/pakin/work/part-snap/snap_src/outer.f90:85
BYFL_DATA_STRUCT:                           8                 1200                    0                  150                    0 stack                         Variable .istart0.93 allocated in translv_._omp_fn.1 at /users/pakin/work/part-snap/snap_src/translv.f90:195
BYFL_DATA_STRUCT:                         480                    0                  960                    0                  180 stack                         Variable dt_parm.20 allocated in analyze_module::pop_calc at /users/pakin/work/part-snap/snap_src/analyze.f90:33
BYFL_DATA_STRUCT:                         256                  256                  512                   32                   17 malloc                        Unnamed data structure allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:252
BYFL_DATA_STRUCT:                           4                  740                    4                  185                    1 .bss                          Variable ny_gl declared at /users/pakin/work/part-snap/snap_src/geom.f90:64
BYFL_DATA_STRUCT:                           4                  728                   12                  182                    3 stack                         Variable j allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:629
BYFL_DATA_STRUCT:                         240                    0                  720                    0                   32 malloc                        Unnamed data structure allocated in solvar_module::solvar_alloc at /users/pakin/work/part-snap/snap_src/solvar.f90:188
BYFL_DATA_STRUCT:                          48                  512                   56                   64                    6 .bss                          Variable pop declared at /users/pakin/work/part-snap/snap_src/solvar.f90:66
BYFL_DATA_STRUCT:                           4                  512                    4                  128                    1 .bss                          Variable jub declared at /users/pakin/work/part-snap/snap_src/geom.f90:64
BYFL_DATA_STRUCT:                           4                  360                  124                   90                   31 stack                         Variable g allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:58
BYFL_DATA_STRUCT:                          64                    0                  448                    0                    7 stack                         Variable error allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:92
BYFL_DATA_STRUCT:                           8                  208                  200                   26                   25 .bss                          Variable tinrsrc declared at /users/pakin/work/part-snap/snap_src/time.f90:41
BYFL_DATA_STRUCT:                           8                  208                  200                   26                   25 .bss                          Variable tsweeps declared at /users/pakin/work/part-snap/snap_src/time.f90:42
BYFL_DATA_STRUCT:                           4                  400                    4                  100                    1 .bss                          Variable yhip declared at /users/pakin/work/part-snap/snap_src/plib.f90:110
BYFL_DATA_STRUCT:                           4                  400                    4                  100                    1 .bss                          Variable ylop declared at /users/pakin/work/part-snap/snap_src/plib.f90:110
BYFL_DATA_STRUCT:                           4                  400                    4                  100                    1 .bss                          Variable zhip declared at /users/pakin/work/part-snap/snap_src/plib.f90:110
BYFL_DATA_STRUCT:                           4                  400                    4                  100                    1 .bss                          Variable zlop declared at /users/pakin/work/part-snap/snap_src/plib.f90:110
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 stack                         Variable t1 allocated in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:61
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 stack                         Variable t2 allocated in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:61
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 stack                         Variable t3 allocated in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:61
BYFL_DATA_STRUCT:                           8                  200                  200                   25                   25 stack                         Variable t4 allocated in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:61
BYFL_DATA_STRUCT:                           4                    0                  400                    0                  100 .bss                          Variable mtag declared at /users/pakin/work/part-snap/snap_src/sweep.f90:49
BYFL_DATA_STRUCT:                           4                    0                  400                    0                  100 .bss                          Variable yp_rcv declared at /users/pakin/work/part-snap/snap_src/sweep.f90:49
BYFL_DATA_STRUCT:                           4                    0                  400                    0                  100 .bss                          Variable yp_snd declared at /users/pakin/work/part-snap/snap_src/sweep.f90:49
BYFL_DATA_STRUCT:                           4                    0                  400                    0                  100 .bss                          Variable zp_rcv declared at /users/pakin/work/part-snap/snap_src/sweep.f90:49
BYFL_DATA_STRUCT:                           4                    0                  400                    0                  100 .bss                          Variable zp_snd declared at /users/pakin/work/part-snap/snap_src/sweep.f90:49
BYFL_DATA_STRUCT:                           4                  240                  132                   60                   33 stack                         Variable g allocated in analyze_module::pop_calc at /users/pakin/work/part-snap/snap_src/analyze.f90:50
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.0 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.0 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:1
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.0.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.1.i allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:63
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.1.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.2.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.25 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:42
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.37.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.39 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:1
BYFL_DATA_STRUCT:                         480                  320                   32                   80                    6 stack                         Variable dt_parm.9.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                           4                  348                    0                   87                    0 .bss                          Variable iproc declared at /users/pakin/work/part-snap/snap_src/plib.f90:109
BYFL_DATA_STRUCT:                         480                  240                   64                   60                   12 stack                         Variable dt_parm.24.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                           4                  260                    4                   65                    1 .bss                          Variable jlb declared at /users/pakin/work/part-snap/snap_src/geom.f90:64
BYFL_DATA_STRUCT:                          64                  130                  128                    4                    2 stack                         Variable arg allocated in utils_module::cmdarg at /users/pakin/work/part-snap/snap_src/utils.f90:42
BYFL_DATA_STRUCT:                         240                  240                    0                    1                    0 malloc                        Unnamed data structure allocated in plib_module::rtsum_d_1d at /users/pakin/work/part-snap/snap_src/plib.f90:526
BYFL_DATA_STRUCT:                           8                  240                    0                   30                    0 stack                         Variable .iend0.90 allocated in translv_._omp_fn.0 at /users/pakin/work/part-snap/snap_src/translv.f90:156
BYFL_DATA_STRUCT:                           8                  240                    0                   30                    0 stack                         Variable .istart0.89 allocated in translv_._omp_fn.0 at /users/pakin/work/part-snap/snap_src/translv.f90:156
BYFL_DATA_STRUCT:                           8                    0                  240                    0                   60 stack                         Variable co allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:61
BYFL_DATA_STRUCT:                           4                  236                    4                   59                    1 stack                         Variable k allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:58
BYFL_DATA_STRUCT:                           4                    0                  240                    0                   60 stack                         Variable mtag allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:58
BYFL_DATA_STRUCT:                           4                  240                    0                   60                    0 .bss                          Variable sproc declared at /users/pakin/work/part-snap/snap_src/plib.f90:109
BYFL_DATA_STRUCT:                           8                  216                    0                   27                    0 .data                         Variable epsi declared at /users/pakin/work/part-snap/snap_src/control.f90:40
BYFL_DATA_STRUCT:                         120                    0                  212                    0                   24 stack                         Variable ipak allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:499
BYFL_DATA_STRUCT:                           4                  100                  100                   25                   25 stack                         Variable .omp_data_o.84 allocated in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:42
BYFL_DATA_STRUCT:                           4                  100                  100                   25                   25 LLVM store instruction        Unknown data structure accessed in inner_module::inner at /users/pakin/work/part-snap/snap_src/inner.f90:227
BYFL_DATA_STRUCT:                         168                   16                  176                    2                   17 .bss                          Variable qim declared at /users/pakin/work/part-snap/snap_src/data.f90:61
BYFL_DATA_STRUCT:                         480                  128                   32                   32                    6 stack                         Variable dt_parm.10.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                  160                    0                   30 stack                         Variable dt_parm.33 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:1
BYFL_DATA_STRUCT:                         120                    0                  160                    0                    6 stack                         Variable dpak allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:501
BYFL_DATA_STRUCT:                          16                  100                   60                   15                   10 stack                         Variable .omp_data_o.102 allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:45
BYFL_DATA_STRUCT:                           4                  156                    0                   39                    0 .bss                          Variable comm_snap declared at /users/pakin/work/part-snap/snap_src/plib.f90:109
BYFL_DATA_STRUCT:                         232                    0                  152                    0                   26 stack                         Variable open_parm.7 allocated in utils_module::open_file at /users/pakin/work/part-snap/snap_src/utils.f90:89
BYFL_DATA_STRUCT:                           4                  152                    0                   38                    0 .data                         Variable npey declared at /users/pakin/work/part-snap/snap_src/plib.f90:63
BYFL_DATA_STRUCT:                           4                  144                    0                   36                    0 .bss                          Variable nproc declared at /users/pakin/work/part-snap/snap_src/plib.f90:109
BYFL_DATA_STRUCT:                           4                  132                    0                   33                    0 .bss                          Variable it_det declared at /users/pakin/work/part-snap/snap_src/control.f90:37
BYFL_DATA_STRUCT:                          64                   64                   64                    1                    1 .bss                          Variable ifile declared at /users/pakin/work/part-snap/snap_src/global.f90:35
BYFL_DATA_STRUCT:                          64                   64                   64                    1                    1 .bss                          Variable ofile declared at /users/pakin/work/part-snap/snap_src/global.f90:35
BYFL_DATA_STRUCT:                          64                  128                    0                    2                    0 stack                         Variable str.9 allocated in utils_module::cmdarg at /users/pakin/work/part-snap/snap_src/utils.f90:26
BYFL_DATA_STRUCT:                          64                    0                  128                    0                    2 stack                         Variable tname allocated in utils_module::open_file at /users/pakin/work/part-snap/snap_src/utils.f90:111
BYFL_DATA_STRUCT:                           8                   64                   56                    8                    7 .bss                          Variable tparam declared at /users/pakin/work/part-snap/snap_src/time.f90:41
BYFL_DATA_STRUCT:                           4                  120                    0                   30                    0 .bss                          Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/output.f90:232
BYFL_DATA_STRUCT:                           4                  120                    0                   30                    0 .bss                          Variable comm_space declared at /users/pakin/work/part-snap/snap_src/plib.f90:109
BYFL_DATA_STRUCT:                           4                  120                    0                   30                    0 .data                         Variable nthreads declared at /users/pakin/work/part-snap/snap_src/plib.f90:63
BYFL_DATA_STRUCT:                           4                  120                    0                   30                    0 stack                         Variable rank allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:59
BYFL_DATA_STRUCT:                           4                   16                   84                    4                   21 stack                         Variable ierr allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:49
BYFL_DATA_STRUCT:                           8                    0                   88                    0                   11 .bss                          Variable dfmxo declared at /users/pakin/work/part-snap/snap_src/control.f90:60
BYFL_DATA_STRUCT:                           8                   48                   40                    6                    5 .bss                          Variable tinners declared at /users/pakin/work/part-snap/snap_src/time.f90:41
BYFL_DATA_STRUCT:                           8                   48                   40                    6                    5 .bss                          Variable totrsrc declared at /users/pakin/work/part-snap/snap_src/time.f90:41
BYFL_DATA_STRUCT:                           4                   40                   48                   10                   12 stack                         Variable ierr allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:94
BYFL_DATA_STRUCT:                          40                   40                   40                    1                    1 stack                         Variable D.2079.sroa.4 allocated in geom_module::diag_setup at /users/pakin/work/part-snap/snap_src/geom.f90:222
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 LLVM store instruction        Unknown data structure accessed in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 LLVM store instruction        Unknown data structure accessed in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 LLVM store instruction        Unknown data structure accessed in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 LLVM store instruction        Unknown data structure accessed in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 LLVM store instruction        Unknown data structure accessed in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 LLVM store instruction        Unknown data structure accessed in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 LLVM store instruction        Unknown data structure accessed in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 stack                         Variable t1 allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:64
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 stack                         Variable t2 allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:64
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 stack                         Variable t3 allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:64
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 stack                         Variable t4 allocated in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:64
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 stack                         Variable t5 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:51
BYFL_DATA_STRUCT:                           8                   40                   40                    5                    5 stack                         Variable t6 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:51
BYFL_DATA_STRUCT:                          48                   16                   56                    2                    6 .bss                          Variable v declared at /users/pakin/work/part-snap/snap_src/data.f90:55
BYFL_DATA_STRUCT:                           4                   16                   56                    4                   14 stack                         Variable ierr allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                   64                    4                   16                    1 .bss                          Variable kub declared at /users/pakin/work/part-snap/snap_src/geom.f90:64
BYFL_DATA_STRUCT:                         480                    0                   64                    0                   12 stack                         Variable dt_parm.22.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   64                    0                   12 stack                         Variable dt_parm.23.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                          64                    0                   64                    0                    1 stack                         Variable error allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:60
BYFL_DATA_STRUCT:                          64                    0                   64                    0                    2 stack                         Variable error allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:196
BYFL_DATA_STRUCT:                          64                    0                   64                    0                    1 stack                         Variable error allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:56
BYFL_DATA_STRUCT:                          64                    0                   64                    0                    1 stack                         Variable error allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:47
BYFL_DATA_STRUCT:                          56                   56                    0                    1                    0 LLVM call instruction         Unknown data structure accessed in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:448
BYFL_DATA_STRUCT:                          56                    0                   56                    0                   10 stack                         Variable close_parm.5 allocated in utils_module::close_file at /users/pakin/work/part-snap/snap_src/utils.f90:138
BYFL_DATA_STRUCT:                          48                    0                   48                    0                    5 stack                         Variable parm.0 allocated in version_module::version_print at /users/pakin/work/part-snap/snap_src/version.f90:35
BYFL_DATA_STRUCT:                           4                   24                   24                    6                    6 stack                         Variable cy_iits allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:49
BYFL_DATA_STRUCT:                           4                   20                   28                    5                    7 stack                         Variable otno allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:49
BYFL_DATA_STRUCT:                         480                    0                   44                    0                    8 stack                         Variable dt_parm.4 allocated in version_module::version_print at /users/pakin/work/part-snap/snap_src/version.f90:35
BYFL_DATA_STRUCT:                         480                    0                   40                    0                    7 stack                         Variable dt_parm.10 allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:40
BYFL_DATA_STRUCT:                          40                   40                    0                    1                    0 stack                         Variable diag_type.16.sroa.3 allocated in geom_module::diag_setup at /users/pakin/work/part-snap/snap_src/geom.f90:222
BYFL_DATA_STRUCT:                           8                   40                    0                    5                    0 stack                         Variable x allocated in plib_module::glmax_d at /users/pakin/work/part-snap/snap_src/plib.f90:370
BYFL_DATA_STRUCT:                           4                   20                   20                    5                    5 stack                         Variable .omp_data_o.88 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:1
BYFL_DATA_STRUCT:                           4                   20                   20                    5                    5 LLVM store instruction        Unknown data structure accessed in outer_module::outer at /users/pakin/work/part-snap/snap_src/outer.f90:243
BYFL_DATA_STRUCT:                           4                   36                    4                    9                    1 .bss                          Variable klb declared at /users/pakin/work/part-snap/snap_src/geom.f90:64
BYFL_DATA_STRUCT:                           4                   20                   20                    5                    5 stack                         Variable out_iits allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:49
BYFL_DATA_STRUCT:                           4                   28                    8                    7                    2 .bss                          Variable otrdone declared at /users/pakin/work/part-snap/snap_src/control.f90:56
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.0.i allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:63
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.1 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.1 allocated in version_module::version_print at /users/pakin/work/part-snap/snap_src/version.f90:35
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.10 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.11 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.11.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.12 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.12.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.13 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.13.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.14.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.15.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.16.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.17.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.18 allocated in analyze_module::pop_calc at /users/pakin/work/part-snap/snap_src/analyze.f90:33
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.18.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.19 allocated in analyze_module::pop_calc at /users/pakin/work/part-snap/snap_src/analyze.f90:33
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.2 allocated in utils_module::stop_run at /users/pakin/work/part-snap/snap_src/utils.f90:205
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.2 allocated in version_module::version_print at /users/pakin/work/part-snap/snap_src/version.f90:35
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.2 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.2.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.20.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.21.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.23 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:1
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.29.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.3 allocated in version_module::version_print at /users/pakin/work/part-snap/snap_src/version.f90:35
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.3 allocated in utils_module::print_error at /users/pakin/work/part-snap/snap_src/utils.f90:173
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.3 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.3.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.3.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.30.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.31.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.32.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.33.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.34.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.36.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.37 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:1
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.4 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.4.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.4.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.5 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.5 allocated in version_module::version_print at /users/pakin/work/part-snap/snap_src/version.f90:35
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.5.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.5.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.6 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.6.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.6.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.7 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.7.i allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:130
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.7.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.8 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.8.i allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:82
BYFL_DATA_STRUCT:                         480                    0                   32                    0                    6 stack                         Variable dt_parm.9 allocated in time_module::time_summ at /users/pakin/work/part-snap/snap_src/time.f90:69
BYFL_DATA_STRUCT:                           8                   16                   16                    2                    2 .bss                          Variable tparset declared at /users/pakin/work/part-snap/snap_src/time.f90:40
BYFL_DATA_STRUCT:                           8                   28                    0                    7                    0 stack                         Variable x allocated in plib_module::glmax_i at /users/pakin/work/part-snap/snap_src/plib.f90:339
BYFL_DATA_STRUCT:                           4                   28                    0                    7                    0 .data                         Variable iitm declared at /users/pakin/work/part-snap/snap_src/control.f90:37
BYFL_DATA_STRUCT:                           4                   28                    0                    7                    0 .data                         Variable npez declared at /users/pakin/work/part-snap/snap_src/plib.f90:63
BYFL_DATA_STRUCT:                           8                   24                    0                    3                    0 .data                         Variable lx declared at /users/pakin/work/part-snap/snap_src/geom.f90:37
BYFL_DATA_STRUCT:                           8                   24                    0                    3                    0 .data                         Variable ly declared at /users/pakin/work/part-snap/snap_src/geom.f90:37
BYFL_DATA_STRUCT:                           8                   24                    0                    3                    0 .data                         Variable lz declared at /users/pakin/work/part-snap/snap_src/geom.f90:37
BYFL_DATA_STRUCT:                           8                   16                    8                    2                    1 stack                         Variable t1 allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:96
BYFL_DATA_STRUCT:                           8                   16                    8                    2                    1 stack                         Variable t1 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:51
BYFL_DATA_STRUCT:                           4                   20                    4                    5                    1 .bss                          Variable nz_gl declared at /users/pakin/work/part-snap/snap_src/geom.f90:64
BYFL_DATA_STRUCT:                         480                    0                   20                    0                    4 stack                         Variable dt_parm.21 allocated in analyze_module::pop_calc at /users/pakin/work/part-snap/snap_src/analyze.f90:33
BYFL_DATA_STRUCT:                           4                    8                   12                    2                    3 stack                         Variable ierr allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:54
BYFL_DATA_STRUCT:                           4                   20                    0                    5                    0 .bss                          Variable mat_opt declared at /users/pakin/work/part-snap/snap_src/data.f90:32
BYFL_DATA_STRUCT:                           4                    8                   12                    2                    3 stack                         Variable n allocated in utils_module::cmdarg at /users/pakin/work/part-snap/snap_src/utils.f90:44
BYFL_DATA_STRUCT:                           8                    0                   16                    0                    4 stack                         Variable remain allocated in plib_module::pcomm_set at /users/pakin/work/part-snap/snap_src/plib.f90:226
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t1 allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:56
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t1 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:63
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t1 allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:65
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t2 allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:96
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t2 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:51
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t2 allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:65
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t2 allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:56
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t2 allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:63
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t3 allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:96
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t3 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:51
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t4 allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:96
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t4 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:51
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t5 allocated in main at /users/pakin/work/part-snap/snap_src/snap_main.f90:96
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 stack                         Variable t7 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:51
BYFL_DATA_STRUCT:                           8                   16                    0                    2                    0 .bss                          Variable tf declared at /users/pakin/work/part-snap/snap_src/control.f90:40
BYFL_DATA_STRUCT:                           8                    8                    8                    1                    1 .bss                          Variable tslv declared at /users/pakin/work/part-snap/snap_src/time.f90:41
BYFL_DATA_STRUCT:                           4                    8                    8                    2                    2 stack                         Variable cy allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:49
BYFL_DATA_STRUCT:                           4                   12                    4                    3                    1 .data                         Variable nsteps declared at /users/pakin/work/part-snap/snap_src/control.f90:37
BYFL_DATA_STRUCT:                           4                   16                    0                    4                    0 .data                         Variable oitm declared at /users/pakin/work/part-snap/snap_src/control.f90:37
BYFL_DATA_STRUCT:                           4                    8                    8                    2                    2 stack                         Variable tot_iits allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:49
BYFL_DATA_STRUCT:                           4                    8                    4                    2                    1 .bss                          Variable do_nested declared at /users/pakin/work/part-snap/snap_src/plib.f90:114
BYFL_DATA_STRUCT:                           4                   12                    0                    3                    0 .bss                          Variable fluxp declared at /users/pakin/work/part-snap/snap_src/control.f90:38
BYFL_DATA_STRUCT:                           4                    4                    8                    1                    2 stack                         Variable ierr allocated in output_module::output at /users/pakin/work/part-snap/snap_src/output.f90:58
BYFL_DATA_STRUCT:                           4                   12                    0                    3                    0 .bss                          Variable scatp declared at /users/pakin/work/part-snap/snap_src/data.f90:32
BYFL_DATA_STRUCT:                           4                   12                    0                    3                    0 .data                         Variable soloutp declared at /users/pakin/work/part-snap/snap_src/control.f90:38
BYFL_DATA_STRUCT:                           4                   12                    0                    3                    0 .bss                          Variable zproc declared at /users/pakin/work/part-snap/snap_src/plib.f90:110
BYFL_DATA_STRUCT:                         144                    8                    0                    1                    0 .bss                          Variable ref_fluxm declared at /users/pakin/work/part-snap/snap_src/mms.f90:56
BYFL_DATA_STRUCT:                         120                    8                    0                    1                    0 .bss                          Variable ref_flux declared at /users/pakin/work/part-snap/snap_src/mms.f90:54
BYFL_DATA_STRUCT:                           8                    8                    0                    1                    0 LLVM load instruction         Unknown data structure accessed in mms_module::mms_deallocate at /users/pakin/work/part-snap/snap_src/mms.f90:167
BYFL_DATA_STRUCT:                           8                    8                    0                    1                    0 LLVM load instruction         Unknown data structure accessed in mms_module::mms_deallocate at /users/pakin/work/part-snap/snap_src/mms.f90:168
BYFL_DATA_STRUCT:                           8                    8                    0                    1                    0 LLVM load instruction         Unknown data structure accessed in mms_module::mms_deallocate at /users/pakin/work/part-snap/snap_src/mms.f90:169
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    2 stack                         Variable dims allocated in plib_module::pcomm_set at /users/pakin/work/part-snap/snap_src/plib.f90:222
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    2 stack                         Variable periodic allocated in plib_module::pcomm_set at /users/pakin/work/part-snap/snap_src/plib.f90:226
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    1 .bss                          Variable tgrind declared at /users/pakin/work/part-snap/snap_src/time.f90:42
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    1 stack                         Variable time allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:51
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    1 .bss                          Variable tinp declared at /users/pakin/work/part-snap/snap_src/time.f90:40
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    1 .bss                          Variable tinrmisc declared at /users/pakin/work/part-snap/snap_src/time.f90:42
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    1 .bss                          Variable tout declared at /users/pakin/work/part-snap/snap_src/time.f90:42
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    1 .bss                          Variable tset declared at /users/pakin/work/part-snap/snap_src/time.f90:40
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    1 .bss                          Variable tslvmisc declared at /users/pakin/work/part-snap/snap_src/time.f90:42
BYFL_DATA_STRUCT:                           8                    0                    8                    0                    1 .bss                          Variable tsnap declared at /users/pakin/work/part-snap/snap_src/time.f90:40
BYFL_DATA_STRUCT:                           4                    4                    4                    1                    1 stack                         Variable .omp_data_o.87 allocated in translv_ at /users/pakin/work/part-snap/snap_src/translv.f90:1
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 malloc                        Unnamed data structure allocated in sn_module::sn_allocate at /users/pakin/work/part-snap/snap_src/sn.f90:100
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable mie allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable mis allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable mje allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable mjs allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable mke allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable mks allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable qie allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:63
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable qis allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable qje allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:63
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable qjs allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:63
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable qke allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:63
BYFL_DATA_STRUCT:                           4                    0                    8                    0                    2 stack                         Variable qks allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:63
BYFL_DATA_STRUCT:                           4                    8                    0                    2                    0 .bss                          Variable yproc declared at /users/pakin/work/part-snap/snap_src/plib.f90:110
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .bss                          Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:215
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .bss                          Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:215
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .data                         Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:149
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .data                         Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:205
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .data                         Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:215
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .data                         Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:194
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .data                         Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/input.f90:449
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .data                         Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:123
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .data                         Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:130
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 .data                         Variable __unknown__ declared at /users/pakin/work/part-snap/snap_src/snap_main.f90:195
BYFL_DATA_STRUCT:                           4                    0                    4                    0                    1 stack                         Variable dlen allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:497
BYFL_DATA_STRUCT:                           4                    0                    4                    0                    1 stack                         Variable flg allocated in setup_module::setup at /users/pakin/work/part-snap/snap_src/setup.f90:62
BYFL_DATA_STRUCT:                           4                    0                    4                    0                    1 stack                         Variable ilen allocated in input_module::read_input at /users/pakin/work/part-snap/snap_src/input.f90:497
BYFL_DATA_STRUCT:                           4                    0                    4                    0                    1 stack                         Variable reorder allocated in plib_module::pcomm_set at /users/pakin/work/part-snap/snap_src/plib.f90:224
BYFL_DATA_STRUCT:                           4                    0                    4                    0                    1 .bss                          Variable thread_funneled declared at /users/pakin/work/part-snap/snap_src/plib.f90:111
BYFL_DATA_STRUCT:                           4                    0                    4                    0                    1 .bss                          Variable thread_serialized declared at /users/pakin/work/part-snap/snap_src/plib.f90:111
BYFL_DATA_STRUCT:                           4                    0                    4                    0                    1 .bss                          Variable thread_single declared at /users/pakin/work/part-snap/snap_src/plib.f90:111
BYFL_DATA_STRUCT:                           4                    4                    0                    1                    0 stack                         Variable x allocated in plib_module::pinit_omp at /users/pakin/work/part-snap/snap_src/plib.f90:339
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:           374,665,400,010 bytes (295,524,788,218 loaded + 79,140,611,792 stored)
BYFL_SUMMARY:               132,250,493 unique bytes (9,517 from single-target loads and stores + 132,241,328 from multiple-target loads and stores - 352 overlapped)
BYFL_SUMMARY:                     1,928 addresses cover 50% of all dynamic loads and stores
BYFL_SUMMARY:            32,338,525,886 flops
BYFL_SUMMARY:           127,617,523,166 integer ops
BYFL_SUMMARY:            31,201,252,844 memory ops (25,903,773,578 loads + 5,297,479,266 stores)
BYFL_SUMMARY:            13,443,620,050 branch ops (1,174,485,110 unconditional and direct + 12,235,855,007 conditional or indirect + 33,279,933 function calls or returns + 0 other)
BYFL_SUMMARY:           204,600,921,946 TOTAL OPS
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:         2,997,323,200,080 bits (2,364,198,305,744 loaded + 633,124,894,336 stored)
BYFL_SUMMARY:             1,058,003,944 unique bits
BYFL_SUMMARY:         5,878,245,176,436 flop bits
BYFL_SUMMARY:        25,348,531,602,411 op bits (excluding memory ops)
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:             4,129,912,164 bytes stored by 18,034,862 calls to memset()
BYFL_SUMMARY:                24,582,760 bytes loaded and stored by 24,035 calls to memcpy() or memmove()
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:            11,208,258,983 vector operations (FP & int)
BYFL_SUMMARY:                    2.0000 elements per vector
BYFL_SUMMARY:                   64.0000 bits per element
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:                         2 loads of 8-bit integers
BYFL_SUMMARY:             1,646,147,718 loads of 32-bit integers
BYFL_SUMMARY:               495,197,206 loads of 64-bit integers
BYFL_SUMMARY:            10,093,956,453 loads of 64-bit floating-point values
BYFL_SUMMARY:                        35 loads of vectors of 32-bit integers
BYFL_SUMMARY:            11,859,898,775 loads of vectors of 64-bit floating-point values
BYFL_SUMMARY:               295,551,799 loads of pointers to 8-bit integers
BYFL_SUMMARY:               700,561,350 loads of pointers to 32-bit integers
BYFL_SUMMARY:                49,152,000 loads of pointers to 64-bit floating-point values
BYFL_SUMMARY:               763,308,240 loads of pointers to oddly sized "other" values (not integers or FP values)
BYFL_SUMMARY:               295,194,338 stores of 32-bit integers
BYFL_SUMMARY:                 2,760,670 stores of 64-bit integers
BYFL_SUMMARY:               255,931,400 stores of 64-bit floating-point values
BYFL_SUMMARY:                     5,052 stores of vectors of 32-bit integers
BYFL_SUMMARY:                        55 stores of vectors of 64-bit integers
BYFL_SUMMARY:             4,742,689,270 stores of vectors of 64-bit floating-point values
BYFL_SUMMARY:                    58,166 stores of pointers to 8-bit integers
BYFL_SUMMARY:                   288,180 stores of pointers to 32-bit integers
BYFL_SUMMARY:                    24,000 stores of pointers to 64-bit floating-point values
BYFL_SUMMARY:                   528,135 stores of pointers to oddly sized "other" values (not integers or FP values)
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:            35,468,917,753 Add            instructions executed
BYFL_SUMMARY:            25,903,773,578 Load           instructions executed
BYFL_SUMMARY:            25,519,370,914 GetElementPtr  instructions executed
BYFL_SUMMARY:            15,362,034,392 PHI            instructions executed
BYFL_SUMMARY:            15,244,113,170 BitCast        instructions executed
BYFL_SUMMARY:            13,410,340,107 Br             instructions executed
BYFL_SUMMARY:            12,452,532,697 ICmp           instructions executed
BYFL_SUMMARY:            11,220,853,823 FMul           instructions executed
BYFL_SUMMARY:             7,385,149,646 FAdd           instructions executed
BYFL_SUMMARY:             5,297,479,266 Store          instructions executed
BYFL_SUMMARY:             2,359,787,660 FSub           instructions executed
BYFL_SUMMARY:             1,084,288,238 Mul            instructions executed
BYFL_SUMMARY:               595,712,809 Or             instructions executed
BYFL_SUMMARY:               565,827,708 And            instructions executed
BYFL_SUMMARY:               400,742,742 SExt           instructions executed
BYFL_SUMMARY:               149,828,465 Shl            instructions executed
BYFL_SUMMARY:               137,626,356 FCmp           instructions executed
BYFL_SUMMARY:                99,840,126 SIToFP         instructions executed
BYFL_SUMMARY:                99,533,270 ShuffleVector  instructions executed
BYFL_SUMMARY:                99,533,260 InsertElement  instructions executed
BYFL_SUMMARY:                74,798,786 Sub            instructions executed
BYFL_SUMMARY:                62,452,558 Select         instructions executed
BYFL_SUMMARY:                60,603,051 Trunc          instructions executed
BYFL_SUMMARY:                49,312,421 Xor            instructions executed
BYFL_SUMMARY:                33,202,490 Call           instructions executed
BYFL_SUMMARY:                26,542,652 FDiv           instructions executed
BYFL_SUMMARY:                   409,427 Alloca         instructions executed
BYFL_SUMMARY:                    77,443 Ret            instructions executed
BYFL_SUMMARY:                    24,316 SDiv           instructions executed
BYFL_SUMMARY:                     6,730 AShr           instructions executed
BYFL_SUMMARY:                     5,482 ZExt           instructions executed
BYFL_SUMMARY:                       148 SRem           instructions executed
BYFL_SUMMARY:                        30 UDiv           instructions executed
BYFL_SUMMARY:                        10 Switch         instructions executed
BYFL_SUMMARY:                         5 ExtractElement instructions executed
BYFL_SUMMARY:           173,164,721,529 TOTAL          instructions executed
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:            19,379,408,799 Add(PHI, [Constant])                          dependencies executed
BYFL_SUMMARY:            14,948,121,643 BitCast(GetElementPtr)                        dependencies executed
BYFL_SUMMARY:            12,809,756,745 GetElementPtr(Load, [Constant], ...)          dependencies executed
BYFL_SUMMARY:            11,991,279,648 GetElementPtr(BitCast, Add)                   dependencies executed
BYFL_SUMMARY:            11,859,901,710 Load(BitCast)                                 dependencies executed
BYFL_SUMMARY:            11,785,154,785 Load(GetElementPtr)                           dependencies executed
BYFL_SUMMARY:            11,558,189,406 Br(ICmp, [Constant], ...)                     dependencies executed
BYFL_SUMMARY:            11,087,118,750 Add(PHI, Add)                                 dependencies executed
BYFL_SUMMARY:             7,955,251,280 FMul(Load, Load)                              dependencies executed
BYFL_SUMMARY:             6,424,958,335 PHI([Constant], Add)                          dependencies executed
BYFL_SUMMARY:            53,365,580,428                                               additional dependencies executed
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:                       256 bytes cover  23.5% of memory accesses
BYFL_SUMMARY:                       580 bytes cover  32.2% of memory accesses
BYFL_SUMMARY:                     1,140 bytes cover  39.9% of memory accesses
BYFL_SUMMARY:                     1,528 bytes cover  45.0% of memory accesses
BYFL_SUMMARY:                     1,928 bytes cover  50.3% of memory accesses
BYFL_SUMMARY:                     2,444 bytes cover  57.1% of memory accesses
BYFL_SUMMARY:                 1,969,112 bytes cover  84.8% of memory accesses
BYFL_SUMMARY:                 3,969,292 bytes cover  95.2% of memory accesses
BYFL_SUMMARY:               132,250,493 bytes cover 100.0% of memory accesses
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:                    3.7342 bytes loaded per byte stored
BYFL_SUMMARY:                    7.8972 ops per load instruction
BYFL_SUMMARY:                   96.0642 bits loaded/stored per memory op
BYFL_SUMMARY:                    2.6429 flops per conditional/indirect branch
BYFL_SUMMARY:                   16.7187 ops per conditional/indirect branch
BYFL_SUMMARY:                    0.9160 vector ops (FP & int) per conditional/indirect branch
BYFL_SUMMARY:                    0.3466 vector ops (FP & int) per flop
BYFL_SUMMARY:                    0.0548 vector ops (FP & int) per op
BYFL_SUMMARY:                    1.1813 ops per instruction
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:                   11.5857 bytes per flop
BYFL_SUMMARY:                    0.5099 bits per flop bit
BYFL_SUMMARY:                    1.8315 bytes per op
BYFL_SUMMARY:                    0.1182 bits per (non-memory) op bit
BYFL_SUMMARY: -----------------------------------------------------------------
BYFL_SUMMARY:                    0.0041 unique bytes per flop
BYFL_SUMMARY:                    0.0002 unique bits per flop bit
BYFL_SUMMARY:                    0.0006 unique bytes per op
BYFL_SUMMARY:                    0.0000 unique bits per (non-memory) op bit
BYFL_SUMMARY:                2,832.9981 bytes per unique byte
BYFL_SUMMARY: -----------------------------------------------------------------

Byfl writes only a subset of information to the standard output device. More detailed information is written to a binary .byfl file. This can be postprocessed into forms that are more amenable to analysis. For example, here's how to convert the .byfl file produced by the above into an XML spreadsheet:

$ bfbin2xmlss ./snap.byfl snap-static-nofix.xml

We loaded the resulting file into Excel, re-saved in .xlsx format, and uploaded it to Google Docs for convenient viewing online:

The spreadsheet includes the following tabs, which showcase the richness of Byfl instrumentation:

  • Basic blocks
  • Basic-block accesses
  • Functions
  • Called functions
  • Vector operations
  • Data-structure accesses
  • Strided accesses
  • Program
  • Memory accesses by data type
  • Instruction mix
  • Instruction dependencies
  • Memory locality
  • Environment variables
  • Command line
  • Byfl options
  • System information
Clone this wiki locally