Skip to content
Martin Popel edited this page Apr 1, 2016 · 12 revisions

Current results

MAXMEM is maximum (resident set size) memory (ps -orss) in MiB. Other columns are time in seconds. Run on x86_64. Each benchmark was repeated 10 or 20 times, we report the average (mean). RSD=relative standard deviation=stdev/mean.

data/UD_Czech/cs-ud-train-l.conllu (68 MB, 41k sentences, 0.8 MWords):

REPEATS=10 hostname=cosmos (older results)

experiment TOTAL MAXMEM init load save iter iterF read write rehang remove add reorder RSD end
old_Treex 2989.996 18023.746 2.772 2501.309 201.291 7.647 3.169 9.185 11.618 55.882 58.347 47.265 35.765
pytreex 260.962 3806.632 0.224 181.974 8.677 3.264 1.248 3.910 3.681 8.273 9.691 22.104 11.931 0.004
perlCa 50.790 1046.105 0.214 10.492 4.817 1.731 1.133 2.262 2.105 5.852 5.256 6.027 8.631 0.008 1.549
perlCl 49.238 1071.524 0.073 10.740 4.652 1.623 1.043 2.159 1.982 6.022 4.612 5.488 7.924 0.011 0.992
utreex 48.999 846.223 0.056 27.113 6.084 0.191 0.191 0.564 0.455 4.645 2.361 4.330 1.110 0.003
perlClAa 38.944 1100.615 0.081 10.882 3.942 0.332 0.300 1.182 0.881 5.054 3.056 3.883 6.323 0.006 1.053
perlA 28.646 824.819 0.079 8.776 3.423 0.263 0.260 0.929 0.715 3.372 2.766 2.607 3.589 0.004 1.091
java 9.476 1593.416 0.118 3.637 1.349 0.396 0.282 0.467 0.317 0.453 0.727 0.620 0.868 0.015
cpp_raw 3.212 356.363 0.008 1.136 1.097 0.041 0.034 0.250 0.177 0.039

REPEATS=20 hostname=cosmos

REAL is the wall-clock time. CPU is user+sys time (sum of all threads).

experiment REAL CPU MAXMEM init load save iter iterF iterS read write rehang remove add reorder free exit RSD
utreex 52.019 50.891 846.202 0.030 27.880 6.345 0.198 0.196 0.872 0.573 0.456 4.742 2.405 4.482 1.129 0.044 2.667 0.024
perlA 25.904 25.361 745.747 0.075 7.970 3.413 0.268 0.265 0.337 0.920 0.722 3.043 2.750 2.590 3.542 0.000 0.007 0.027
java 10.054 21.440 1692.785 0.126 3.607 1.454 0.403 0.288 0.283 0.486 0.352 0.489 0.732 0.789 0.630 0.189 0.225 0.023

REPEATS=20 hostname=tauri2

experiment REAL CPU MAXMEM init load save iter iterF iterS read write rehang remove add reorder free exit RSD
utreex 44.142 43.956 846.288 0.078 24.068 5.868 0.144 0.143 0.724 0.374 0.263 4.505 2.193 2.971 1.050 0.031 1.729 0.007
perlA 23.148 23.031 745.850 0.080 7.668 2.953 0.196 0.193 0.256 0.631 0.529 2.767 2.247 2.340 3.283 0.000 0.005 0.020
java 13.957 36.248 1242.656 0.099 9.225 1.135 0.308 0.199 0.195 0.311 0.228 0.328 0.625 0.436 0.562 0.184 0.121 0.014

REPEATS=10 hostname=tauri2

experiment REAL CPU MAXMEM init load save iter iterF iterS iterN read write rehang remove add reorder exit RSD
pytreex 240.090 240.039 3808.691 0.097 158.064 7.869 2.851 0.990 0.977 15.217 3.291 3.111 7.348 8.918 17.059 11.215 3.086 0.003
utreex 45.508 45.471 879.117 0.029 24.096 5.657 0.143 0.142 0.744 1.726 0.373 0.267 4.579 2.240 3.049 1.215 1.248 0.005
perl 20.646 20.601 748.066 0.077 6.793 2.932 0.193 0.185 1.069 0.589 0.617 0.524 2.441 2.067 1.259 1.863 0.039 0.004
java 14.365 36.185 1323.910 0.099 8.636 0.913 0.309 0.204 0.219 1.389 0.309 0.227 0.322 0.487 0.446 0.740 0.066 0.014